[==========] Running 25 tests from 3 test suites.
[----------] Global test environment set-up.
[----------] 21 tests from TxnParticipantITest
[ RUN ] TxnParticipantITest.TestReplicateParticipantOps
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251211 09:07:07.999290 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:42901
I20251211 09:07:07.999637 479 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 09:07:07.999790 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:08.004158 487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:08.004256 485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:08.004158 484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:08.004320 479 server_base.cc:1047] running on GCE node
I20251211 09:07:08.004555 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:08.004602 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:08.004623 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444028004624 us; error 0 us; skew 500 ppm
I20251211 09:07:08.005643 479 webserver.cc:492] Webserver started at http://127.0.119.254:40177/ using document root <none> and password file <none>
I20251211 09:07:08.005771 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:08.005808 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:08.005868 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:08.006840 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "dc4f6dae505d4672937949da855c1d05"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.008011 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 09:07:08.008526 492 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.008721 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.008795 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "dc4f6dae505d4672937949da855c1d05"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.008859 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:08.026682 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:08.026970 479 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 09:07:08.027053 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:08.031117 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:42901
I20251211 09:07:08.031189 544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:42901 every 8 connection(s)
I20251211 09:07:08.031821 545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:08.034332 545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05: Bootstrap starting.
I20251211 09:07:08.035140 545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:08.035439 545 log.cc:826] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05: Log is configured to *not* fsync() on all Append() calls
I20251211 09:07:08.036034 545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05: No bootstrap required, opened a new log
I20251211 09:07:08.037153 545 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f6dae505d4672937949da855c1d05" member_type: VOTER }
I20251211 09:07:08.037282 545 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:08.037317 545 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc4f6dae505d4672937949da855c1d05, State: Initialized, Role: FOLLOWER
I20251211 09:07:08.037436 545 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f6dae505d4672937949da855c1d05" member_type: VOTER }
I20251211 09:07:08.037504 545 raft_consensus.cc:399] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:07:08.037536 545 raft_consensus.cc:493] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:07:08.037583 545 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:08.038048 545 raft_consensus.cc:515] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f6dae505d4672937949da855c1d05" member_type: VOTER }
I20251211 09:07:08.038136 545 leader_election.cc:304] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc4f6dae505d4672937949da855c1d05; no voters:
I20251211 09:07:08.038290 545 leader_election.cc:290] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:07:08.038364 548 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:08.038509 545 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:07:08.038564 548 raft_consensus.cc:697] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 1 LEADER]: Becoming Leader. State: Replica: dc4f6dae505d4672937949da855c1d05, State: Running, Role: LEADER
I20251211 09:07:08.038672 548 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f6dae505d4672937949da855c1d05" member_type: VOTER }
I20251211 09:07:08.039002 549 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc4f6dae505d4672937949da855c1d05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f6dae505d4672937949da855c1d05" member_type: VOTER } }
I20251211 09:07:08.039033 550 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc4f6dae505d4672937949da855c1d05. Latest consensus state: current_term: 1 leader_uuid: "dc4f6dae505d4672937949da855c1d05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc4f6dae505d4672937949da855c1d05" member_type: VOTER } }
I20251211 09:07:08.039086 549 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:08.039090 550 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:08.039534 555 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:07:08.039961 555 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:07:08.040082 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:07:08.041280 555 catalog_manager.cc:1357] Generated new cluster ID: 0bd288f02089471182dc598c59d976a0
I20251211 09:07:08.041328 555 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:07:08.059132 555 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:07:08.059695 555 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:07:08.074263 555 catalog_manager.cc:6027] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05: Generated new TSK 0
I20251211 09:07:08.074462 555 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:07:08.104282 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:08.106040 568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:08.106065 570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:08.106089 479 server_base.cc:1047] running on GCE node
W20251211 09:07:08.106065 567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:08.106374 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:08.106419 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:08.106446 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444028106445 us; error 0 us; skew 500 ppm
I20251211 09:07:08.107128 479 webserver.cc:492] Webserver started at http://127.0.119.193:40963/ using document root <none> and password file <none>
I20251211 09:07:08.107220 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:08.107270 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:08.107319 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:08.107636 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "7d99157fbe3443b7b2cefcef30a27038"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.108745 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:08.109289 575 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.109445 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.109498 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "7d99157fbe3443b7b2cefcef30a27038"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.109546 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:08.139104 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:08.139426 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:08.139660 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:08.140003 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:08.140050 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.140087 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:08.140113 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.144572 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:33995
I20251211 09:07:08.144609 638 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:33995 every 8 connection(s)
I20251211 09:07:08.144975 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:08.146517 646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:08.146724 479 server_base.cc:1047] running on GCE node
W20251211 09:07:08.146775 642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:08.146646 644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:08.147025 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:08.147064 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:08.147082 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444028147082 us; error 0 us; skew 500 ppm
I20251211 09:07:08.147766 479 webserver.cc:492] Webserver started at http://127.0.119.194:35017/ using document root <none> and password file <none>
I20251211 09:07:08.147853 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:08.147892 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:08.147933 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:08.148241 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "dba82ff7a134491fb19a55bd784d8896"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.149547 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:08.150130 651 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.150262 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251211 09:07:08.150321 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "dba82ff7a134491fb19a55bd784d8896"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.150369 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:08.153434 639 heartbeater.cc:344] Connected to a master server at 127.0.119.254:42901
I20251211 09:07:08.153533 639 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:08.153697 639 heartbeater.cc:507] Master 127.0.119.254:42901 requested a full tablet report, sending...
I20251211 09:07:08.154098 509 ts_manager.cc:194] Registered new tserver with Master: 7d99157fbe3443b7b2cefcef30a27038 (127.0.119.193:33995)
I20251211 09:07:08.154757 509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40330
I20251211 09:07:08.176661 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:08.177320 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:08.177521 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:08.177781 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:08.177819 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.177856 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:08.177882 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.182416 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:39651
I20251211 09:07:08.182466 714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:39651 every 8 connection(s)
I20251211 09:07:08.182879 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:08.184304 721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:08.184566 479 server_base.cc:1047] running on GCE node
W20251211 09:07:08.184621 718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:08.185699 719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:08.185895 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:08.185931 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:08.185948 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444028185949 us; error 0 us; skew 500 ppm
I20251211 09:07:08.186620 479 webserver.cc:492] Webserver started at http://127.0.119.195:41975/ using document root <none> and password file <none>
I20251211 09:07:08.186664 715 heartbeater.cc:344] Connected to a master server at 127.0.119.254:42901
I20251211 09:07:08.186717 715 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:08.186719 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:08.186785 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:08.186827 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:08.186836 715 heartbeater.cc:507] Master 127.0.119.254:42901 requested a full tablet report, sending...
I20251211 09:07:08.187145 509 ts_manager.cc:194] Registered new tserver with Master: dba82ff7a134491fb19a55bd784d8896 (127.0.119.194:39651)
I20251211 09:07:08.187145 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "6bcd71813cfe4151b652b74b6322ed8a"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.187680 509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40342
I20251211 09:07:08.188329 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.000s
I20251211 09:07:08.188804 726 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.188927 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.188978 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "6bcd71813cfe4151b652b74b6322ed8a"
format_stamp: "Formatted at 2025-12-11 09:07:08 on dist-test-slave-hb70"
I20251211 09:07:08.189031 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:08.195506 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:08.195749 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:08.195909 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:08.196123 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:08.196152 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.196183 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:08.196216 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.199985 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:44607
I20251211 09:07:08.200114 789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:44607 every 8 connection(s)
I20251211 09:07:08.208453 790 heartbeater.cc:344] Connected to a master server at 127.0.119.254:42901
I20251211 09:07:08.208550 790 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:08.208654 790 heartbeater.cc:507] Master 127.0.119.254:42901 requested a full tablet report, sending...
I20251211 09:07:08.208889 509 ts_manager.cc:194] Registered new tserver with Master: 6bcd71813cfe4151b652b74b6322ed8a (127.0.119.195:44607)
I20251211 09:07:08.209038 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008873049s
I20251211 09:07:08.209410 509 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40358
I20251211 09:07:08.209591 479 test_util.cc:276] Using random seed: 2016156083
I20251211 09:07:08.216506 509 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40366:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:07:08.216748 509 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:07:08.221601 754 tablet_service.cc:1505] Processing CreateTablet for tablet 1688c49f9d4542c8b8331bb370b39be4 (DEFAULT_TABLE table=test-workload [id=cfc766b19859499780daade77ae5f994]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:08.221817 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1688c49f9d4542c8b8331bb370b39be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:08.221916 603 tablet_service.cc:1505] Processing CreateTablet for tablet 1688c49f9d4542c8b8331bb370b39be4 (DEFAULT_TABLE table=test-workload [id=cfc766b19859499780daade77ae5f994]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:08.222009 603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1688c49f9d4542c8b8331bb370b39be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:08.223462 805 tablet_bootstrap.cc:492] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a: Bootstrap starting.
I20251211 09:07:08.223860 805 tablet_bootstrap.cc:654] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:08.223922 679 tablet_service.cc:1505] Processing CreateTablet for tablet 1688c49f9d4542c8b8331bb370b39be4 (DEFAULT_TABLE table=test-workload [id=cfc766b19859499780daade77ae5f994]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:08.224030 679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1688c49f9d4542c8b8331bb370b39be4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:08.224136 806 tablet_bootstrap.cc:492] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038: Bootstrap starting.
I20251211 09:07:08.224375 805 tablet_bootstrap.cc:492] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a: No bootstrap required, opened a new log
I20251211 09:07:08.224428 805 ts_tablet_manager.cc:1403] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:08.224548 806 tablet_bootstrap.cc:654] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:08.224591 805 raft_consensus.cc:359] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.224673 805 raft_consensus.cc:385] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:08.224728 805 raft_consensus.cc:740] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bcd71813cfe4151b652b74b6322ed8a, State: Initialized, Role: FOLLOWER
I20251211 09:07:08.224823 805 consensus_queue.cc:260] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.225010 806 tablet_bootstrap.cc:492] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038: No bootstrap required, opened a new log
I20251211 09:07:08.225069 805 ts_tablet_manager.cc:1434] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:07:08.225106 806 ts_tablet_manager.cc:1403] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:08.225147 790 heartbeater.cc:499] Master 127.0.119.254:42901 was elected leader, sending a full tablet report...
I20251211 09:07:08.225322 806 raft_consensus.cc:359] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.225383 806 raft_consensus.cc:385] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:08.225405 806 raft_consensus.cc:740] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d99157fbe3443b7b2cefcef30a27038, State: Initialized, Role: FOLLOWER
I20251211 09:07:08.225457 806 consensus_queue.cc:260] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.225605 806 ts_tablet_manager.cc:1434] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:08.225641 639 heartbeater.cc:499] Master 127.0.119.254:42901 was elected leader, sending a full tablet report...
I20251211 09:07:08.225900 810 tablet_bootstrap.cc:492] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896: Bootstrap starting.
I20251211 09:07:08.226152 810 tablet_bootstrap.cc:654] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:08.226739 810 tablet_bootstrap.cc:492] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896: No bootstrap required, opened a new log
I20251211 09:07:08.226785 810 ts_tablet_manager.cc:1403] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:08.226927 810 raft_consensus.cc:359] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.226974 810 raft_consensus.cc:385] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:08.226996 810 raft_consensus.cc:740] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dba82ff7a134491fb19a55bd784d8896, State: Initialized, Role: FOLLOWER
I20251211 09:07:08.227043 810 consensus_queue.cc:260] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.227195 810 ts_tablet_manager.cc:1434] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:07:08.227246 715 heartbeater.cc:499] Master 127.0.119.254:42901 was elected leader, sending a full tablet report...
I20251211 09:07:08.253921 811 raft_consensus.cc:493] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:07:08.254033 811 raft_consensus.cc:515] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.254338 811 leader_election.cc:290] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6bcd71813cfe4151b652b74b6322ed8a (127.0.119.195:44607), dba82ff7a134491fb19a55bd784d8896 (127.0.119.194:39651)
I20251211 09:07:08.257622 764 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1688c49f9d4542c8b8331bb370b39be4" candidate_uuid: "7d99157fbe3443b7b2cefcef30a27038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bcd71813cfe4151b652b74b6322ed8a" is_pre_election: true
I20251211 09:07:08.257743 764 raft_consensus.cc:2468] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d99157fbe3443b7b2cefcef30a27038 in term 0.
I20251211 09:07:08.257637 689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1688c49f9d4542c8b8331bb370b39be4" candidate_uuid: "7d99157fbe3443b7b2cefcef30a27038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba82ff7a134491fb19a55bd784d8896" is_pre_election: true
I20251211 09:07:08.257787 689 raft_consensus.cc:2468] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d99157fbe3443b7b2cefcef30a27038 in term 0.
I20251211 09:07:08.257900 579 leader_election.cc:304] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bcd71813cfe4151b652b74b6322ed8a, 7d99157fbe3443b7b2cefcef30a27038; no voters:
I20251211 09:07:08.258011 811 raft_consensus.cc:2804] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:07:08.258059 811 raft_consensus.cc:493] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:07:08.258075 811 raft_consensus.cc:3060] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:08.258764 811 raft_consensus.cc:515] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.258886 811 leader_election.cc:290] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [CANDIDATE]: Term 1 election: Requested vote from peers 6bcd71813cfe4151b652b74b6322ed8a (127.0.119.195:44607), dba82ff7a134491fb19a55bd784d8896 (127.0.119.194:39651)
I20251211 09:07:08.259032 764 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1688c49f9d4542c8b8331bb370b39be4" candidate_uuid: "7d99157fbe3443b7b2cefcef30a27038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6bcd71813cfe4151b652b74b6322ed8a"
I20251211 09:07:08.259054 689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1688c49f9d4542c8b8331bb370b39be4" candidate_uuid: "7d99157fbe3443b7b2cefcef30a27038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dba82ff7a134491fb19a55bd784d8896"
I20251211 09:07:08.259092 764 raft_consensus.cc:3060] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:08.259114 689 raft_consensus.cc:3060] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:08.259694 764 raft_consensus.cc:2468] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d99157fbe3443b7b2cefcef30a27038 in term 1.
I20251211 09:07:08.259749 689 raft_consensus.cc:2468] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d99157fbe3443b7b2cefcef30a27038 in term 1.
I20251211 09:07:08.259871 579 leader_election.cc:304] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bcd71813cfe4151b652b74b6322ed8a, 7d99157fbe3443b7b2cefcef30a27038; no voters:
I20251211 09:07:08.259964 811 raft_consensus.cc:2804] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:08.260080 811 raft_consensus.cc:697] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 1 LEADER]: Becoming Leader. State: Replica: 7d99157fbe3443b7b2cefcef30a27038, State: Running, Role: LEADER
I20251211 09:07:08.260128 811 consensus_queue.cc:237] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } }
I20251211 09:07:08.260773 509 catalog_manager.cc:5654] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d99157fbe3443b7b2cefcef30a27038 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "7d99157fbe3443b7b2cefcef30a27038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d99157fbe3443b7b2cefcef30a27038" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 } health_report { overall_health: UNKNOWN } } }
I20251211 09:07:08.271844 689 raft_consensus.cc:1275] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 1 FOLLOWER]: Refusing update from remote peer 7d99157fbe3443b7b2cefcef30a27038: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:08.271847 764 raft_consensus.cc:1275] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 1 FOLLOWER]: Refusing update from remote peer 7d99157fbe3443b7b2cefcef30a27038: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:08.272156 811 consensus_queue.cc:1048] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bcd71813cfe4151b652b74b6322ed8a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:08.272287 815 consensus_queue.cc:1048] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dba82ff7a134491fb19a55bd784d8896" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:08.274094 822 mvcc.cc:204] Tried to move back new op lower bound from 7231258739799556096 to 7231258739754090496. Current Snapshot: MvccSnapshot[applied={T|T < 7231258739799556096}]
I20251211 09:07:18.279006 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:07:18.281487 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:18.281628 479 tablet_replica.cc:333] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038: stopping tablet replica
I20251211 09:07:18.281698 479 raft_consensus.cc:2243] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:07:18.281778 479 raft_consensus.cc:2272] T 1688c49f9d4542c8b8331bb370b39be4 P 7d99157fbe3443b7b2cefcef30a27038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:18.295882 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:07:18.296854 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:07:18.299609 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:18.299738 479 tablet_replica.cc:333] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896: stopping tablet replica
I20251211 09:07:18.299791 479 raft_consensus.cc:2243] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:18.299840 479 raft_consensus.cc:2272] T 1688c49f9d4542c8b8331bb370b39be4 P dba82ff7a134491fb19a55bd784d8896 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:18.320165 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:07:18.320961 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:07:18.323549 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:18.323764 479 tablet_replica.cc:333] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a: stopping tablet replica
I20251211 09:07:18.323848 479 raft_consensus.cc:2243] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:18.323904 479 raft_consensus.cc:2272] T 1688c49f9d4542c8b8331bb370b39be4 P 6bcd71813cfe4151b652b74b6322ed8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:18.337548 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:07:18.338384 479 master.cc:561] Master@127.0.119.254:42901 shutting down...
I20251211 09:07:18.341027 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:07:18.341109 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:18.341157 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P dc4f6dae505d4672937949da855c1d05: stopping tablet replica
I20251211 09:07:18.352936 479 master.cc:583] Master@127.0.119.254:42901 shutdown complete.
[ OK ] TxnParticipantITest.TestReplicateParticipantOps (10372 ms)
[ RUN ] TxnParticipantITest.TestWaitOnFinalizeCommit
I20251211 09:07:18.371632 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:39853
I20251211 09:07:18.371815 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:18.373215 879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:18.373225 880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:18.373361 883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:18.373490 479 server_base.cc:1047] running on GCE node
I20251211 09:07:18.373593 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:18.373620 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:18.373642 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444038373642 us; error 0 us; skew 500 ppm
I20251211 09:07:18.374178 479 webserver.cc:492] Webserver started at http://127.0.119.254:35107/ using document root <none> and password file <none>
I20251211 09:07:18.374261 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:18.374308 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:18.374369 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:18.374624 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "b24c6d0202774f12bb14219a11669959"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.375492 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:07:18.375901 888 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.376024 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.376070 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "b24c6d0202774f12bb14219a11669959"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.376114 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:18.381899 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:18.382079 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:18.384709 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:39853
I20251211 09:07:18.393463 940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:39853 every 8 connection(s)
I20251211 09:07:18.394418 941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:18.395681 941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959: Bootstrap starting.
I20251211 09:07:18.395968 941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:18.396471 941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959: No bootstrap required, opened a new log
I20251211 09:07:18.396593 941 raft_consensus.cc:359] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c6d0202774f12bb14219a11669959" member_type: VOTER }
I20251211 09:07:18.396643 941 raft_consensus.cc:385] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:18.396657 941 raft_consensus.cc:740] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b24c6d0202774f12bb14219a11669959, State: Initialized, Role: FOLLOWER
I20251211 09:07:18.396713 941 consensus_queue.cc:260] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c6d0202774f12bb14219a11669959" member_type: VOTER }
I20251211 09:07:18.396752 941 raft_consensus.cc:399] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:07:18.396767 941 raft_consensus.cc:493] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:07:18.396795 941 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:18.397300 941 raft_consensus.cc:515] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c6d0202774f12bb14219a11669959" member_type: VOTER }
I20251211 09:07:18.397363 941 leader_election.cc:304] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b24c6d0202774f12bb14219a11669959; no voters:
I20251211 09:07:18.397471 941 leader_election.cc:290] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:07:18.397531 944 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:18.397629 941 sys_catalog.cc:565] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:07:18.397707 944 raft_consensus.cc:697] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 1 LEADER]: Becoming Leader. State: Replica: b24c6d0202774f12bb14219a11669959, State: Running, Role: LEADER
I20251211 09:07:18.397759 944 consensus_queue.cc:237] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c6d0202774f12bb14219a11669959" member_type: VOTER }
I20251211 09:07:18.397891 944 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b24c6d0202774f12bb14219a11669959. Latest consensus state: current_term: 1 leader_uuid: "b24c6d0202774f12bb14219a11669959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c6d0202774f12bb14219a11669959" member_type: VOTER } }
I20251211 09:07:18.397934 945 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b24c6d0202774f12bb14219a11669959" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24c6d0202774f12bb14219a11669959" member_type: VOTER } }
I20251211 09:07:18.397998 945 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:18.397945 944 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:18.398248 948 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:07:18.398422 948 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:07:18.398993 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:07:18.399008 948 catalog_manager.cc:1357] Generated new cluster ID: cbe06c9a99ef4f1294959bcce8055ffa
I20251211 09:07:18.399080 948 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:07:18.402571 948 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:07:18.402968 948 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:07:18.420521 948 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959: Generated new TSK 0
I20251211 09:07:18.420643 948 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:07:18.430825 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:18.432343 962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:18.432432 963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:18.432523 479 server_base.cc:1047] running on GCE node
W20251211 09:07:18.432411 965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:18.432660 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:18.432695 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:18.432708 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444038432709 us; error 0 us; skew 500 ppm
I20251211 09:07:18.433387 479 webserver.cc:492] Webserver started at http://127.0.119.193:33127/ using document root <none> and password file <none>
I20251211 09:07:18.433461 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:18.433497 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:18.433534 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:18.433781 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.434695 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:18.435154 970 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.435313 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.435395 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.435436 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:18.438582 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:18.438733 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:18.438838 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:18.439033 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:18.439061 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.439082 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:18.439122 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.441905 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:36027
I20251211 09:07:18.441939 1033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:36027 every 8 connection(s)
I20251211 09:07:18.442283 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:18.443435 1038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:18.443526 1039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:18.443655 479 server_base.cc:1047] running on GCE node
W20251211 09:07:18.443650 1041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:18.443912 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:18.443951 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:18.443969 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444038443969 us; error 0 us; skew 500 ppm
I20251211 09:07:18.444599 479 webserver.cc:492] Webserver started at http://127.0.119.194:34169/ using document root <none> and password file <none>
I20251211 09:07:18.444691 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:18.444736 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:18.444787 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:18.445040 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "08b5d900abd44f7d8cc24d54d982238e"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.446238 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:18.446260 1034 heartbeater.cc:344] Connected to a master server at 127.0.119.254:39853
I20251211 09:07:18.446303 1034 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:18.446388 1034 heartbeater.cc:507] Master 127.0.119.254:39853 requested a full tablet report, sending...
I20251211 09:07:18.446622 905 ts_manager.cc:194] Registered new tserver with Master: 1f0af9c22e7f47c38b2cb1ff4fcf39c9 (127.0.119.193:36027)
I20251211 09:07:18.446882 1046 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.447003 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.447046 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "08b5d900abd44f7d8cc24d54d982238e"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.447091 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:18.447350 905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38880
I20251211 09:07:18.457434 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:18.457628 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:18.457767 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:18.457958 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:18.457988 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.458011 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:18.458038 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.460917 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:35503
I20251211 09:07:18.460990 1109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:35503 every 8 connection(s)
I20251211 09:07:18.461338 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:18.462618 1113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:18.462728 1114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:18.462781 1116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:18.462882 479 server_base.cc:1047] running on GCE node
I20251211 09:07:18.462988 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:18.463007 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:18.463019 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444038463020 us; error 0 us; skew 500 ppm
I20251211 09:07:18.463716 479 webserver.cc:492] Webserver started at http://127.0.119.195:38913/ using document root <none> and password file <none>
I20251211 09:07:18.463819 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:18.463873 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:18.463927 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:18.464298 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "7a56215b9aa54120bc6baef5f95b7a0d"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.464566 1110 heartbeater.cc:344] Connected to a master server at 127.0.119.254:39853
I20251211 09:07:18.464632 1110 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:18.464761 1110 heartbeater.cc:507] Master 127.0.119.254:39853 requested a full tablet report, sending...
I20251211 09:07:18.464993 905 ts_manager.cc:194] Registered new tserver with Master: 08b5d900abd44f7d8cc24d54d982238e (127.0.119.194:35503)
I20251211 09:07:18.465457 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 09:07:18.465481 905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38896
I20251211 09:07:18.465996 1121 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.466118 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.466169 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "7a56215b9aa54120bc6baef5f95b7a0d"
format_stamp: "Formatted at 2025-12-11 09:07:18 on dist-test-slave-hb70"
I20251211 09:07:18.466199 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:18.486403 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:18.486635 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:18.486780 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:18.486984 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:18.487013 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.487037 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:18.487066 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.490476 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:43359
I20251211 09:07:18.490550 1184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:43359 every 8 connection(s)
I20251211 09:07:18.493656 1185 heartbeater.cc:344] Connected to a master server at 127.0.119.254:39853
I20251211 09:07:18.493716 1185 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:18.493813 1185 heartbeater.cc:507] Master 127.0.119.254:39853 requested a full tablet report, sending...
I20251211 09:07:18.494042 905 ts_manager.cc:194] Registered new tserver with Master: 7a56215b9aa54120bc6baef5f95b7a0d (127.0.119.195:43359)
I20251211 09:07:18.494357 905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38898
I20251211 09:07:18.495069 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004392494s
I20251211 09:07:18.495415 479 test_util.cc:276] Using random seed: 2026441911
I20251211 09:07:18.499961 905 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38902:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:07:18.500088 905 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:07:18.504889 1149 tablet_service.cc:1505] Processing CreateTablet for tablet 971afa7749b448e7a559ac805ff02075 (DEFAULT_TABLE table=test-workload [id=1a4de18f8a8942d1bf0667a430a67b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:18.504863 998 tablet_service.cc:1505] Processing CreateTablet for tablet 971afa7749b448e7a559ac805ff02075 (DEFAULT_TABLE table=test-workload [id=1a4de18f8a8942d1bf0667a430a67b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:18.505039 1149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971afa7749b448e7a559ac805ff02075. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:18.505080 998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971afa7749b448e7a559ac805ff02075. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:18.506004 1074 tablet_service.cc:1505] Processing CreateTablet for tablet 971afa7749b448e7a559ac805ff02075 (DEFAULT_TABLE table=test-workload [id=1a4de18f8a8942d1bf0667a430a67b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:18.506111 1074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971afa7749b448e7a559ac805ff02075. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:18.506361 1200 tablet_bootstrap.cc:492] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d: Bootstrap starting.
I20251211 09:07:18.506755 1201 tablet_bootstrap.cc:492] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9: Bootstrap starting.
I20251211 09:07:18.506922 1200 tablet_bootstrap.cc:654] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:18.507205 1201 tablet_bootstrap.cc:654] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:18.507562 1202 tablet_bootstrap.cc:492] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e: Bootstrap starting.
I20251211 09:07:18.507586 1200 tablet_bootstrap.cc:492] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d: No bootstrap required, opened a new log
I20251211 09:07:18.507642 1200 ts_tablet_manager.cc:1403] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:18.507802 1200 raft_consensus.cc:359] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.507856 1200 raft_consensus.cc:385] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:18.507886 1201 tablet_bootstrap.cc:492] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9: No bootstrap required, opened a new log
I20251211 09:07:18.507905 1200 raft_consensus.cc:740] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a56215b9aa54120bc6baef5f95b7a0d, State: Initialized, Role: FOLLOWER
I20251211 09:07:18.508008 1202 tablet_bootstrap.cc:654] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:18.508024 1201 ts_tablet_manager.cc:1403] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:18.508026 1200 consensus_queue.cc:260] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.508250 1200 ts_tablet_manager.cc:1434] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:18.508235 1201 raft_consensus.cc:359] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.508302 1201 raft_consensus.cc:385] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:18.508320 1185 heartbeater.cc:499] Master 127.0.119.254:39853 was elected leader, sending a full tablet report...
I20251211 09:07:18.508337 1201 raft_consensus.cc:740] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0af9c22e7f47c38b2cb1ff4fcf39c9, State: Initialized, Role: FOLLOWER
I20251211 09:07:18.508428 1201 consensus_queue.cc:260] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.508610 1202 tablet_bootstrap.cc:492] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e: No bootstrap required, opened a new log
I20251211 09:07:18.508633 1034 heartbeater.cc:499] Master 127.0.119.254:39853 was elected leader, sending a full tablet report...
I20251211 09:07:18.508661 1202 ts_tablet_manager.cc:1403] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:18.508608 1201 ts_tablet_manager.cc:1434] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:18.508800 1202 raft_consensus.cc:359] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.508873 1202 raft_consensus.cc:385] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:18.508898 1202 raft_consensus.cc:740] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08b5d900abd44f7d8cc24d54d982238e, State: Initialized, Role: FOLLOWER
I20251211 09:07:18.508951 1202 consensus_queue.cc:260] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.509106 1202 ts_tablet_manager.cc:1434] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:07:18.509140 1110 heartbeater.cc:499] Master 127.0.119.254:39853 was elected leader, sending a full tablet report...
I20251211 09:07:18.689638 1205 raft_consensus.cc:493] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:07:18.689750 1205 raft_consensus.cc:515] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.689914 1205 leader_election.cc:290] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08b5d900abd44f7d8cc24d54d982238e (127.0.119.194:35503), 1f0af9c22e7f47c38b2cb1ff4fcf39c9 (127.0.119.193:36027)
W20251211 09:07:18.692363 1035 tablet.cc:2378] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 09:07:18.692598 1084 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "971afa7749b448e7a559ac805ff02075" candidate_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b5d900abd44f7d8cc24d54d982238e" is_pre_election: true
I20251211 09:07:18.692685 1084 raft_consensus.cc:2468] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a56215b9aa54120bc6baef5f95b7a0d in term 0.
I20251211 09:07:18.692647 1008 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "971afa7749b448e7a559ac805ff02075" candidate_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" is_pre_election: true
I20251211 09:07:18.692734 1008 raft_consensus.cc:2468] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a56215b9aa54120bc6baef5f95b7a0d in term 0.
I20251211 09:07:18.692843 1125 leader_election.cc:304] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b5d900abd44f7d8cc24d54d982238e, 7a56215b9aa54120bc6baef5f95b7a0d; no voters:
I20251211 09:07:18.692941 1205 raft_consensus.cc:2804] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:07:18.692988 1205 raft_consensus.cc:493] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:07:18.693013 1205 raft_consensus.cc:3060] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:18.693712 1205 raft_consensus.cc:515] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.693842 1205 leader_election.cc:290] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [CANDIDATE]: Term 1 election: Requested vote from peers 08b5d900abd44f7d8cc24d54d982238e (127.0.119.194:35503), 1f0af9c22e7f47c38b2cb1ff4fcf39c9 (127.0.119.193:36027)
I20251211 09:07:18.694011 1084 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "971afa7749b448e7a559ac805ff02075" candidate_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08b5d900abd44f7d8cc24d54d982238e"
I20251211 09:07:18.694016 1008 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "971afa7749b448e7a559ac805ff02075" candidate_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9"
I20251211 09:07:18.694072 1084 raft_consensus.cc:3060] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:18.694105 1008 raft_consensus.cc:3060] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:18.694692 1008 raft_consensus.cc:2468] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a56215b9aa54120bc6baef5f95b7a0d in term 1.
I20251211 09:07:18.694700 1084 raft_consensus.cc:2468] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a56215b9aa54120bc6baef5f95b7a0d in term 1.
I20251211 09:07:18.694867 1125 leader_election.cc:304] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b5d900abd44f7d8cc24d54d982238e, 7a56215b9aa54120bc6baef5f95b7a0d; no voters:
I20251211 09:07:18.694954 1205 raft_consensus.cc:2804] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:18.695089 1205 raft_consensus.cc:697] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 1 LEADER]: Becoming Leader. State: Replica: 7a56215b9aa54120bc6baef5f95b7a0d, State: Running, Role: LEADER
I20251211 09:07:18.695130 1205 consensus_queue.cc:237] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:18.695631 905 catalog_manager.cc:5654] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a56215b9aa54120bc6baef5f95b7a0d (127.0.119.195). New cstate: current_term: 1 leader_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } health_report { overall_health: HEALTHY } } }
I20251211 09:07:18.735409 1008 raft_consensus.cc:1275] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 1 FOLLOWER]: Refusing update from remote peer 7a56215b9aa54120bc6baef5f95b7a0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:18.735424 1084 raft_consensus.cc:1275] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 1 FOLLOWER]: Refusing update from remote peer 7a56215b9aa54120bc6baef5f95b7a0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:18.735659 1205 consensus_queue.cc:1048] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:18.735816 1210 consensus_queue.cc:1048] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:29.228744 1205 raft_consensus.cc:993] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d: : Instructing follower 1f0af9c22e7f47c38b2cb1ff4fcf39c9 to start an election
I20251211 09:07:29.228853 1205 raft_consensus.cc:1081] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 1 LEADER]: Signalling peer 1f0af9c22e7f47c38b2cb1ff4fcf39c9 to start an election
I20251211 09:07:29.229130 1007 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "971afa7749b448e7a559ac805ff02075"
dest_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9"
from {username='slave'} at 127.0.0.1:52806
I20251211 09:07:29.229279 1007 raft_consensus.cc:493] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:07:29.229318 1007 raft_consensus.cc:3060] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:07:29.292353 1007 raft_consensus.cc:515] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:29.292970 1007 leader_election.cc:290] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [CANDIDATE]: Term 2 election: Requested vote from peers 08b5d900abd44f7d8cc24d54d982238e (127.0.119.194:35503), 7a56215b9aa54120bc6baef5f95b7a0d (127.0.119.195:43359)
I20251211 09:07:29.295926 1084 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "971afa7749b448e7a559ac805ff02075" candidate_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 13222 } } ignore_live_leader: true dest_uuid: "08b5d900abd44f7d8cc24d54d982238e"
I20251211 09:07:29.296068 1084 raft_consensus.cc:3060] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:07:29.296130 1159 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "971afa7749b448e7a559ac805ff02075" candidate_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 13222 } } ignore_live_leader: true dest_uuid: "7a56215b9aa54120bc6baef5f95b7a0d"
I20251211 09:07:29.296193 1159 raft_consensus.cc:3055] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:07:29.296228 1159 raft_consensus.cc:740] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a56215b9aa54120bc6baef5f95b7a0d, State: Running, Role: LEADER
I20251211 09:07:29.296307 1159 consensus_queue.cc:260] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13222, Committed index: 13222, Last appended: 1.13222, Last appended by leader: 13222, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:29.296388 1159 raft_consensus.cc:3060] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:07:29.296947 1084 raft_consensus.cc:2468] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0af9c22e7f47c38b2cb1ff4fcf39c9 in term 2.
I20251211 09:07:29.297101 1159 raft_consensus.cc:2468] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0af9c22e7f47c38b2cb1ff4fcf39c9 in term 2.
I20251211 09:07:29.297161 974 leader_election.cc:304] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08b5d900abd44f7d8cc24d54d982238e, 1f0af9c22e7f47c38b2cb1ff4fcf39c9; no voters:
I20251211 09:07:29.297446 1256 raft_consensus.cc:2804] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:07:29.297654 1256 raft_consensus.cc:697] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 2 LEADER]: Becoming Leader. State: Replica: 1f0af9c22e7f47c38b2cb1ff4fcf39c9, State: Running, Role: LEADER
I20251211 09:07:29.297725 1256 consensus_queue.cc:237] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13222, Committed index: 13222, Last appended: 1.13222, Last appended by leader: 13222, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } }
I20251211 09:07:29.298206 902 catalog_manager.cc:5654] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 reported cstate change: term changed from 1 to 2, leader changed from 7a56215b9aa54120bc6baef5f95b7a0d (127.0.119.195) to 1f0af9c22e7f47c38b2cb1ff4fcf39c9 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f0af9c22e7f47c38b2cb1ff4fcf39c9" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 } health_report { overall_health: UNKNOWN } } }
I20251211 09:07:29.303633 1084 raft_consensus.cc:1275] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 2 FOLLOWER]: Refusing update from remote peer 1f0af9c22e7f47c38b2cb1ff4fcf39c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 13222. Preceding OpId from leader: term: 2 index: 13224. (index mismatch)
I20251211 09:07:29.303628 1159 raft_consensus.cc:1275] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 2 FOLLOWER]: Refusing update from remote peer 1f0af9c22e7f47c38b2cb1ff4fcf39c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 13222. Preceding OpId from leader: term: 2 index: 13224. (index mismatch)
I20251211 09:07:29.303836 1257 consensus_queue.cc:1048] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08b5d900abd44f7d8cc24d54d982238e" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13223, Last known committed idx: 13222, Time since last communication: 0.000s
I20251211 09:07:29.303905 1256 consensus_queue.cc:1048] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a56215b9aa54120bc6baef5f95b7a0d" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13223, Last known committed idx: 13222, Time since last communication: 0.000s
I20251211 09:07:31.363052 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:07:31.365571 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:31.365705 479 tablet_replica.cc:333] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9: stopping tablet replica
I20251211 09:07:31.365762 479 raft_consensus.cc:2243] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:07:31.365837 479 raft_consensus.cc:2272] T 971afa7749b448e7a559ac805ff02075 P 1f0af9c22e7f47c38b2cb1ff4fcf39c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:31.380641 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:07:31.381635 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:07:31.384666 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:31.384779 479 tablet_replica.cc:333] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e: stopping tablet replica
I20251211 09:07:31.384858 479 raft_consensus.cc:2243] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:31.384907 479 raft_consensus.cc:2272] T 971afa7749b448e7a559ac805ff02075 P 08b5d900abd44f7d8cc24d54d982238e [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:31.398079 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:07:31.399016 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:07:31.401526 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:31.401659 479 tablet_replica.cc:333] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d: stopping tablet replica
I20251211 09:07:31.401728 479 raft_consensus.cc:2243] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:31.401782 479 raft_consensus.cc:2272] T 971afa7749b448e7a559ac805ff02075 P 7a56215b9aa54120bc6baef5f95b7a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:31.424976 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:07:31.426018 479 master.cc:561] Master@127.0.119.254:39853 shutting down...
I20251211 09:07:31.428346 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:07:31.428432 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:31.428457 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P b24c6d0202774f12bb14219a11669959: stopping tablet replica
I20251211 09:07:31.440387 479 master.cc:583] Master@127.0.119.254:39853 shutdown complete.
[ OK ] TxnParticipantITest.TestWaitOnFinalizeCommit (13087 ms)
[ RUN ] TxnParticipantITest.TestWaitOnAbortCommit
I20251211 09:07:31.459268 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:37551
I20251211 09:07:31.459453 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:07:31.460907 479 server_base.cc:1047] running on GCE node
W20251211 09:07:31.460928 1300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:31.461042 1297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:31.461108 1298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:31.461309 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:31.461344 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:31.461365 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444051461366 us; error 0 us; skew 500 ppm
I20251211 09:07:31.461932 479 webserver.cc:492] Webserver started at http://127.0.119.254:32841/ using document root <none> and password file <none>
I20251211 09:07:31.462037 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:31.462080 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:31.462132 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:31.462401 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "73f7d3efc870479ca5b8fd05638dd18a"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.463261 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:07:31.463673 1305 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.463789 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.463830 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "73f7d3efc870479ca5b8fd05638dd18a"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.463877 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:31.474263 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:31.474470 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:31.476904 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:37551
I20251211 09:07:31.479717 1357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:37551 every 8 connection(s)
I20251211 09:07:31.479875 1358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:31.483103 1358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a: Bootstrap starting.
I20251211 09:07:31.483439 1358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:31.483952 1358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a: No bootstrap required, opened a new log
I20251211 09:07:31.484103 1358 raft_consensus.cc:359] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f7d3efc870479ca5b8fd05638dd18a" member_type: VOTER }
I20251211 09:07:31.484156 1358 raft_consensus.cc:385] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:31.484171 1358 raft_consensus.cc:740] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73f7d3efc870479ca5b8fd05638dd18a, State: Initialized, Role: FOLLOWER
I20251211 09:07:31.484229 1358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f7d3efc870479ca5b8fd05638dd18a" member_type: VOTER }
I20251211 09:07:31.484267 1358 raft_consensus.cc:399] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:07:31.484297 1358 raft_consensus.cc:493] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:07:31.484328 1358 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:31.484802 1358 raft_consensus.cc:515] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f7d3efc870479ca5b8fd05638dd18a" member_type: VOTER }
I20251211 09:07:31.484856 1358 leader_election.cc:304] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73f7d3efc870479ca5b8fd05638dd18a; no voters:
I20251211 09:07:31.484984 1358 leader_election.cc:290] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:07:31.485031 1361 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:31.485121 1358 sys_catalog.cc:565] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:07:31.485205 1361 raft_consensus.cc:697] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 1 LEADER]: Becoming Leader. State: Replica: 73f7d3efc870479ca5b8fd05638dd18a, State: Running, Role: LEADER
I20251211 09:07:31.485296 1361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f7d3efc870479ca5b8fd05638dd18a" member_type: VOTER }
I20251211 09:07:31.485518 1362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73f7d3efc870479ca5b8fd05638dd18a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f7d3efc870479ca5b8fd05638dd18a" member_type: VOTER } }
I20251211 09:07:31.485519 1363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73f7d3efc870479ca5b8fd05638dd18a. Latest consensus state: current_term: 1 leader_uuid: "73f7d3efc870479ca5b8fd05638dd18a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73f7d3efc870479ca5b8fd05638dd18a" member_type: VOTER } }
I20251211 09:07:31.485679 1363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:31.485667 1362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:31.486028 1368 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:07:31.486176 1368 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:07:31.486545 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:07:31.486758 1368 catalog_manager.cc:1357] Generated new cluster ID: 774f9ac571ab454e9ce5c4854624e2a7
I20251211 09:07:31.486797 1368 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:07:31.494629 1368 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:07:31.495098 1368 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:07:31.503823 1368 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a: Generated new TSK 0
I20251211 09:07:31.503914 1368 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:07:31.518389 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:31.519750 1379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:31.519798 1380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:31.519877 479 server_base.cc:1047] running on GCE node
W20251211 09:07:31.519949 1382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:31.520108 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:31.520151 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:31.520165 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444051520165 us; error 0 us; skew 500 ppm
I20251211 09:07:31.520740 479 webserver.cc:492] Webserver started at http://127.0.119.193:39679/ using document root <none> and password file <none>
I20251211 09:07:31.520821 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:31.520866 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:31.520918 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:31.521195 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.522297 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:31.522805 1387 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.522924 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.522965 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.523015 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:31.540100 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:31.540366 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:31.540551 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:31.540776 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:31.540804 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.540838 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:31.540863 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.543789 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:35311
I20251211 09:07:31.544340 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:07:31.544435 1450 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:35311 every 8 connection(s)
W20251211 09:07:31.545617 1455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:31.545742 1453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:31.546123 479 server_base.cc:1047] running on GCE node
W20251211 09:07:31.546175 1458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:31.546406 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:31.546442 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:31.546458 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444051546459 us; error 0 us; skew 500 ppm
I20251211 09:07:31.547077 479 webserver.cc:492] Webserver started at http://127.0.119.194:46121/ using document root <none> and password file <none>
I20251211 09:07:31.547153 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:31.547216 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:31.547281 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:31.547602 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "74b33eddd803414e997c3e30cce017c3"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.548418 1451 heartbeater.cc:344] Connected to a master server at 127.0.119.254:37551
I20251211 09:07:31.548473 1451 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:31.548576 1451 heartbeater.cc:507] Master 127.0.119.254:37551 requested a full tablet report, sending...
I20251211 09:07:31.548763 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:31.548795 1322 ts_manager.cc:194] Registered new tserver with Master: 8db3773a9ecb4ae6b2d7ee7d52d00800 (127.0.119.193:35311)
I20251211 09:07:31.549266 1463 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.549371 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.549414 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "74b33eddd803414e997c3e30cce017c3"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.549454 1322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59744
I20251211 09:07:31.549470 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:31.559434 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:31.559679 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:31.559836 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:31.560045 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:31.560074 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.560110 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:31.560142 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.562842 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:40227
I20251211 09:07:31.562909 1526 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:40227 every 8 connection(s)
I20251211 09:07:31.563205 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:31.564529 1530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:31.564654 1531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:31.564746 479 server_base.cc:1047] running on GCE node
W20251211 09:07:31.564848 1533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:31.565012 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:31.565047 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:31.565059 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444051565060 us; error 0 us; skew 500 ppm
I20251211 09:07:31.565754 479 webserver.cc:492] Webserver started at http://127.0.119.195:38541/ using document root <none> and password file <none>
I20251211 09:07:31.565850 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:31.565899 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:31.565950 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:31.566219 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "8008be39c37e489197518dd24088e2fb"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.566256 1527 heartbeater.cc:344] Connected to a master server at 127.0.119.254:37551
I20251211 09:07:31.566324 1527 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:31.566453 1527 heartbeater.cc:507] Master 127.0.119.254:37551 requested a full tablet report, sending...
I20251211 09:07:31.566666 1322 ts_manager.cc:194] Registered new tserver with Master: 74b33eddd803414e997c3e30cce017c3 (127.0.119.194:40227)
I20251211 09:07:31.567044 1322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59756
I20251211 09:07:31.567231 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:07:31.567705 1538 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.567817 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.567858 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "8008be39c37e489197518dd24088e2fb"
format_stamp: "Formatted at 2025-12-11 09:07:31 on dist-test-slave-hb70"
I20251211 09:07:31.567906 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:31.586534 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:31.586817 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:31.587005 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:31.587242 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:31.587272 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.587308 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:31.587335 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.590710 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:37243
I20251211 09:07:31.590756 1602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:37243 every 8 connection(s)
I20251211 09:07:31.593955 1603 heartbeater.cc:344] Connected to a master server at 127.0.119.254:37551
I20251211 09:07:31.594058 1603 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:31.594188 1603 heartbeater.cc:507] Master 127.0.119.254:37551 requested a full tablet report, sending...
I20251211 09:07:31.594427 1322 ts_manager.cc:194] Registered new tserver with Master: 8008be39c37e489197518dd24088e2fb (127.0.119.195:37243)
I20251211 09:07:31.594851 1322 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59766
I20251211 09:07:31.595336 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004439618s
I20251211 09:07:31.595706 479 test_util.cc:276] Using random seed: 2039542202
I20251211 09:07:31.600076 1322 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59772:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:07:31.600232 1322 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:07:31.604892 1491 tablet_service.cc:1505] Processing CreateTablet for tablet 2aaf53e698c14b9aa80351d20ceb130c (DEFAULT_TABLE table=test-workload [id=40cb2f4ed0244923a5124b2ab4d795df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:31.604899 1566 tablet_service.cc:1505] Processing CreateTablet for tablet 2aaf53e698c14b9aa80351d20ceb130c (DEFAULT_TABLE table=test-workload [id=40cb2f4ed0244923a5124b2ab4d795df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:31.605037 1491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaf53e698c14b9aa80351d20ceb130c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:31.605062 1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaf53e698c14b9aa80351d20ceb130c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:31.605201 1415 tablet_service.cc:1505] Processing CreateTablet for tablet 2aaf53e698c14b9aa80351d20ceb130c (DEFAULT_TABLE table=test-workload [id=40cb2f4ed0244923a5124b2ab4d795df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:31.605321 1415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaf53e698c14b9aa80351d20ceb130c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:31.606365 1618 tablet_bootstrap.cc:492] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3: Bootstrap starting.
I20251211 09:07:31.606827 1620 tablet_bootstrap.cc:492] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800: Bootstrap starting.
I20251211 09:07:31.606829 1618 tablet_bootstrap.cc:654] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:31.607348 1620 tablet_bootstrap.cc:654] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:31.607621 1618 tablet_bootstrap.cc:492] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3: No bootstrap required, opened a new log
I20251211 09:07:31.607678 1618 ts_tablet_manager.cc:1403] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:31.607692 1619 tablet_bootstrap.cc:492] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb: Bootstrap starting.
I20251211 09:07:31.607862 1620 tablet_bootstrap.cc:492] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800: No bootstrap required, opened a new log
I20251211 09:07:31.607839 1618 raft_consensus.cc:359] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.607910 1620 ts_tablet_manager.cc:1403] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:31.608110 1619 tablet_bootstrap.cc:654] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:31.608124 1620 raft_consensus.cc:359] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.608181 1620 raft_consensus.cc:385] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:31.608217 1620 raft_consensus.cc:740] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db3773a9ecb4ae6b2d7ee7d52d00800, State: Initialized, Role: FOLLOWER
I20251211 09:07:31.608281 1620 consensus_queue.cc:260] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.608458 1620 ts_tablet_manager.cc:1434] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.608493 1451 heartbeater.cc:499] Master 127.0.119.254:37551 was elected leader, sending a full tablet report...
I20251211 09:07:31.607909 1618 raft_consensus.cc:385] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:31.608616 1618 raft_consensus.cc:740] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b33eddd803414e997c3e30cce017c3, State: Initialized, Role: FOLLOWER
I20251211 09:07:31.608692 1618 consensus_queue.cc:260] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.608775 1619 tablet_bootstrap.cc:492] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb: No bootstrap required, opened a new log
I20251211 09:07:31.608827 1619 ts_tablet_manager.cc:1403] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:31.608891 1618 ts_tablet_manager.cc:1434] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:31.608918 1527 heartbeater.cc:499] Master 127.0.119.254:37551 was elected leader, sending a full tablet report...
I20251211 09:07:31.608986 1619 raft_consensus.cc:359] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.609047 1619 raft_consensus.cc:385] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:31.609088 1619 raft_consensus.cc:740] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8008be39c37e489197518dd24088e2fb, State: Initialized, Role: FOLLOWER
I20251211 09:07:31.609172 1619 consensus_queue.cc:260] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.609377 1619 ts_tablet_manager.cc:1434] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:31.609386 1603 heartbeater.cc:499] Master 127.0.119.254:37551 was elected leader, sending a full tablet report...
I20251211 09:07:31.660396 1623 raft_consensus.cc:493] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:07:31.660490 1623 raft_consensus.cc:515] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.660686 1623 leader_election.cc:290] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8008be39c37e489197518dd24088e2fb (127.0.119.195:37243), 74b33eddd803414e997c3e30cce017c3 (127.0.119.194:40227)
I20251211 09:07:31.663154 1501 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2aaf53e698c14b9aa80351d20ceb130c" candidate_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b33eddd803414e997c3e30cce017c3" is_pre_election: true
I20251211 09:07:31.663198 1577 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2aaf53e698c14b9aa80351d20ceb130c" candidate_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8008be39c37e489197518dd24088e2fb" is_pre_election: true
I20251211 09:07:31.663254 1501 raft_consensus.cc:2468] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8db3773a9ecb4ae6b2d7ee7d52d00800 in term 0.
I20251211 09:07:31.663301 1577 raft_consensus.cc:2468] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8db3773a9ecb4ae6b2d7ee7d52d00800 in term 0.
I20251211 09:07:31.663441 1388 leader_election.cc:304] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b33eddd803414e997c3e30cce017c3, 8db3773a9ecb4ae6b2d7ee7d52d00800; no voters:
I20251211 09:07:31.663535 1623 raft_consensus.cc:2804] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:07:31.663582 1623 raft_consensus.cc:493] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:07:31.663601 1623 raft_consensus.cc:3060] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:31.664239 1623 raft_consensus.cc:515] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.664361 1623 leader_election.cc:290] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [CANDIDATE]: Term 1 election: Requested vote from peers 8008be39c37e489197518dd24088e2fb (127.0.119.195:37243), 74b33eddd803414e997c3e30cce017c3 (127.0.119.194:40227)
I20251211 09:07:31.664497 1577 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2aaf53e698c14b9aa80351d20ceb130c" candidate_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8008be39c37e489197518dd24088e2fb"
I20251211 09:07:31.664554 1577 raft_consensus.cc:3060] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:31.665190 1577 raft_consensus.cc:2468] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8db3773a9ecb4ae6b2d7ee7d52d00800 in term 1.
I20251211 09:07:31.665298 1501 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2aaf53e698c14b9aa80351d20ceb130c" candidate_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b33eddd803414e997c3e30cce017c3"
I20251211 09:07:31.665349 1501 raft_consensus.cc:3060] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:31.665354 1391 leader_election.cc:304] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8008be39c37e489197518dd24088e2fb, 8db3773a9ecb4ae6b2d7ee7d52d00800; no voters:
I20251211 09:07:31.665493 1623 raft_consensus.cc:2804] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:31.665638 1623 raft_consensus.cc:697] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 1 LEADER]: Becoming Leader. State: Replica: 8db3773a9ecb4ae6b2d7ee7d52d00800, State: Running, Role: LEADER
I20251211 09:07:31.665692 1623 consensus_queue.cc:237] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } }
I20251211 09:07:31.665982 1501 raft_consensus.cc:2468] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8db3773a9ecb4ae6b2d7ee7d52d00800 in term 1.
I20251211 09:07:31.666216 1322 catalog_manager.cc:5654] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8db3773a9ecb4ae6b2d7ee7d52d00800 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8db3773a9ecb4ae6b2d7ee7d52d00800" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 35311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 } health_report { overall_health: UNKNOWN } } }
I20251211 09:07:31.681427 1501 raft_consensus.cc:1275] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 1 FOLLOWER]: Refusing update from remote peer 8db3773a9ecb4ae6b2d7ee7d52d00800: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:31.681427 1577 raft_consensus.cc:1275] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 1 FOLLOWER]: Refusing update from remote peer 8db3773a9ecb4ae6b2d7ee7d52d00800: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:31.681703 1628 consensus_queue.cc:1048] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74b33eddd803414e997c3e30cce017c3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:31.681821 1623 consensus_queue.cc:1048] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8008be39c37e489197518dd24088e2fb" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:42.724494 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:07:42.727150 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:42.727290 479 tablet_replica.cc:333] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800: stopping tablet replica
I20251211 09:07:42.727375 479 raft_consensus.cc:2243] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:07:42.727450 479 raft_consensus.cc:2272] T 2aaf53e698c14b9aa80351d20ceb130c P 8db3773a9ecb4ae6b2d7ee7d52d00800 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:42.746651 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:07:42.747578 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:07:42.750582 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:42.750689 479 tablet_replica.cc:333] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3: stopping tablet replica
I20251211 09:07:42.750752 479 raft_consensus.cc:2243] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:42.750802 479 raft_consensus.cc:2272] T 2aaf53e698c14b9aa80351d20ceb130c P 74b33eddd803414e997c3e30cce017c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:42.765005 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:07:42.765854 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:07:42.768934 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:42.769074 479 tablet_replica.cc:333] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb: stopping tablet replica
I20251211 09:07:42.769150 479 raft_consensus.cc:2243] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:42.769258 479 raft_consensus.cc:2272] T 2aaf53e698c14b9aa80351d20ceb130c P 8008be39c37e489197518dd24088e2fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:42.792385 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:07:42.793371 479 master.cc:561] Master@127.0.119.254:37551 shutting down...
I20251211 09:07:42.795941 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:07:42.796006 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:42.796028 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 73f7d3efc870479ca5b8fd05638dd18a: stopping tablet replica
I20251211 09:07:42.807659 479 master.cc:583] Master@127.0.119.254:37551 shutdown complete.
[ OK ] TxnParticipantITest.TestWaitOnAbortCommit (11367 ms)
[ RUN ] TxnParticipantITest.TestProxyBasicCalls
I20251211 09:07:42.826994 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:37885
I20251211 09:07:42.827163 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:42.828513 1686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:42.828513 1684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:42.828603 479 server_base.cc:1047] running on GCE node
W20251211 09:07:42.828557 1683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:42.828842 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:42.828882 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:42.828904 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444062828904 us; error 0 us; skew 500 ppm
I20251211 09:07:42.829481 479 webserver.cc:492] Webserver started at http://127.0.119.254:41157/ using document root <none> and password file <none>
I20251211 09:07:42.829566 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:42.829614 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:42.829667 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:42.829941 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "3f3437063d5145f1810b619ca972a6fb"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.830791 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:42.831215 1691 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.831347 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.831390 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "3f3437063d5145f1810b619ca972a6fb"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.831441 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:42.852818 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:42.853034 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:42.855572 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:37885
I20251211 09:07:42.859863 1743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:37885 every 8 connection(s)
I20251211 09:07:42.859988 1744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:42.860926 1744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb: Bootstrap starting.
I20251211 09:07:42.861194 1744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:42.861680 1744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb: No bootstrap required, opened a new log
I20251211 09:07:42.861788 1744 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f3437063d5145f1810b619ca972a6fb" member_type: VOTER }
I20251211 09:07:42.861831 1744 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:42.861845 1744 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f3437063d5145f1810b619ca972a6fb, State: Initialized, Role: FOLLOWER
I20251211 09:07:42.861882 1744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f3437063d5145f1810b619ca972a6fb" member_type: VOTER }
I20251211 09:07:42.861927 1744 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:07:42.861963 1744 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:07:42.861980 1744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:42.862434 1744 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f3437063d5145f1810b619ca972a6fb" member_type: VOTER }
I20251211 09:07:42.862488 1744 leader_election.cc:304] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f3437063d5145f1810b619ca972a6fb; no voters:
I20251211 09:07:42.862571 1744 leader_election.cc:290] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:07:42.862641 1747 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:42.862723 1744 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:07:42.862783 1747 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 1 LEADER]: Becoming Leader. State: Replica: 3f3437063d5145f1810b619ca972a6fb, State: Running, Role: LEADER
I20251211 09:07:42.862833 1747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f3437063d5145f1810b619ca972a6fb" member_type: VOTER }
I20251211 09:07:42.863036 1748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f3437063d5145f1810b619ca972a6fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f3437063d5145f1810b619ca972a6fb" member_type: VOTER } }
I20251211 09:07:42.863054 1749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f3437063d5145f1810b619ca972a6fb. Latest consensus state: current_term: 1 leader_uuid: "3f3437063d5145f1810b619ca972a6fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f3437063d5145f1810b619ca972a6fb" member_type: VOTER } }
I20251211 09:07:42.863116 1748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:42.863123 1749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:42.863373 1752 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:07:42.863528 1752 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:07:42.864100 1752 catalog_manager.cc:1357] Generated new cluster ID: 768931301a4e441798ab122dfd85e52b
I20251211 09:07:42.864132 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:07:42.864156 1752 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:07:42.875506 1752 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:07:42.876204 1752 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:07:42.888370 1752 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb: Generated new TSK 0
I20251211 09:07:42.888461 1752 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:07:42.896044 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:42.897403 1765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:42.897425 1766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:42.897593 479 server_base.cc:1047] running on GCE node
W20251211 09:07:42.897622 1768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:42.897774 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:42.897827 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:42.897840 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444062897840 us; error 0 us; skew 500 ppm
I20251211 09:07:42.898419 479 webserver.cc:492] Webserver started at http://127.0.119.193:42051/ using document root <none> and password file <none>
I20251211 09:07:42.898497 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:42.898545 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:42.898602 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:42.898873 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "c5607212fad344c19c221d64c1800ece"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.899765 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:42.900199 1773 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.900346 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.900386 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "c5607212fad344c19c221d64c1800ece"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.900426 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:42.914041 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:42.914280 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:42.914443 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:42.914634 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:42.914661 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.914685 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:42.914713 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.917449 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:38205
I20251211 09:07:42.917498 1836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:38205 every 8 connection(s)
I20251211 09:07:42.917826 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:42.919046 1841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:42.919054 1842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:42.919179 1844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:42.919991 479 server_base.cc:1047] running on GCE node
I20251211 09:07:42.920135 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:42.920185 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:42.920204 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444062920204 us; error 0 us; skew 500 ppm
I20251211 09:07:42.920650 479 webserver.cc:492] Webserver started at http://127.0.119.194:35157/ using document root <none> and password file <none>
I20251211 09:07:42.920727 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:42.920773 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:42.920819 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:42.921116 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "6c34fc5564fa4e938c4c8c2794a6d059"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.921329 1837 heartbeater.cc:344] Connected to a master server at 127.0.119.254:37885
I20251211 09:07:42.921389 1837 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:42.921481 1837 heartbeater.cc:507] Master 127.0.119.254:37885 requested a full tablet report, sending...
I20251211 09:07:42.921687 1708 ts_manager.cc:194] Registered new tserver with Master: c5607212fad344c19c221d64c1800ece (127.0.119.193:38205)
I20251211 09:07:42.922187 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:07:42.922353 1708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41196
I20251211 09:07:42.922688 1849 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.922817 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.922863 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "6c34fc5564fa4e938c4c8c2794a6d059"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.922899 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:42.927030 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:42.927179 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:42.927295 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:42.927425 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:42.927448 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.927474 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:42.927493 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.930298 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:37471
I20251211 09:07:42.930353 1912 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:37471 every 8 connection(s)
I20251211 09:07:42.930636 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:42.931718 1916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:42.932056 1919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:42.932096 479 server_base.cc:1047] running on GCE node
W20251211 09:07:42.932214 1917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:42.932363 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:42.932405 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:42.932428 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444062932428 us; error 0 us; skew 500 ppm
I20251211 09:07:42.933032 479 webserver.cc:492] Webserver started at http://127.0.119.195:42605/ using document root <none> and password file <none>
I20251211 09:07:42.933127 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:42.933185 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:42.933233 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:42.933528 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "a0049631b1c4422a8fd4c756db763cd9"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.933717 1913 heartbeater.cc:344] Connected to a master server at 127.0.119.254:37885
I20251211 09:07:42.933777 1913 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:42.933894 1913 heartbeater.cc:507] Master 127.0.119.254:37885 requested a full tablet report, sending...
I20251211 09:07:42.934116 1708 ts_manager.cc:194] Registered new tserver with Master: 6c34fc5564fa4e938c4c8c2794a6d059 (127.0.119.194:37471)
I20251211 09:07:42.934465 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:07:42.934476 1708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41208
I20251211 09:07:42.934962 1924 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.935079 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.935130 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "a0049631b1c4422a8fd4c756db763cd9"
format_stamp: "Formatted at 2025-12-11 09:07:42 on dist-test-slave-hb70"
I20251211 09:07:42.935173 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:42.942210 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:42.942418 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:42.942560 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:42.942731 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:42.942755 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.942787 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:42.942814 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.946009 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:35075
I20251211 09:07:42.946061 1987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:35075 every 8 connection(s)
I20251211 09:07:42.948797 1988 heartbeater.cc:344] Connected to a master server at 127.0.119.254:37885
I20251211 09:07:42.948851 1988 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:42.948953 1988 heartbeater.cc:507] Master 127.0.119.254:37885 requested a full tablet report, sending...
I20251211 09:07:42.949175 1708 ts_manager.cc:194] Registered new tserver with Master: a0049631b1c4422a8fd4c756db763cd9 (127.0.119.195:35075)
I20251211 09:07:42.949491 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003307141s
I20251211 09:07:42.949563 1708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41216
I20251211 09:07:42.949839 479 test_util.cc:276] Using random seed: 2050896335
I20251211 09:07:42.954051 1708 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41218:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:07:42.954176 1708 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:07:42.958680 1877 tablet_service.cc:1505] Processing CreateTablet for tablet 8b7d9285539e4da88b8f507a21b8961a (DEFAULT_TABLE table=test-workload [id=836bd1d4798e4caeb06726b5ef876ea4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:42.958835 1877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7d9285539e4da88b8f507a21b8961a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:42.958930 1801 tablet_service.cc:1505] Processing CreateTablet for tablet 8b7d9285539e4da88b8f507a21b8961a (DEFAULT_TABLE table=test-workload [id=836bd1d4798e4caeb06726b5ef876ea4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:42.959021 1801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7d9285539e4da88b8f507a21b8961a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:42.959334 1952 tablet_service.cc:1505] Processing CreateTablet for tablet 8b7d9285539e4da88b8f507a21b8961a (DEFAULT_TABLE table=test-workload [id=836bd1d4798e4caeb06726b5ef876ea4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:42.959445 1952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b7d9285539e4da88b8f507a21b8961a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:42.960412 2003 tablet_bootstrap.cc:492] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059: Bootstrap starting.
I20251211 09:07:42.960602 2005 tablet_bootstrap.cc:492] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9: Bootstrap starting.
I20251211 09:07:42.960886 2003 tablet_bootstrap.cc:654] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:42.960983 2005 tablet_bootstrap.cc:654] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:42.961213 2004 tablet_bootstrap.cc:492] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece: Bootstrap starting.
I20251211 09:07:42.961490 2003 tablet_bootstrap.cc:492] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059: No bootstrap required, opened a new log
I20251211 09:07:42.961539 2003 ts_tablet_manager.cc:1403] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:42.961609 2005 tablet_bootstrap.cc:492] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9: No bootstrap required, opened a new log
I20251211 09:07:42.961632 2004 tablet_bootstrap.cc:654] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:42.961653 2005 ts_tablet_manager.cc:1403] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:42.961690 2003 raft_consensus.cc:359] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:42.961756 2003 raft_consensus.cc:385] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:42.961782 2003 raft_consensus.cc:740] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c34fc5564fa4e938c4c8c2794a6d059, State: Initialized, Role: FOLLOWER
I20251211 09:07:42.961807 2005 raft_consensus.cc:359] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:42.961835 2003 consensus_queue.cc:260] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:42.961894 2005 raft_consensus.cc:385] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:42.961921 2005 raft_consensus.cc:740] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0049631b1c4422a8fd4c756db763cd9, State: Initialized, Role: FOLLOWER
I20251211 09:07:42.962002 2005 consensus_queue.cc:260] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:42.962021 2003 ts_tablet_manager.cc:1434] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:07:42.962096 1913 heartbeater.cc:499] Master 127.0.119.254:37885 was elected leader, sending a full tablet report...
I20251211 09:07:42.962160 2005 ts_tablet_manager.cc:1434] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:07:42.962226 1988 heartbeater.cc:499] Master 127.0.119.254:37885 was elected leader, sending a full tablet report...
I20251211 09:07:42.962226 2004 tablet_bootstrap.cc:492] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece: No bootstrap required, opened a new log
I20251211 09:07:42.962415 2004 ts_tablet_manager.cc:1403] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251211 09:07:42.962553 2004 raft_consensus.cc:359] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:42.962616 2004 raft_consensus.cc:385] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:42.962639 2004 raft_consensus.cc:740] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5607212fad344c19c221d64c1800ece, State: Initialized, Role: FOLLOWER
I20251211 09:07:42.962703 2004 consensus_queue.cc:260] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:42.962867 2004 ts_tablet_manager.cc:1434] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:42.962908 1837 heartbeater.cc:499] Master 127.0.119.254:37885 was elected leader, sending a full tablet report...
I20251211 09:07:43.283782 2009 raft_consensus.cc:493] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:07:43.283922 2009 raft_consensus.cc:515] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:43.284145 2009 leader_election.cc:290] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5607212fad344c19c221d64c1800ece (127.0.119.193:38205), a0049631b1c4422a8fd4c756db763cd9 (127.0.119.195:35075)
I20251211 09:07:43.286823 1811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b7d9285539e4da88b8f507a21b8961a" candidate_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5607212fad344c19c221d64c1800ece" is_pre_election: true
I20251211 09:07:43.286928 1811 raft_consensus.cc:2468] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c34fc5564fa4e938c4c8c2794a6d059 in term 0.
I20251211 09:07:43.286974 1962 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b7d9285539e4da88b8f507a21b8961a" candidate_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0049631b1c4422a8fd4c756db763cd9" is_pre_election: true
I20251211 09:07:43.287062 1962 raft_consensus.cc:2468] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c34fc5564fa4e938c4c8c2794a6d059 in term 0.
I20251211 09:07:43.287092 1853 leader_election.cc:304] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c34fc5564fa4e938c4c8c2794a6d059, c5607212fad344c19c221d64c1800ece; no voters:
I20251211 09:07:43.287165 2009 raft_consensus.cc:2804] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:07:43.287216 2009 raft_consensus.cc:493] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:07:43.287245 2009 raft_consensus.cc:3060] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:43.287865 2009 raft_consensus.cc:515] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:43.288004 2009 leader_election.cc:290] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [CANDIDATE]: Term 1 election: Requested vote from peers c5607212fad344c19c221d64c1800ece (127.0.119.193:38205), a0049631b1c4422a8fd4c756db763cd9 (127.0.119.195:35075)
I20251211 09:07:43.288137 1962 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b7d9285539e4da88b8f507a21b8961a" candidate_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0049631b1c4422a8fd4c756db763cd9"
I20251211 09:07:43.288147 1811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b7d9285539e4da88b8f507a21b8961a" candidate_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5607212fad344c19c221d64c1800ece"
I20251211 09:07:43.288219 1962 raft_consensus.cc:3060] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:43.288228 1811 raft_consensus.cc:3060] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:43.288899 1962 raft_consensus.cc:2468] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c34fc5564fa4e938c4c8c2794a6d059 in term 1.
I20251211 09:07:43.288899 1811 raft_consensus.cc:2468] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c34fc5564fa4e938c4c8c2794a6d059 in term 1.
I20251211 09:07:43.289093 1853 leader_election.cc:304] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c34fc5564fa4e938c4c8c2794a6d059, c5607212fad344c19c221d64c1800ece; no voters:
I20251211 09:07:43.289189 2009 raft_consensus.cc:2804] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:43.289366 2009 raft_consensus.cc:697] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 1 LEADER]: Becoming Leader. State: Replica: 6c34fc5564fa4e938c4c8c2794a6d059, State: Running, Role: LEADER
I20251211 09:07:43.289441 2009 consensus_queue.cc:237] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:43.289968 1707 catalog_manager.cc:5654] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c34fc5564fa4e938c4c8c2794a6d059 (127.0.119.194). New cstate: current_term: 1 leader_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } health_report { overall_health: UNKNOWN } } }
I20251211 09:07:43.315953 1962 raft_consensus.cc:1275] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 1 FOLLOWER]: Refusing update from remote peer 6c34fc5564fa4e938c4c8c2794a6d059: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:43.315953 1811 raft_consensus.cc:1275] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 1 FOLLOWER]: Refusing update from remote peer 6c34fc5564fa4e938c4c8c2794a6d059: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:43.316224 2013 consensus_queue.cc:1048] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:43.316327 2009 consensus_queue.cc:1048] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:43.317461 2020 mvcc.cc:204] Tried to move back new op lower bound from 7231258883340910592 to 7231258883234045952. Current Snapshot: MvccSnapshot[applied={T|T < 7231258883340910592}]
I20251211 09:07:53.887027 2057 raft_consensus.cc:993] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059: : Instructing follower c5607212fad344c19c221d64c1800ece to start an election
I20251211 09:07:53.887116 2057 raft_consensus.cc:1081] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 1 LEADER]: Signalling peer c5607212fad344c19c221d64c1800ece to start an election
I20251211 09:07:53.887300 1811 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "8b7d9285539e4da88b8f507a21b8961a"
dest_uuid: "c5607212fad344c19c221d64c1800ece"
from {username='slave'} at 127.0.0.1:53536
I20251211 09:07:53.887387 1811 raft_consensus.cc:493] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:07:53.887418 1811 raft_consensus.cc:3060] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:07:53.888073 1811 raft_consensus.cc:515] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:53.888234 1811 leader_election.cc:290] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [CANDIDATE]: Term 2 election: Requested vote from peers 6c34fc5564fa4e938c4c8c2794a6d059 (127.0.119.194:37471), a0049631b1c4422a8fd4c756db763cd9 (127.0.119.195:35075)
I20251211 09:07:53.890761 1962 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b7d9285539e4da88b8f507a21b8961a" candidate_uuid: "c5607212fad344c19c221d64c1800ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 13995 } } ignore_live_leader: true dest_uuid: "a0049631b1c4422a8fd4c756db763cd9"
I20251211 09:07:53.890831 1887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b7d9285539e4da88b8f507a21b8961a" candidate_uuid: "c5607212fad344c19c221d64c1800ece" candidate_term: 2 candidate_status { last_received { term: 1 index: 13995 } } ignore_live_leader: true dest_uuid: "6c34fc5564fa4e938c4c8c2794a6d059"
I20251211 09:07:53.890849 1962 raft_consensus.cc:3060] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:07:53.890915 1887 raft_consensus.cc:3055] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:07:53.890949 1887 raft_consensus.cc:740] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c34fc5564fa4e938c4c8c2794a6d059, State: Running, Role: LEADER
I20251211 09:07:53.891018 1887 consensus_queue.cc:260] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13995, Committed index: 13995, Last appended: 1.13995, Last appended by leader: 13995, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:53.891101 1887 raft_consensus.cc:3060] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:07:53.891568 1962 raft_consensus.cc:2468] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5607212fad344c19c221d64c1800ece in term 2.
I20251211 09:07:53.891714 1887 raft_consensus.cc:2468] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5607212fad344c19c221d64c1800ece in term 2.
I20251211 09:07:53.891762 1775 leader_election.cc:304] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0049631b1c4422a8fd4c756db763cd9, c5607212fad344c19c221d64c1800ece; no voters:
I20251211 09:07:53.891968 2063 raft_consensus.cc:2804] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:07:53.892119 2063 raft_consensus.cc:697] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 2 LEADER]: Becoming Leader. State: Replica: c5607212fad344c19c221d64c1800ece, State: Running, Role: LEADER
I20251211 09:07:53.892177 2063 consensus_queue.cc:237] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13995, Committed index: 13995, Last appended: 1.13995, Last appended by leader: 13995, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } }
I20251211 09:07:53.892693 1708 catalog_manager.cc:5654] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece reported cstate change: term changed from 1 to 2, leader changed from 6c34fc5564fa4e938c4c8c2794a6d059 (127.0.119.194) to c5607212fad344c19c221d64c1800ece (127.0.119.193). New cstate: current_term: 2 leader_uuid: "c5607212fad344c19c221d64c1800ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5607212fad344c19c221d64c1800ece" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 } health_report { overall_health: UNKNOWN } } }
I20251211 09:07:53.895555 1887 raft_consensus.cc:1275] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 2 FOLLOWER]: Refusing update from remote peer c5607212fad344c19c221d64c1800ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 13995. Preceding OpId from leader: term: 2 index: 13997. (index mismatch)
I20251211 09:07:53.895552 1962 raft_consensus.cc:1275] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 2 FOLLOWER]: Refusing update from remote peer c5607212fad344c19c221d64c1800ece: Log matching property violated. Preceding OpId in replica: term: 1 index: 13995. Preceding OpId from leader: term: 2 index: 13997. (index mismatch)
I20251211 09:07:53.895802 2064 consensus_queue.cc:1048] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0049631b1c4422a8fd4c756db763cd9" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 35075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13996, Last known committed idx: 13995, Time since last communication: 0.000s
I20251211 09:07:53.895879 2063 consensus_queue.cc:1048] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c34fc5564fa4e938c4c8c2794a6d059" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13996, Last known committed idx: 13995, Time since last communication: 0.000s
I20251211 09:07:53.899029 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:07:53.901512 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:53.901611 479 tablet_replica.cc:333] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece: stopping tablet replica
I20251211 09:07:53.901669 479 raft_consensus.cc:2243] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:07:53.901722 479 raft_consensus.cc:2272] T 8b7d9285539e4da88b8f507a21b8961a P c5607212fad344c19c221d64c1800ece [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:53.915387 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:07:53.916276 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:07:53.919385 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:53.919495 479 tablet_replica.cc:333] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059: stopping tablet replica
I20251211 09:07:53.919559 479 raft_consensus.cc:2243] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:53.919591 479 raft_consensus.cc:2272] T 8b7d9285539e4da88b8f507a21b8961a P 6c34fc5564fa4e938c4c8c2794a6d059 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:53.938723 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:07:53.939590 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:07:53.942438 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:07:53.942570 479 tablet_replica.cc:333] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9: stopping tablet replica
I20251211 09:07:53.942638 479 raft_consensus.cc:2243] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:07:53.942690 479 raft_consensus.cc:2272] T 8b7d9285539e4da88b8f507a21b8961a P a0049631b1c4422a8fd4c756db763cd9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:53.964978 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:07:53.965827 479 master.cc:561] Master@127.0.119.254:37885 shutting down...
I20251211 09:07:53.968155 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:07:53.968220 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:07:53.968240 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3f3437063d5145f1810b619ca972a6fb: stopping tablet replica
I20251211 09:07:53.979925 479 master.cc:583] Master@127.0.119.254:37885 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyBasicCalls (11172 ms)
[ RUN ] TxnParticipantITest.TestBeginCommitAfterFinalize
I20251211 09:07:53.999220 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:33929
I20251211 09:07:53.999387 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:54.000511 2080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:54.000540 2082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:54.000562 2079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:54.000655 479 server_base.cc:1047] running on GCE node
I20251211 09:07:54.000833 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:54.000869 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:54.000881 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444074000881 us; error 0 us; skew 500 ppm
I20251211 09:07:54.001421 479 webserver.cc:492] Webserver started at http://127.0.119.254:33741/ using document root <none> and password file <none>
I20251211 09:07:54.001489 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:54.001523 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:54.001559 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:54.001794 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "d8ef57de2caa4fcfbbbe68a120e955b1"
format_stamp: "Formatted at 2025-12-11 09:07:53 on dist-test-slave-hb70"
I20251211 09:07:54.002574 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:54.002979 2087 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.003108 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.003158 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "d8ef57de2caa4fcfbbbe68a120e955b1"
format_stamp: "Formatted at 2025-12-11 09:07:53 on dist-test-slave-hb70"
I20251211 09:07:54.003206 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:54.016690 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:54.016897 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:54.019426 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:33929
I20251211 09:07:54.021183 2139 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:33929 every 8 connection(s)
I20251211 09:07:54.021351 2140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:54.022464 2140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1: Bootstrap starting.
I20251211 09:07:54.022789 2140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:54.023258 2140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1: No bootstrap required, opened a new log
I20251211 09:07:54.023373 2140 raft_consensus.cc:359] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" member_type: VOTER }
I20251211 09:07:54.023420 2140 raft_consensus.cc:385] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:54.023435 2140 raft_consensus.cc:740] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ef57de2caa4fcfbbbe68a120e955b1, State: Initialized, Role: FOLLOWER
I20251211 09:07:54.023497 2140 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" member_type: VOTER }
I20251211 09:07:54.023537 2140 raft_consensus.cc:399] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:07:54.023556 2140 raft_consensus.cc:493] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:07:54.023586 2140 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:54.024062 2140 raft_consensus.cc:515] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" member_type: VOTER }
I20251211 09:07:54.024116 2140 leader_election.cc:304] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8ef57de2caa4fcfbbbe68a120e955b1; no voters:
I20251211 09:07:54.024219 2140 leader_election.cc:290] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:07:54.024264 2143 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:54.024369 2140 sys_catalog.cc:565] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:07:54.024405 2143 raft_consensus.cc:697] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 1 LEADER]: Becoming Leader. State: Replica: d8ef57de2caa4fcfbbbe68a120e955b1, State: Running, Role: LEADER
I20251211 09:07:54.024485 2143 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" member_type: VOTER }
I20251211 09:07:54.024704 2144 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" member_type: VOTER } }
I20251211 09:07:54.024715 2145 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8ef57de2caa4fcfbbbe68a120e955b1. Latest consensus state: current_term: 1 leader_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8ef57de2caa4fcfbbbe68a120e955b1" member_type: VOTER } }
I20251211 09:07:54.025023 2144 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:54.025053 2145 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [sys.catalog]: This master's current role is: LEADER
I20251211 09:07:54.025224 2153 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:07:54.025415 2153 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:07:54.025789 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:07:54.025938 2153 catalog_manager.cc:1357] Generated new cluster ID: 633823a08a4e4baebee6dc1ba3c93265
I20251211 09:07:54.025988 2153 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:07:54.060490 2153 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:07:54.060928 2153 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:07:54.063503 2153 catalog_manager.cc:6027] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1: Generated new TSK 0
I20251211 09:07:54.063575 2153 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:07:54.089818 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:54.091135 2161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:54.091221 2164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:54.091220 2162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:54.091459 479 server_base.cc:1047] running on GCE node
I20251211 09:07:54.091538 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:54.091562 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:54.091575 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444074091576 us; error 0 us; skew 500 ppm
I20251211 09:07:54.092163 479 webserver.cc:492] Webserver started at http://127.0.119.193:39619/ using document root <none> and password file <none>
I20251211 09:07:54.092233 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:54.092268 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:54.092303 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:54.092536 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "e1060575888e4c3aa55335bc97e818b4"
format_stamp: "Formatted at 2025-12-11 09:07:54 on dist-test-slave-hb70"
I20251211 09:07:54.093384 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:54.093808 2169 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.093948 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.094015 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "e1060575888e4c3aa55335bc97e818b4"
format_stamp: "Formatted at 2025-12-11 09:07:54 on dist-test-slave-hb70"
I20251211 09:07:54.094077 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:54.113006 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:54.113185 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:54.113420 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:54.113617 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:54.113643 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.113667 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:54.113685 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.116255 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:46815
I20251211 09:07:54.116320 2232 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:46815 every 8 connection(s)
I20251211 09:07:54.116631 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:54.117811 2237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:54.117868 2240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:54.118093 479 server_base.cc:1047] running on GCE node
W20251211 09:07:54.118467 2238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:54.118615 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:54.118654 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:54.118666 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444074118667 us; error 0 us; skew 500 ppm
I20251211 09:07:54.119298 479 webserver.cc:492] Webserver started at http://127.0.119.194:37539/ using document root <none> and password file <none>
I20251211 09:07:54.119390 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:54.119441 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:54.119496 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:54.119820 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "26dfec800b934d8583cb909ace1d2300"
format_stamp: "Formatted at 2025-12-11 09:07:54 on dist-test-slave-hb70"
I20251211 09:07:54.120394 2233 heartbeater.cc:344] Connected to a master server at 127.0.119.254:33929
I20251211 09:07:54.120458 2233 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:54.120553 2233 heartbeater.cc:507] Master 127.0.119.254:33929 requested a full tablet report, sending...
I20251211 09:07:54.120803 2104 ts_manager.cc:194] Registered new tserver with Master: e1060575888e4c3aa55335bc97e818b4 (127.0.119.193:46815)
I20251211 09:07:54.120903 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:54.121371 2245 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.121378 2104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57494
I20251211 09:07:54.121491 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.121534 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "26dfec800b934d8583cb909ace1d2300"
format_stamp: "Formatted at 2025-12-11 09:07:54 on dist-test-slave-hb70"
I20251211 09:07:54.121578 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:54.132647 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:54.132896 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:54.133015 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:54.133200 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:54.133227 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.133322 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:54.133350 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.136161 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:37455
I20251211 09:07:54.136197 2309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:37455 every 8 connection(s)
I20251211 09:07:54.136529 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:07:54.137656 2316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:07:54.137678 2313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:54.138253 479 server_base.cc:1047] running on GCE node
W20251211 09:07:54.138442 2314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:07:54.138614 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:07:54.138648 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:07:54.138667 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444074138667 us; error 0 us; skew 500 ppm
I20251211 09:07:54.139333 479 webserver.cc:492] Webserver started at http://127.0.119.195:41101/ using document root <none> and password file <none>
I20251211 09:07:54.139428 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:07:54.139477 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:07:54.139528 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:07:54.139849 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "aa5f942dec594d1cb65c385860c55f11"
format_stamp: "Formatted at 2025-12-11 09:07:54 on dist-test-slave-hb70"
I20251211 09:07:54.139940 2310 heartbeater.cc:344] Connected to a master server at 127.0.119.254:33929
I20251211 09:07:54.139994 2310 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:54.140092 2310 heartbeater.cc:507] Master 127.0.119.254:33929 requested a full tablet report, sending...
I20251211 09:07:54.140323 2104 ts_manager.cc:194] Registered new tserver with Master: 26dfec800b934d8583cb909ace1d2300 (127.0.119.194:37455)
I20251211 09:07:54.140668 2104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57502
I20251211 09:07:54.140887 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:07:54.141366 2321 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.141481 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.141525 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "aa5f942dec594d1cb65c385860c55f11"
format_stamp: "Formatted at 2025-12-11 09:07:54 on dist-test-slave-hb70"
I20251211 09:07:54.141569 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:07:54.164640 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:07:54.164886 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:07:54.165076 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:07:54.165302 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:07:54.165333 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.165366 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:07:54.165396 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:07:54.168498 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:40255
I20251211 09:07:54.168557 2384 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:40255 every 8 connection(s)
I20251211 09:07:54.171619 2385 heartbeater.cc:344] Connected to a master server at 127.0.119.254:33929
I20251211 09:07:54.171674 2385 heartbeater.cc:461] Registering TS with master...
I20251211 09:07:54.171772 2385 heartbeater.cc:507] Master 127.0.119.254:33929 requested a full tablet report, sending...
I20251211 09:07:54.172061 2104 ts_manager.cc:194] Registered new tserver with Master: aa5f942dec594d1cb65c385860c55f11 (127.0.119.195:40255)
I20251211 09:07:54.172430 2104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57504
I20251211 09:07:54.173082 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004393068s
I20251211 09:07:54.173449 479 test_util.cc:276] Using random seed: 2062119944
I20251211 09:07:54.177966 2104 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57514:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:07:54.178094 2104 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:07:54.182579 2274 tablet_service.cc:1505] Processing CreateTablet for tablet d013c279fc524bd3bd0ca645c6c301af (DEFAULT_TABLE table=test-workload [id=86539807482b431eb9a36e7a088f4503]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:54.182724 2274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d013c279fc524bd3bd0ca645c6c301af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:54.182962 2197 tablet_service.cc:1505] Processing CreateTablet for tablet d013c279fc524bd3bd0ca645c6c301af (DEFAULT_TABLE table=test-workload [id=86539807482b431eb9a36e7a088f4503]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:54.183034 2349 tablet_service.cc:1505] Processing CreateTablet for tablet d013c279fc524bd3bd0ca645c6c301af (DEFAULT_TABLE table=test-workload [id=86539807482b431eb9a36e7a088f4503]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:07:54.183053 2197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d013c279fc524bd3bd0ca645c6c301af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:54.183152 2349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d013c279fc524bd3bd0ca645c6c301af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:07:54.184278 2400 tablet_bootstrap.cc:492] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300: Bootstrap starting.
I20251211 09:07:54.184509 2402 tablet_bootstrap.cc:492] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4: Bootstrap starting.
I20251211 09:07:54.184747 2400 tablet_bootstrap.cc:654] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:54.185020 2402 tablet_bootstrap.cc:654] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:54.185120 2401 tablet_bootstrap.cc:492] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11: Bootstrap starting.
I20251211 09:07:54.185514 2401 tablet_bootstrap.cc:654] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11: Neither blocks nor log segments found. Creating new log.
I20251211 09:07:54.185602 2402 tablet_bootstrap.cc:492] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4: No bootstrap required, opened a new log
I20251211 09:07:54.185652 2402 ts_tablet_manager.cc:1403] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:54.185798 2402 raft_consensus.cc:359] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.185881 2402 raft_consensus.cc:385] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:54.185907 2402 raft_consensus.cc:740] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1060575888e4c3aa55335bc97e818b4, State: Initialized, Role: FOLLOWER
I20251211 09:07:54.185913 2400 tablet_bootstrap.cc:492] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300: No bootstrap required, opened a new log
I20251211 09:07:54.185972 2400 ts_tablet_manager.cc:1403] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:07:54.186003 2402 consensus_queue.cc:260] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.186103 2400 raft_consensus.cc:359] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.186162 2400 raft_consensus.cc:385] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:54.186177 2402 ts_tablet_manager.cc:1434] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:07:54.186185 2400 raft_consensus.cc:740] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26dfec800b934d8583cb909ace1d2300, State: Initialized, Role: FOLLOWER
I20251211 09:07:54.186316 2401 tablet_bootstrap.cc:492] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11: No bootstrap required, opened a new log
I20251211 09:07:54.186209 2233 heartbeater.cc:499] Master 127.0.119.254:33929 was elected leader, sending a full tablet report...
I20251211 09:07:54.186477 2400 consensus_queue.cc:260] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.186558 2401 ts_tablet_manager.cc:1403] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:07:54.186630 2400 ts_tablet_manager.cc:1434] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:07:54.186721 2310 heartbeater.cc:499] Master 127.0.119.254:33929 was elected leader, sending a full tablet report...
I20251211 09:07:54.186705 2401 raft_consensus.cc:359] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.186756 2401 raft_consensus.cc:385] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:07:54.186779 2401 raft_consensus.cc:740] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5f942dec594d1cb65c385860c55f11, State: Initialized, Role: FOLLOWER
I20251211 09:07:54.187057 2401 consensus_queue.cc:260] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.187245 2385 heartbeater.cc:499] Master 127.0.119.254:33929 was elected leader, sending a full tablet report...
I20251211 09:07:54.187244 2401 ts_tablet_manager.cc:1434] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20251211 09:07:54.366662 2234 tablet.cc:2378] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 09:07:54.422641 2408 raft_consensus.cc:493] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:07:54.422783 2408 raft_consensus.cc:515] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.423007 2408 leader_election.cc:290] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1060575888e4c3aa55335bc97e818b4 (127.0.119.193:46815), 26dfec800b934d8583cb909ace1d2300 (127.0.119.194:37455)
I20251211 09:07:54.425530 2207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d013c279fc524bd3bd0ca645c6c301af" candidate_uuid: "aa5f942dec594d1cb65c385860c55f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1060575888e4c3aa55335bc97e818b4" is_pre_election: true
I20251211 09:07:54.425626 2207 raft_consensus.cc:2468] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa5f942dec594d1cb65c385860c55f11 in term 0.
I20251211 09:07:54.425595 2284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d013c279fc524bd3bd0ca645c6c301af" candidate_uuid: "aa5f942dec594d1cb65c385860c55f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26dfec800b934d8583cb909ace1d2300" is_pre_election: true
I20251211 09:07:54.425690 2284 raft_consensus.cc:2468] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa5f942dec594d1cb65c385860c55f11 in term 0.
I20251211 09:07:54.425776 2325 leader_election.cc:304] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa5f942dec594d1cb65c385860c55f11, e1060575888e4c3aa55335bc97e818b4; no voters:
I20251211 09:07:54.425879 2408 raft_consensus.cc:2804] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:07:54.425927 2408 raft_consensus.cc:493] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:07:54.425947 2408 raft_consensus.cc:3060] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:54.426625 2408 raft_consensus.cc:515] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.426741 2408 leader_election.cc:290] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [CANDIDATE]: Term 1 election: Requested vote from peers e1060575888e4c3aa55335bc97e818b4 (127.0.119.193:46815), 26dfec800b934d8583cb909ace1d2300 (127.0.119.194:37455)
I20251211 09:07:54.426904 2284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d013c279fc524bd3bd0ca645c6c301af" candidate_uuid: "aa5f942dec594d1cb65c385860c55f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26dfec800b934d8583cb909ace1d2300"
I20251211 09:07:54.426959 2284 raft_consensus.cc:3060] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:54.427459 2284 raft_consensus.cc:2468] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa5f942dec594d1cb65c385860c55f11 in term 1.
I20251211 09:07:54.427539 2207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d013c279fc524bd3bd0ca645c6c301af" candidate_uuid: "aa5f942dec594d1cb65c385860c55f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1060575888e4c3aa55335bc97e818b4"
I20251211 09:07:54.427597 2207 raft_consensus.cc:3060] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:07:54.427649 2322 leader_election.cc:304] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26dfec800b934d8583cb909ace1d2300, aa5f942dec594d1cb65c385860c55f11; no voters:
I20251211 09:07:54.427770 2408 raft_consensus.cc:2804] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:07:54.427925 2408 raft_consensus.cc:697] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 1 LEADER]: Becoming Leader. State: Replica: aa5f942dec594d1cb65c385860c55f11, State: Running, Role: LEADER
I20251211 09:07:54.428097 2408 consensus_queue.cc:237] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:07:54.428318 2207 raft_consensus.cc:2468] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa5f942dec594d1cb65c385860c55f11 in term 1.
I20251211 09:07:54.428627 2103 catalog_manager.cc:5654] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa5f942dec594d1cb65c385860c55f11 (127.0.119.195). New cstate: current_term: 1 leader_uuid: "aa5f942dec594d1cb65c385860c55f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } health_report { overall_health: HEALTHY } } }
I20251211 09:07:54.472393 2207 raft_consensus.cc:1275] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 1 FOLLOWER]: Refusing update from remote peer aa5f942dec594d1cb65c385860c55f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:54.472393 2284 raft_consensus.cc:1275] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 1 FOLLOWER]: Refusing update from remote peer aa5f942dec594d1cb65c385860c55f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:07:54.472671 2410 consensus_queue.cc:1048] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:07:54.472869 2408 consensus_queue.cc:1048] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:04.957293 2435 raft_consensus.cc:993] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11: : Instructing follower e1060575888e4c3aa55335bc97e818b4 to start an election
I20251211 09:08:04.957382 2435 raft_consensus.cc:1081] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 1 LEADER]: Signalling peer e1060575888e4c3aa55335bc97e818b4 to start an election
I20251211 09:08:04.957602 2206 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d013c279fc524bd3bd0ca645c6c301af"
dest_uuid: "e1060575888e4c3aa55335bc97e818b4"
from {username='slave'} at 127.0.0.1:52172
I20251211 09:08:04.957666 2206 raft_consensus.cc:493] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:08:04.957685 2206 raft_consensus.cc:3060] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:04.958318 2206 raft_consensus.cc:515] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:08:04.958472 2206 leader_election.cc:290] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [CANDIDATE]: Term 2 election: Requested vote from peers 26dfec800b934d8583cb909ace1d2300 (127.0.119.194:37455), aa5f942dec594d1cb65c385860c55f11 (127.0.119.195:40255)
I20251211 09:08:04.962024 2284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d013c279fc524bd3bd0ca645c6c301af" candidate_uuid: "e1060575888e4c3aa55335bc97e818b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 13647 } } ignore_live_leader: true dest_uuid: "26dfec800b934d8583cb909ace1d2300"
I20251211 09:08:04.962025 2359 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d013c279fc524bd3bd0ca645c6c301af" candidate_uuid: "e1060575888e4c3aa55335bc97e818b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 13647 } } ignore_live_leader: true dest_uuid: "aa5f942dec594d1cb65c385860c55f11"
I20251211 09:08:04.962116 2284 raft_consensus.cc:3060] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:04.962155 2359 raft_consensus.cc:3055] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:08:04.962191 2359 raft_consensus.cc:740] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa5f942dec594d1cb65c385860c55f11, State: Running, Role: LEADER
I20251211 09:08:04.962251 2359 consensus_queue.cc:260] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13647, Committed index: 13647, Last appended: 1.13647, Last appended by leader: 13647, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:08:04.962340 2359 raft_consensus.cc:3060] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:04.962878 2284 raft_consensus.cc:2468] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1060575888e4c3aa55335bc97e818b4 in term 2.
I20251211 09:08:04.963021 2359 raft_consensus.cc:2468] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1060575888e4c3aa55335bc97e818b4 in term 2.
I20251211 09:08:04.963095 2170 leader_election.cc:304] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26dfec800b934d8583cb909ace1d2300, e1060575888e4c3aa55335bc97e818b4; no voters:
I20251211 09:08:04.963266 2463 raft_consensus.cc:2804] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:08:04.963353 2463 raft_consensus.cc:697] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 2 LEADER]: Becoming Leader. State: Replica: e1060575888e4c3aa55335bc97e818b4, State: Running, Role: LEADER
I20251211 09:08:04.963411 2463 consensus_queue.cc:237] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13647, Committed index: 13647, Last appended: 1.13647, Last appended by leader: 13647, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } }
I20251211 09:08:04.963977 2103 catalog_manager.cc:5654] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 reported cstate change: term changed from 1 to 2, leader changed from aa5f942dec594d1cb65c385860c55f11 (127.0.119.195) to e1060575888e4c3aa55335bc97e818b4 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "e1060575888e4c3aa55335bc97e818b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1060575888e4c3aa55335bc97e818b4" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 46815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 } health_report { overall_health: UNKNOWN } } }
I20251211 09:08:04.974504 2284 raft_consensus.cc:1275] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 2 FOLLOWER]: Refusing update from remote peer e1060575888e4c3aa55335bc97e818b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 13647. Preceding OpId from leader: term: 2 index: 13649. (index mismatch)
I20251211 09:08:04.974504 2359 raft_consensus.cc:1275] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 2 FOLLOWER]: Refusing update from remote peer e1060575888e4c3aa55335bc97e818b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 13647. Preceding OpId from leader: term: 2 index: 13649. (index mismatch)
I20251211 09:08:04.974747 2464 consensus_queue.cc:1048] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa5f942dec594d1cb65c385860c55f11" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13648, Last known committed idx: 13647, Time since last communication: 0.000s
I20251211 09:08:04.974848 2463 consensus_queue.cc:1048] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26dfec800b934d8583cb909ace1d2300" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13648, Last known committed idx: 13647, Time since last communication: 0.000s
W20251211 09:08:04.978160 2470 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42568: Illegal state: Transaction 0 commit already in progress
I20251211 09:08:04.978437 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:08:04.981274 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:04.981375 479 tablet_replica.cc:333] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4: stopping tablet replica
I20251211 09:08:04.981431 479 raft_consensus.cc:2243] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:08:04.981487 479 raft_consensus.cc:2272] T d013c279fc524bd3bd0ca645c6c301af P e1060575888e4c3aa55335bc97e818b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:04.995558 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:08:04.996433 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:08:04.999958 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:05.000075 479 tablet_replica.cc:333] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300: stopping tablet replica
I20251211 09:08:05.000133 479 raft_consensus.cc:2243] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:05.000183 479 raft_consensus.cc:2272] T d013c279fc524bd3bd0ca645c6c301af P 26dfec800b934d8583cb909ace1d2300 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:05.020937 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:08:05.021849 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:08:05.025444 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:05.025583 479 tablet_replica.cc:333] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11: stopping tablet replica
I20251211 09:08:05.025642 479 raft_consensus.cc:2243] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:05.025701 479 raft_consensus.cc:2272] T d013c279fc524bd3bd0ca645c6c301af P aa5f942dec594d1cb65c385860c55f11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:05.029207 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:08:05.030068 479 master.cc:561] Master@127.0.119.254:33929 shutting down...
I20251211 09:08:05.032608 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:08:05.032667 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:05.032686 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P d8ef57de2caa4fcfbbbe68a120e955b1: stopping tablet replica
I20251211 09:08:05.045111 479 master.cc:583] Master@127.0.119.254:33929 shutdown complete.
[ OK ] TxnParticipantITest.TestBeginCommitAfterFinalize (11065 ms)
[ RUN ] TxnParticipantITest.TestProxyErrorWhenNotBegun
I20251211 09:08:05.064633 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:46733
I20251211 09:08:05.064788 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:08:05.066247 479 server_base.cc:1047] running on GCE node
W20251211 09:08:05.066259 2481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:05.066397 2479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:05.066432 2478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:05.066615 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:05.066653 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:05.066672 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444085066671 us; error 0 us; skew 500 ppm
I20251211 09:08:05.067241 479 webserver.cc:492] Webserver started at http://127.0.119.254:33519/ using document root <none> and password file <none>
I20251211 09:08:05.067323 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:05.067369 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:05.067425 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:05.067683 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "fc12cfd9ebf049bfa3f9a231907df6d1"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.068552 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:05.068990 2486 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.069133 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.069185 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "fc12cfd9ebf049bfa3f9a231907df6d1"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.069232 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:05.074316 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:05.074491 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:05.076828 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:46733
I20251211 09:08:05.087388 2538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:46733 every 8 connection(s)
I20251211 09:08:05.087404 2539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:05.088464 2539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1: Bootstrap starting.
I20251211 09:08:05.088758 2539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:05.089267 2539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1: No bootstrap required, opened a new log
I20251211 09:08:05.089380 2539 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" member_type: VOTER }
I20251211 09:08:05.089437 2539 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:05.089452 2539 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc12cfd9ebf049bfa3f9a231907df6d1, State: Initialized, Role: FOLLOWER
I20251211 09:08:05.089490 2539 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" member_type: VOTER }
I20251211 09:08:05.089526 2539 raft_consensus.cc:399] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:08:05.089555 2539 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:08:05.089573 2539 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:05.090020 2539 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" member_type: VOTER }
I20251211 09:08:05.090071 2539 leader_election.cc:304] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc12cfd9ebf049bfa3f9a231907df6d1; no voters:
I20251211 09:08:05.090160 2539 leader_election.cc:290] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:08:05.090231 2542 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:05.090324 2539 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:08:05.090335 2542 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 1 LEADER]: Becoming Leader. State: Replica: fc12cfd9ebf049bfa3f9a231907df6d1, State: Running, Role: LEADER
I20251211 09:08:05.090453 2542 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" member_type: VOTER }
I20251211 09:08:05.090646 2544 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc12cfd9ebf049bfa3f9a231907df6d1. Latest consensus state: current_term: 1 leader_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" member_type: VOTER } }
I20251211 09:08:05.090651 2543 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc12cfd9ebf049bfa3f9a231907df6d1" member_type: VOTER } }
I20251211 09:08:05.090849 2543 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:05.091015 2548 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:08:05.091038 2544 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:05.091173 2548 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:08:05.091668 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:08:05.092057 2548 catalog_manager.cc:1357] Generated new cluster ID: 0d4c433b0a1a41969b1fb6f2c6feb4e8
I20251211 09:08:05.092103 2548 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:08:05.099575 2548 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:08:05.099967 2548 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:08:05.107679 2548 catalog_manager.cc:6027] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1: Generated new TSK 0
I20251211 09:08:05.107754 2548 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:08:05.123461 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:05.124810 2561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:05.124859 2560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:05.125015 479 server_base.cc:1047] running on GCE node
W20251211 09:08:05.124881 2563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:05.125180 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:05.125207 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:05.125227 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444085125227 us; error 0 us; skew 500 ppm
I20251211 09:08:05.125834 479 webserver.cc:492] Webserver started at http://127.0.119.193:38043/ using document root <none> and password file <none>
I20251211 09:08:05.125916 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:05.125964 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:05.126015 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:05.126293 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "eeccd7b13a054b9399ff3c9406c97b06"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.127153 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:05.127600 2568 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.127728 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.127775 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "eeccd7b13a054b9399ff3c9406c97b06"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.127820 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:05.139804 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:05.139984 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:05.140123 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:05.140363 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:05.140395 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.140429 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:05.140455 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.143107 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:34697
I20251211 09:08:05.143730 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:08:05.143998 2631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:34697 every 8 connection(s)
W20251211 09:08:05.144948 2634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:05.145008 2637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:05.145053 2635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:05.145164 479 server_base.cc:1047] running on GCE node
I20251211 09:08:05.145349 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:05.145386 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:05.145399 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444085145400 us; error 0 us; skew 500 ppm
I20251211 09:08:05.145972 479 webserver.cc:492] Webserver started at http://127.0.119.194:39175/ using document root <none> and password file <none>
I20251211 09:08:05.146050 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:05.146098 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:05.146148 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:05.146394 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "1a2aea4def5949168bbd13e10f2a21ea"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.147338 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:05.147897 2644 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.147960 2632 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46733
I20251211 09:08:05.148015 2632 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:05.148011 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.148095 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "1a2aea4def5949168bbd13e10f2a21ea"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.148134 2632 heartbeater.cc:507] Master 127.0.119.254:46733 requested a full tablet report, sending...
I20251211 09:08:05.148144 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:05.148386 2503 ts_manager.cc:194] Registered new tserver with Master: eeccd7b13a054b9399ff3c9406c97b06 (127.0.119.193:34697)
I20251211 09:08:05.149027 2503 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55072
I20251211 09:08:05.159729 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:05.159934 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:05.160106 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:05.160315 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:05.160342 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.160379 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:05.160406 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.163152 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:45911
I20251211 09:08:05.163230 2707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:45911 every 8 connection(s)
I20251211 09:08:05.163533 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:05.164749 2711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:05.164793 2712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:05.164999 479 server_base.cc:1047] running on GCE node
W20251211 09:08:05.165366 2714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:05.165560 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:05.165607 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:05.165627 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444085165626 us; error 0 us; skew 500 ppm
I20251211 09:08:05.166316 479 webserver.cc:492] Webserver started at http://127.0.119.195:38783/ using document root <none> and password file <none>
I20251211 09:08:05.166411 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:05.166469 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:05.166518 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:05.166853 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "26c9f850037b4660805c76eca4670f40"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.166985 2708 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46733
I20251211 09:08:05.167058 2708 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:05.167168 2708 heartbeater.cc:507] Master 127.0.119.254:46733 requested a full tablet report, sending...
I20251211 09:08:05.167387 2503 ts_manager.cc:194] Registered new tserver with Master: 1a2aea4def5949168bbd13e10f2a21ea (127.0.119.194:45911)
I20251211 09:08:05.167718 2503 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55078
I20251211 09:08:05.167925 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:08:05.168383 2719 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.168524 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.168568 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "26c9f850037b4660805c76eca4670f40"
format_stamp: "Formatted at 2025-12-11 09:08:05 on dist-test-slave-hb70"
I20251211 09:08:05.168614 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:05.175060 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:05.175275 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:05.175431 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:05.175611 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:05.175639 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.175671 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:05.175697 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:05.178953 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:37277
I20251211 09:08:05.179018 2782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:37277 every 8 connection(s)
I20251211 09:08:05.181965 2783 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46733
I20251211 09:08:05.182016 2783 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:05.182116 2783 heartbeater.cc:507] Master 127.0.119.254:46733 requested a full tablet report, sending...
I20251211 09:08:05.182335 2503 ts_manager.cc:194] Registered new tserver with Master: 26c9f850037b4660805c76eca4670f40 (127.0.119.195:37277)
I20251211 09:08:05.182391 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003247101s
I20251211 09:08:05.182754 479 test_util.cc:276] Using random seed: 2073129250
I20251211 09:08:05.182785 2503 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55080
I20251211 09:08:05.187177 2503 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55088:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:08:05.187310 2503 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:08:05.191356 2672 tablet_service.cc:1505] Processing CreateTablet for tablet d3b4819b435544ff89d1aabfaa26c674 (DEFAULT_TABLE table=test-workload [id=e97a91bea0164e1b8f8b5a368d6b50e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:05.191502 2672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b4819b435544ff89d1aabfaa26c674. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:05.192600 2747 tablet_service.cc:1505] Processing CreateTablet for tablet d3b4819b435544ff89d1aabfaa26c674 (DEFAULT_TABLE table=test-workload [id=e97a91bea0164e1b8f8b5a368d6b50e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:05.192625 2596 tablet_service.cc:1505] Processing CreateTablet for tablet d3b4819b435544ff89d1aabfaa26c674 (DEFAULT_TABLE table=test-workload [id=e97a91bea0164e1b8f8b5a368d6b50e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:05.192699 2747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b4819b435544ff89d1aabfaa26c674. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:05.192720 2596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b4819b435544ff89d1aabfaa26c674. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:05.193102 2798 tablet_bootstrap.cc:492] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea: Bootstrap starting.
I20251211 09:08:05.193567 2798 tablet_bootstrap.cc:654] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:05.194206 2798 tablet_bootstrap.cc:492] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea: No bootstrap required, opened a new log
I20251211 09:08:05.194257 2798 ts_tablet_manager.cc:1403] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:05.194306 2801 tablet_bootstrap.cc:492] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06: Bootstrap starting.
I20251211 09:08:05.194420 2798 raft_consensus.cc:359] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.194504 2798 raft_consensus.cc:385] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:05.194528 2798 raft_consensus.cc:740] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a2aea4def5949168bbd13e10f2a21ea, State: Initialized, Role: FOLLOWER
I20251211 09:08:05.194586 2798 consensus_queue.cc:260] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.194728 2801 tablet_bootstrap.cc:654] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:05.194767 2798 ts_tablet_manager.cc:1434] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251211 09:08:05.194823 2708 heartbeater.cc:499] Master 127.0.119.254:46733 was elected leader, sending a full tablet report...
I20251211 09:08:05.194264 2800 tablet_bootstrap.cc:492] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40: Bootstrap starting.
I20251211 09:08:05.195425 2800 tablet_bootstrap.cc:654] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:05.195762 2801 tablet_bootstrap.cc:492] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06: No bootstrap required, opened a new log
I20251211 09:08:05.195802 2801 ts_tablet_manager.cc:1403] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:08:05.195916 2800 tablet_bootstrap.cc:492] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40: No bootstrap required, opened a new log
I20251211 09:08:05.195967 2800 ts_tablet_manager.cc:1403] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:08:05.195920 2801 raft_consensus.cc:359] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.196014 2801 raft_consensus.cc:385] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:05.196043 2801 raft_consensus.cc:740] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeccd7b13a054b9399ff3c9406c97b06, State: Initialized, Role: FOLLOWER
I20251211 09:08:05.196133 2800 raft_consensus.cc:359] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.196139 2801 consensus_queue.cc:260] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.196203 2800 raft_consensus.cc:385] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:05.196219 2800 raft_consensus.cc:740] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26c9f850037b4660805c76eca4670f40, State: Initialized, Role: FOLLOWER
I20251211 09:08:05.196269 2800 consensus_queue.cc:260] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.196357 2801 ts_tablet_manager.cc:1434] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:05.196388 2632 heartbeater.cc:499] Master 127.0.119.254:46733 was elected leader, sending a full tablet report...
I20251211 09:08:05.196439 2800 ts_tablet_manager.cc:1434] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:08:05.196537 2783 heartbeater.cc:499] Master 127.0.119.254:46733 was elected leader, sending a full tablet report...
I20251211 09:08:05.297473 2802 raft_consensus.cc:493] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:08:05.297581 2802 raft_consensus.cc:515] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.297782 2802 leader_election.cc:290] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26c9f850037b4660805c76eca4670f40 (127.0.119.195:37277), eeccd7b13a054b9399ff3c9406c97b06 (127.0.119.193:34697)
I20251211 09:08:05.300305 2757 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b4819b435544ff89d1aabfaa26c674" candidate_uuid: "1a2aea4def5949168bbd13e10f2a21ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f850037b4660805c76eca4670f40" is_pre_election: true
I20251211 09:08:05.300432 2757 raft_consensus.cc:2468] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a2aea4def5949168bbd13e10f2a21ea in term 0.
I20251211 09:08:05.300434 2606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b4819b435544ff89d1aabfaa26c674" candidate_uuid: "1a2aea4def5949168bbd13e10f2a21ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeccd7b13a054b9399ff3c9406c97b06" is_pre_election: true
I20251211 09:08:05.300551 2606 raft_consensus.cc:2468] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a2aea4def5949168bbd13e10f2a21ea in term 0.
I20251211 09:08:05.300624 2647 leader_election.cc:304] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a2aea4def5949168bbd13e10f2a21ea, 26c9f850037b4660805c76eca4670f40; no voters:
I20251211 09:08:05.300751 2802 raft_consensus.cc:2804] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:08:05.300788 2802 raft_consensus.cc:493] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:08:05.300804 2802 raft_consensus.cc:3060] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:05.301466 2802 raft_consensus.cc:515] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.301568 2802 leader_election.cc:290] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [CANDIDATE]: Term 1 election: Requested vote from peers 26c9f850037b4660805c76eca4670f40 (127.0.119.195:37277), eeccd7b13a054b9399ff3c9406c97b06 (127.0.119.193:34697)
I20251211 09:08:05.301738 2757 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b4819b435544ff89d1aabfaa26c674" candidate_uuid: "1a2aea4def5949168bbd13e10f2a21ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26c9f850037b4660805c76eca4670f40"
I20251211 09:08:05.301784 2606 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b4819b435544ff89d1aabfaa26c674" candidate_uuid: "1a2aea4def5949168bbd13e10f2a21ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeccd7b13a054b9399ff3c9406c97b06"
I20251211 09:08:05.301792 2757 raft_consensus.cc:3060] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:05.301865 2606 raft_consensus.cc:3060] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:05.302480 2606 raft_consensus.cc:2468] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a2aea4def5949168bbd13e10f2a21ea in term 1.
I20251211 09:08:05.302528 2757 raft_consensus.cc:2468] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a2aea4def5949168bbd13e10f2a21ea in term 1.
I20251211 09:08:05.302654 2647 leader_election.cc:304] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a2aea4def5949168bbd13e10f2a21ea, eeccd7b13a054b9399ff3c9406c97b06; no voters:
I20251211 09:08:05.302738 2802 raft_consensus.cc:2804] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:05.302873 2802 raft_consensus.cc:697] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 1 LEADER]: Becoming Leader. State: Replica: 1a2aea4def5949168bbd13e10f2a21ea, State: Running, Role: LEADER
I20251211 09:08:05.302925 2802 consensus_queue.cc:237] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:05.303453 2503 catalog_manager.cc:5654] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a2aea4def5949168bbd13e10f2a21ea (127.0.119.194). New cstate: current_term: 1 leader_uuid: "1a2aea4def5949168bbd13e10f2a21ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } health_report { overall_health: UNKNOWN } } }
I20251211 09:08:05.317806 2606 raft_consensus.cc:1275] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 1 FOLLOWER]: Refusing update from remote peer 1a2aea4def5949168bbd13e10f2a21ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:05.317809 2757 raft_consensus.cc:1275] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 1 FOLLOWER]: Refusing update from remote peer 1a2aea4def5949168bbd13e10f2a21ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:05.318218 2808 consensus_queue.cc:1048] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:05.318336 2802 consensus_queue.cc:1048] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:15.740670 2840 raft_consensus.cc:993] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea: : Instructing follower eeccd7b13a054b9399ff3c9406c97b06 to start an election
I20251211 09:08:15.740746 2840 raft_consensus.cc:1081] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 1 LEADER]: Signalling peer eeccd7b13a054b9399ff3c9406c97b06 to start an election
I20251211 09:08:15.740940 2606 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d3b4819b435544ff89d1aabfaa26c674"
dest_uuid: "eeccd7b13a054b9399ff3c9406c97b06"
from {username='slave'} at 127.0.0.1:47530
I20251211 09:08:15.741010 2606 raft_consensus.cc:493] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:08:15.741030 2606 raft_consensus.cc:3060] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:15.741726 2606 raft_consensus.cc:515] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:15.741863 2606 leader_election.cc:290] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [CANDIDATE]: Term 2 election: Requested vote from peers 1a2aea4def5949168bbd13e10f2a21ea (127.0.119.194:45911), 26c9f850037b4660805c76eca4670f40 (127.0.119.195:37277)
I20251211 09:08:15.745150 2756 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b4819b435544ff89d1aabfaa26c674" candidate_uuid: "eeccd7b13a054b9399ff3c9406c97b06" candidate_term: 2 candidate_status { last_received { term: 1 index: 13945 } } ignore_live_leader: true dest_uuid: "26c9f850037b4660805c76eca4670f40"
I20251211 09:08:15.745246 2756 raft_consensus.cc:3060] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:15.746215 2756 raft_consensus.cc:2468] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeccd7b13a054b9399ff3c9406c97b06 in term 2.
I20251211 09:08:15.746410 2571 leader_election.cc:304] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26c9f850037b4660805c76eca4670f40, eeccd7b13a054b9399ff3c9406c97b06; no voters:
I20251211 09:08:15.746630 2852 raft_consensus.cc:2804] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:08:15.746673 2682 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3b4819b435544ff89d1aabfaa26c674" candidate_uuid: "eeccd7b13a054b9399ff3c9406c97b06" candidate_term: 2 candidate_status { last_received { term: 1 index: 13945 } } ignore_live_leader: true dest_uuid: "1a2aea4def5949168bbd13e10f2a21ea"
I20251211 09:08:15.746734 2682 raft_consensus.cc:3055] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:08:15.746784 2852 raft_consensus.cc:697] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 2 LEADER]: Becoming Leader. State: Replica: eeccd7b13a054b9399ff3c9406c97b06, State: Running, Role: LEADER
I20251211 09:08:15.746793 2682 raft_consensus.cc:740] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a2aea4def5949168bbd13e10f2a21ea, State: Running, Role: LEADER
I20251211 09:08:15.746918 2852 consensus_queue.cc:237] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13945, Committed index: 13945, Last appended: 1.13945, Last appended by leader: 13945, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:15.746928 2682 consensus_queue.cc:260] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13945, Committed index: 13945, Last appended: 1.13945, Last appended by leader: 13945, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } }
I20251211 09:08:15.747079 2682 raft_consensus.cc:3060] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:15.747668 2682 raft_consensus.cc:2468] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeccd7b13a054b9399ff3c9406c97b06 in term 2.
I20251211 09:08:15.748135 2501 catalog_manager.cc:5654] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 reported cstate change: term changed from 1 to 2, leader changed from 1a2aea4def5949168bbd13e10f2a21ea (127.0.119.194) to eeccd7b13a054b9399ff3c9406c97b06 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "eeccd7b13a054b9399ff3c9406c97b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeccd7b13a054b9399ff3c9406c97b06" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34697 } health_report { overall_health: HEALTHY } } }
W20251211 09:08:15.750885 2817 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58830: Illegal state: Transaction hasn't been successfully started
W20251211 09:08:15.751276 2817 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:58830: Illegal state: Transaction metadata for transaction 1 does not exist
I20251211 09:08:15.751796 2756 raft_consensus.cc:1275] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 2 FOLLOWER]: Refusing update from remote peer eeccd7b13a054b9399ff3c9406c97b06: Log matching property violated. Preceding OpId in replica: term: 1 index: 13945. Preceding OpId from leader: term: 2 index: 13947. (index mismatch)
I20251211 09:08:15.751960 2682 raft_consensus.cc:1275] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 2 FOLLOWER]: Refusing update from remote peer eeccd7b13a054b9399ff3c9406c97b06: Log matching property violated. Preceding OpId in replica: term: 1 index: 13945. Preceding OpId from leader: term: 2 index: 13947. (index mismatch)
I20251211 09:08:15.751994 2853 consensus_queue.cc:1048] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26c9f850037b4660805c76eca4670f40" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13946, Last known committed idx: 13945, Time since last communication: 0.000s
I20251211 09:08:15.752122 2853 consensus_queue.cc:1048] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a2aea4def5949168bbd13e10f2a21ea" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13946, Last known committed idx: 13945, Time since last communication: 0.000s
I20251211 09:08:15.753346 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:08:15.755944 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:15.756037 479 tablet_replica.cc:333] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06: stopping tablet replica
I20251211 09:08:15.756084 479 raft_consensus.cc:2243] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:08:15.756139 479 raft_consensus.cc:2272] T d3b4819b435544ff89d1aabfaa26c674 P eeccd7b13a054b9399ff3c9406c97b06 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:15.770087 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:08:15.771018 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:08:15.773670 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:15.773830 479 tablet_replica.cc:333] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea: stopping tablet replica
I20251211 09:08:15.773903 479 raft_consensus.cc:2243] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:15.773972 479 raft_consensus.cc:2272] T d3b4819b435544ff89d1aabfaa26c674 P 1a2aea4def5949168bbd13e10f2a21ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:15.797472 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:08:15.798362 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:08:15.800761 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:15.800866 479 tablet_replica.cc:333] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40: stopping tablet replica
I20251211 09:08:15.800931 479 raft_consensus.cc:2243] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:15.800984 479 raft_consensus.cc:2272] T d3b4819b435544ff89d1aabfaa26c674 P 26c9f850037b4660805c76eca4670f40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:15.814368 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:08:15.815286 479 master.cc:561] Master@127.0.119.254:46733 shutting down...
I20251211 09:08:15.817515 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:08:15.817587 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:15.817611 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P fc12cfd9ebf049bfa3f9a231907df6d1: stopping tablet replica
I20251211 09:08:15.829566 479 master.cc:583] Master@127.0.119.254:46733 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyErrorWhenNotBegun (10783 ms)
[ RUN ] TxnParticipantITest.TestProxyIllegalStatesInCommitSequence
I20251211 09:08:15.848596 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:44311
I20251211 09:08:15.848753 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:15.850062 2861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:15.850112 2860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:15.850271 479 server_base.cc:1047] running on GCE node
W20251211 09:08:15.850277 2863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:15.850426 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:15.850454 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:15.850466 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444095850467 us; error 0 us; skew 500 ppm
I20251211 09:08:15.851022 479 webserver.cc:492] Webserver started at http://127.0.119.254:35453/ using document root <none> and password file <none>
I20251211 09:08:15.851091 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:15.851125 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:15.851161 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:15.851397 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "63797c31f01b4b9bb33102b31c94309a"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.852234 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:08:15.852658 2868 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.852790 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.852849 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "63797c31f01b4b9bb33102b31c94309a"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.852886 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:15.871263 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:15.871438 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:15.874035 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:44311
I20251211 09:08:15.877214 2922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:15.881888 2921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:44311 every 8 connection(s)
I20251211 09:08:15.884225 2922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a: Bootstrap starting.
I20251211 09:08:15.884491 2922 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:15.884936 2922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a: No bootstrap required, opened a new log
I20251211 09:08:15.885037 2922 raft_consensus.cc:359] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63797c31f01b4b9bb33102b31c94309a" member_type: VOTER }
I20251211 09:08:15.885082 2922 raft_consensus.cc:385] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:15.885095 2922 raft_consensus.cc:740] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63797c31f01b4b9bb33102b31c94309a, State: Initialized, Role: FOLLOWER
I20251211 09:08:15.885133 2922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63797c31f01b4b9bb33102b31c94309a" member_type: VOTER }
I20251211 09:08:15.885174 2922 raft_consensus.cc:399] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:08:15.885196 2922 raft_consensus.cc:493] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:08:15.885226 2922 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:15.885690 2922 raft_consensus.cc:515] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63797c31f01b4b9bb33102b31c94309a" member_type: VOTER }
I20251211 09:08:15.885744 2922 leader_election.cc:304] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63797c31f01b4b9bb33102b31c94309a; no voters:
I20251211 09:08:15.885825 2922 leader_election.cc:290] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:08:15.885902 2925 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:15.885965 2922 sys_catalog.cc:565] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:08:15.886062 2925 raft_consensus.cc:697] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 1 LEADER]: Becoming Leader. State: Replica: 63797c31f01b4b9bb33102b31c94309a, State: Running, Role: LEADER
I20251211 09:08:15.886140 2925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63797c31f01b4b9bb33102b31c94309a" member_type: VOTER }
I20251211 09:08:15.886365 2926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63797c31f01b4b9bb33102b31c94309a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63797c31f01b4b9bb33102b31c94309a" member_type: VOTER } }
I20251211 09:08:15.886389 2927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63797c31f01b4b9bb33102b31c94309a. Latest consensus state: current_term: 1 leader_uuid: "63797c31f01b4b9bb33102b31c94309a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63797c31f01b4b9bb33102b31c94309a" member_type: VOTER } }
I20251211 09:08:15.886540 2926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:15.886559 2927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:15.886687 2934 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:08:15.886878 2934 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:08:15.887372 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:08:15.887387 2934 catalog_manager.cc:1357] Generated new cluster ID: 1368276234b24790afd4cade6c0c2498
I20251211 09:08:15.887439 2934 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:08:15.898934 2934 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:08:15.899390 2934 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:08:15.903780 2934 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a: Generated new TSK 0
I20251211 09:08:15.903870 2934 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:08:15.919185 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:15.920567 2944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:15.920682 479 server_base.cc:1047] running on GCE node
W20251211 09:08:15.920567 2943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:15.920691 2946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:15.921028 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:15.921068 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:15.921082 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444095921083 us; error 0 us; skew 500 ppm
I20251211 09:08:15.921693 479 webserver.cc:492] Webserver started at http://127.0.119.193:35279/ using document root <none> and password file <none>
I20251211 09:08:15.921772 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:15.921813 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:15.921856 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:15.922108 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "a48ed4a6046b430493044310bc611594"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.922912 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:15.923323 2951 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.923444 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.923503 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "a48ed4a6046b430493044310bc611594"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.923550 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:15.927433 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:15.927603 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:15.927734 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:15.927918 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:15.927945 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.927966 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:15.927994 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.930797 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:42567
I20251211 09:08:15.930828 3014 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:42567 every 8 connection(s)
I20251211 09:08:15.931154 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:15.932318 3020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:15.932518 3019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:15.932557 479 server_base.cc:1047] running on GCE node
W20251211 09:08:15.932667 3022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:15.932847 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:15.932893 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:15.932910 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444095932910 us; error 0 us; skew 500 ppm
I20251211 09:08:15.933597 479 webserver.cc:492] Webserver started at http://127.0.119.194:43403/ using document root <none> and password file <none>
I20251211 09:08:15.933688 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:15.933734 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:15.933784 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:15.934103 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "e8b03715e4d54a50be387ea2f57d44c5"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.934787 3015 heartbeater.cc:344] Connected to a master server at 127.0.119.254:44311
I20251211 09:08:15.934844 3015 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:15.934958 3015 heartbeater.cc:507] Master 127.0.119.254:44311 requested a full tablet report, sending...
I20251211 09:08:15.935189 2885 ts_manager.cc:194] Registered new tserver with Master: a48ed4a6046b430493044310bc611594 (127.0.119.193:42567)
I20251211 09:08:15.935261 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:15.935762 3027 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.935794 2885 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36982
I20251211 09:08:15.935948 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.936000 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "e8b03715e4d54a50be387ea2f57d44c5"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.936049 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:15.951385 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:15.951649 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:15.951820 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:15.952036 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:15.952066 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.952102 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:15.952135 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.955082 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:40535
I20251211 09:08:15.955143 3090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:40535 every 8 connection(s)
I20251211 09:08:15.955483 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:15.956728 3094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:15.956804 3097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:15.956845 3095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:15.957047 479 server_base.cc:1047] running on GCE node
I20251211 09:08:15.957172 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:15.957206 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:15.957219 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444095957220 us; error 0 us; skew 500 ppm
I20251211 09:08:15.957913 479 webserver.cc:492] Webserver started at http://127.0.119.195:37477/ using document root <none> and password file <none>
I20251211 09:08:15.958004 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:15.958050 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:15.958107 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:15.958396 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "88376653732847148cec6d00f0fc1fe2"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.958439 3091 heartbeater.cc:344] Connected to a master server at 127.0.119.254:44311
I20251211 09:08:15.958491 3091 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:15.958612 3091 heartbeater.cc:507] Master 127.0.119.254:44311 requested a full tablet report, sending...
I20251211 09:08:15.958849 2885 ts_manager.cc:194] Registered new tserver with Master: e8b03715e4d54a50be387ea2f57d44c5 (127.0.119.194:40535)
I20251211 09:08:15.959336 2885 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36984
I20251211 09:08:15.959558 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:15.960017 3102 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.960139 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.960191 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "88376653732847148cec6d00f0fc1fe2"
format_stamp: "Formatted at 2025-12-11 09:08:15 on dist-test-slave-hb70"
I20251211 09:08:15.960240 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:15.972029 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:15.972268 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:15.972426 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:15.972617 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:15.972644 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.972681 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:15.972708 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.975910 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:45279
I20251211 09:08:15.975988 3165 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:45279 every 8 connection(s)
I20251211 09:08:15.978812 3166 heartbeater.cc:344] Connected to a master server at 127.0.119.254:44311
I20251211 09:08:15.978866 3166 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:15.978962 3166 heartbeater.cc:507] Master 127.0.119.254:44311 requested a full tablet report, sending...
I20251211 09:08:15.979193 2885 ts_manager.cc:194] Registered new tserver with Master: 88376653732847148cec6d00f0fc1fe2 (127.0.119.195:45279)
I20251211 09:08:15.979418 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003320027s
I20251211 09:08:15.979590 2885 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36990
I20251211 09:08:15.979816 479 test_util.cc:276] Using random seed: 2083926311
I20251211 09:08:15.984110 2885 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37002:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:08:15.984247 2885 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:08:15.988704 3055 tablet_service.cc:1505] Processing CreateTablet for tablet 3302ad58980a44f0a573e2cd0db54062 (DEFAULT_TABLE table=test-workload [id=5c98ddf55f8c4b29ad817db2de971c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:15.988843 3055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3302ad58980a44f0a573e2cd0db54062. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:15.989007 2979 tablet_service.cc:1505] Processing CreateTablet for tablet 3302ad58980a44f0a573e2cd0db54062 (DEFAULT_TABLE table=test-workload [id=5c98ddf55f8c4b29ad817db2de971c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:15.989120 2979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3302ad58980a44f0a573e2cd0db54062. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:15.989127 3130 tablet_service.cc:1505] Processing CreateTablet for tablet 3302ad58980a44f0a573e2cd0db54062 (DEFAULT_TABLE table=test-workload [id=5c98ddf55f8c4b29ad817db2de971c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:15.989244 3130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3302ad58980a44f0a573e2cd0db54062. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:15.990389 3181 tablet_bootstrap.cc:492] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594: Bootstrap starting.
I20251211 09:08:15.990553 3183 tablet_bootstrap.cc:492] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2: Bootstrap starting.
I20251211 09:08:15.990667 3182 tablet_bootstrap.cc:492] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5: Bootstrap starting.
I20251211 09:08:15.990870 3181 tablet_bootstrap.cc:654] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:15.991156 3183 tablet_bootstrap.cc:654] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:15.991170 3182 tablet_bootstrap.cc:654] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:15.991672 3181 tablet_bootstrap.cc:492] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594: No bootstrap required, opened a new log
I20251211 09:08:15.991729 3181 ts_tablet_manager.cc:1403] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:15.991778 3183 tablet_bootstrap.cc:492] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2: No bootstrap required, opened a new log
I20251211 09:08:15.991811 3182 tablet_bootstrap.cc:492] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5: No bootstrap required, opened a new log
I20251211 09:08:15.991830 3183 ts_tablet_manager.cc:1403] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:15.991878 3182 ts_tablet_manager.cc:1403] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:15.991894 3181 raft_consensus.cc:359] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:15.992033 3181 raft_consensus.cc:385] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:15.992051 3183 raft_consensus.cc:359] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:15.992087 3181 raft_consensus.cc:740] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48ed4a6046b430493044310bc611594, State: Initialized, Role: FOLLOWER
I20251211 09:08:15.992129 3183 raft_consensus.cc:385] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:15.992115 3182 raft_consensus.cc:359] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:15.992184 3183 raft_consensus.cc:740] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88376653732847148cec6d00f0fc1fe2, State: Initialized, Role: FOLLOWER
I20251211 09:08:15.992193 3182 raft_consensus.cc:385] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:15.992233 3182 raft_consensus.cc:740] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b03715e4d54a50be387ea2f57d44c5, State: Initialized, Role: FOLLOWER
I20251211 09:08:15.992288 3182 consensus_queue.cc:260] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:15.992295 3183 consensus_queue.cc:260] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:15.992336 3181 consensus_queue.cc:260] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:15.992465 3182 ts_tablet_manager.cc:1434] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:15.992499 3183 ts_tablet_manager.cc:1434] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:08:15.992625 3166 heartbeater.cc:499] Master 127.0.119.254:44311 was elected leader, sending a full tablet report...
I20251211 09:08:15.992655 3015 heartbeater.cc:499] Master 127.0.119.254:44311 was elected leader, sending a full tablet report...
I20251211 09:08:15.992480 3181 ts_tablet_manager.cc:1434] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:15.992508 3091 heartbeater.cc:499] Master 127.0.119.254:44311 was elected leader, sending a full tablet report...
I20251211 09:08:16.087566 3188 raft_consensus.cc:493] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:08:16.087659 3188 raft_consensus.cc:515] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:16.087872 3188 leader_election.cc:290] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a48ed4a6046b430493044310bc611594 (127.0.119.193:42567), e8b03715e4d54a50be387ea2f57d44c5 (127.0.119.194:40535)
I20251211 09:08:16.091194 2989 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3302ad58980a44f0a573e2cd0db54062" candidate_uuid: "88376653732847148cec6d00f0fc1fe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48ed4a6046b430493044310bc611594" is_pre_election: true
I20251211 09:08:16.091284 2989 raft_consensus.cc:2468] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88376653732847148cec6d00f0fc1fe2 in term 0.
I20251211 09:08:16.091208 3065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3302ad58980a44f0a573e2cd0db54062" candidate_uuid: "88376653732847148cec6d00f0fc1fe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b03715e4d54a50be387ea2f57d44c5" is_pre_election: true
I20251211 09:08:16.091324 3065 raft_consensus.cc:2468] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88376653732847148cec6d00f0fc1fe2 in term 0.
I20251211 09:08:16.091462 3103 leader_election.cc:304] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88376653732847148cec6d00f0fc1fe2, a48ed4a6046b430493044310bc611594; no voters:
I20251211 09:08:16.091571 3188 raft_consensus.cc:2804] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:08:16.091619 3188 raft_consensus.cc:493] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:08:16.091640 3188 raft_consensus.cc:3060] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:16.092237 3188 raft_consensus.cc:515] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:16.092370 3188 leader_election.cc:290] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [CANDIDATE]: Term 1 election: Requested vote from peers a48ed4a6046b430493044310bc611594 (127.0.119.193:42567), e8b03715e4d54a50be387ea2f57d44c5 (127.0.119.194:40535)
I20251211 09:08:16.092514 3065 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3302ad58980a44f0a573e2cd0db54062" candidate_uuid: "88376653732847148cec6d00f0fc1fe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8b03715e4d54a50be387ea2f57d44c5"
I20251211 09:08:16.092514 2989 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3302ad58980a44f0a573e2cd0db54062" candidate_uuid: "88376653732847148cec6d00f0fc1fe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48ed4a6046b430493044310bc611594"
I20251211 09:08:16.092592 3065 raft_consensus.cc:3060] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:16.092602 2989 raft_consensus.cc:3060] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:16.093269 2989 raft_consensus.cc:2468] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88376653732847148cec6d00f0fc1fe2 in term 1.
I20251211 09:08:16.093269 3065 raft_consensus.cc:2468] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88376653732847148cec6d00f0fc1fe2 in term 1.
I20251211 09:08:16.093508 3104 leader_election.cc:304] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88376653732847148cec6d00f0fc1fe2, e8b03715e4d54a50be387ea2f57d44c5; no voters:
I20251211 09:08:16.093605 3188 raft_consensus.cc:2804] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:16.093731 3188 raft_consensus.cc:697] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 1 LEADER]: Becoming Leader. State: Replica: 88376653732847148cec6d00f0fc1fe2, State: Running, Role: LEADER
I20251211 09:08:16.093770 3188 consensus_queue.cc:237] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:16.094256 2885 catalog_manager.cc:5654] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88376653732847148cec6d00f0fc1fe2 (127.0.119.195). New cstate: current_term: 1 leader_uuid: "88376653732847148cec6d00f0fc1fe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } health_report { overall_health: UNKNOWN } } }
I20251211 09:08:16.108218 2989 raft_consensus.cc:1275] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 1 FOLLOWER]: Refusing update from remote peer 88376653732847148cec6d00f0fc1fe2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:16.108342 3065 raft_consensus.cc:1275] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 1 FOLLOWER]: Refusing update from remote peer 88376653732847148cec6d00f0fc1fe2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:16.108435 3191 consensus_queue.cc:1048] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:16.108525 3188 consensus_queue.cc:1048] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:16.109972 3198 mvcc.cc:204] Tried to move back new op lower bound from 7231259017658048512 to 7231259017600520192. Current Snapshot: MvccSnapshot[applied={T|T < 7231259017658048512}]
I20251211 09:08:26.566933 3216 raft_consensus.cc:993] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2: : Instructing follower a48ed4a6046b430493044310bc611594 to start an election
I20251211 09:08:26.567018 3216 raft_consensus.cc:1081] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 1 LEADER]: Signalling peer a48ed4a6046b430493044310bc611594 to start an election
I20251211 09:08:26.567230 2989 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3302ad58980a44f0a573e2cd0db54062"
dest_uuid: "a48ed4a6046b430493044310bc611594"
from {username='slave'} at 127.0.0.1:49658
I20251211 09:08:26.567319 2989 raft_consensus.cc:493] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:08:26.567341 2989 raft_consensus.cc:3060] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:26.568024 2989 raft_consensus.cc:515] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:26.568179 2989 leader_election.cc:290] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [CANDIDATE]: Term 2 election: Requested vote from peers 88376653732847148cec6d00f0fc1fe2 (127.0.119.195:45279), e8b03715e4d54a50be387ea2f57d44c5 (127.0.119.194:40535)
I20251211 09:08:26.571003 3140 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3302ad58980a44f0a573e2cd0db54062" candidate_uuid: "a48ed4a6046b430493044310bc611594" candidate_term: 2 candidate_status { last_received { term: 1 index: 14020 } } ignore_live_leader: true dest_uuid: "88376653732847148cec6d00f0fc1fe2"
I20251211 09:08:26.571045 3064 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3302ad58980a44f0a573e2cd0db54062" candidate_uuid: "a48ed4a6046b430493044310bc611594" candidate_term: 2 candidate_status { last_received { term: 1 index: 14020 } } ignore_live_leader: true dest_uuid: "e8b03715e4d54a50be387ea2f57d44c5"
I20251211 09:08:26.571076 3140 raft_consensus.cc:3055] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:08:26.571118 3064 raft_consensus.cc:3060] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:26.571146 3140 raft_consensus.cc:740] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88376653732847148cec6d00f0fc1fe2, State: Running, Role: LEADER
I20251211 09:08:26.571241 3140 consensus_queue.cc:260] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14020, Committed index: 14020, Last appended: 1.14020, Last appended by leader: 14020, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:26.571327 3140 raft_consensus.cc:3060] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:26.571828 3064 raft_consensus.cc:2468] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48ed4a6046b430493044310bc611594 in term 2.
I20251211 09:08:26.571959 3140 raft_consensus.cc:2468] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a48ed4a6046b430493044310bc611594 in term 2.
I20251211 09:08:26.572000 2953 leader_election.cc:304] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a48ed4a6046b430493044310bc611594, e8b03715e4d54a50be387ea2f57d44c5; no voters:
I20251211 09:08:26.572211 3245 raft_consensus.cc:2804] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:08:26.572332 3245 raft_consensus.cc:697] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 2 LEADER]: Becoming Leader. State: Replica: a48ed4a6046b430493044310bc611594, State: Running, Role: LEADER
I20251211 09:08:26.572407 3245 consensus_queue.cc:237] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14020, Committed index: 14020, Last appended: 1.14020, Last appended by leader: 14020, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } }
I20251211 09:08:26.572870 2882 catalog_manager.cc:5654] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 reported cstate change: term changed from 1 to 2, leader changed from 88376653732847148cec6d00f0fc1fe2 (127.0.119.195) to a48ed4a6046b430493044310bc611594 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "a48ed4a6046b430493044310bc611594" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a48ed4a6046b430493044310bc611594" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 42567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 } health_report { overall_health: UNKNOWN } } }
I20251211 09:08:26.579959 3140 raft_consensus.cc:1275] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 2 FOLLOWER]: Refusing update from remote peer a48ed4a6046b430493044310bc611594: Log matching property violated. Preceding OpId in replica: term: 1 index: 14020. Preceding OpId from leader: term: 2 index: 14022. (index mismatch)
I20251211 09:08:26.579970 3064 raft_consensus.cc:1275] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 2 FOLLOWER]: Refusing update from remote peer a48ed4a6046b430493044310bc611594: Log matching property violated. Preceding OpId in replica: term: 1 index: 14020. Preceding OpId from leader: term: 2 index: 14022. (index mismatch)
I20251211 09:08:26.580164 3245 consensus_queue.cc:1048] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88376653732847148cec6d00f0fc1fe2" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14021, Last known committed idx: 14020, Time since last communication: 0.000s
I20251211 09:08:26.580257 3246 consensus_queue.cc:1048] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8b03715e4d54a50be387ea2f57d44c5" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14021, Last known committed idx: 14020, Time since last communication: 0.000s
W20251211 09:08:26.581674 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Transaction 0 already open
W20251211 09:08:26.582010 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Cannot finalize transaction in state: OPEN
W20251211 09:08:26.583207 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Transaction 0 commit already in progress
W20251211 09:08:26.583528 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:08:26.584652 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Transaction 0 commit already in progress
W20251211 09:08:26.584900 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Transaction metadata for transaction 0 already set
W20251211 09:08:26.585129 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:08:26.585382 3200 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59798: Illegal state: Transaction metadata for transaction 0 already exists
I20251211 09:08:26.585544 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:08:26.588002 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:26.588101 479 tablet_replica.cc:333] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594: stopping tablet replica
I20251211 09:08:26.588138 479 raft_consensus.cc:2243] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:08:26.588181 479 raft_consensus.cc:2272] T 3302ad58980a44f0a573e2cd0db54062 P a48ed4a6046b430493044310bc611594 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:26.603529 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:08:26.604408 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:08:26.607313 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:26.607415 479 tablet_replica.cc:333] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5: stopping tablet replica
I20251211 09:08:26.607465 479 raft_consensus.cc:2243] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:26.607512 479 raft_consensus.cc:2272] T 3302ad58980a44f0a573e2cd0db54062 P e8b03715e4d54a50be387ea2f57d44c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:26.620721 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:08:26.621551 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:08:26.624155 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:26.624286 479 tablet_replica.cc:333] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2: stopping tablet replica
I20251211 09:08:26.624353 479 raft_consensus.cc:2243] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:26.624392 479 raft_consensus.cc:2272] T 3302ad58980a44f0a573e2cd0db54062 P 88376653732847148cec6d00f0fc1fe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:26.647166 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:08:26.648006 479 master.cc:561] Master@127.0.119.254:44311 shutting down...
I20251211 09:08:26.650295 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:08:26.650365 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:26.650385 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 63797c31f01b4b9bb33102b31c94309a: stopping tablet replica
I20251211 09:08:26.662082 479 master.cc:583] Master@127.0.119.254:44311 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyIllegalStatesInCommitSequence (10832 ms)
[ RUN ] TxnParticipantITest.TestProxyIllegalStatesInAbortSequence
I20251211 09:08:26.681020 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:33425
I20251211 09:08:26.681190 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:26.682379 3254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:26.682416 3255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:26.682535 479 server_base.cc:1047] running on GCE node
W20251211 09:08:26.682420 3257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:26.682703 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:26.682750 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:26.682768 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444106682769 us; error 0 us; skew 500 ppm
I20251211 09:08:26.683295 479 webserver.cc:492] Webserver started at http://127.0.119.254:46349/ using document root <none> and password file <none>
I20251211 09:08:26.683362 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:26.683408 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:26.683444 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:26.683698 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "58c4c9555a4747a9ae0e7108efc4976e"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.684504 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:26.684893 3262 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.685019 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.685060 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "58c4c9555a4747a9ae0e7108efc4976e"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.685109 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:26.692672 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:26.692842 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:26.695173 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:33425
I20251211 09:08:26.702360 3314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:33425 every 8 connection(s)
I20251211 09:08:26.702503 3315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:26.703475 3315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e: Bootstrap starting.
I20251211 09:08:26.703755 3315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:26.704216 3315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e: No bootstrap required, opened a new log
I20251211 09:08:26.704336 3315 raft_consensus.cc:359] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58c4c9555a4747a9ae0e7108efc4976e" member_type: VOTER }
I20251211 09:08:26.704382 3315 raft_consensus.cc:385] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:26.704406 3315 raft_consensus.cc:740] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58c4c9555a4747a9ae0e7108efc4976e, State: Initialized, Role: FOLLOWER
I20251211 09:08:26.704461 3315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58c4c9555a4747a9ae0e7108efc4976e" member_type: VOTER }
I20251211 09:08:26.704504 3315 raft_consensus.cc:399] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:08:26.704532 3315 raft_consensus.cc:493] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:08:26.704558 3315 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:26.705009 3315 raft_consensus.cc:515] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58c4c9555a4747a9ae0e7108efc4976e" member_type: VOTER }
I20251211 09:08:26.705065 3315 leader_election.cc:304] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58c4c9555a4747a9ae0e7108efc4976e; no voters:
I20251211 09:08:26.705165 3315 leader_election.cc:290] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:08:26.705214 3318 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:26.705320 3315 sys_catalog.cc:565] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:08:26.705404 3318 raft_consensus.cc:697] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 1 LEADER]: Becoming Leader. State: Replica: 58c4c9555a4747a9ae0e7108efc4976e, State: Running, Role: LEADER
I20251211 09:08:26.705466 3318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58c4c9555a4747a9ae0e7108efc4976e" member_type: VOTER }
I20251211 09:08:26.705668 3319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58c4c9555a4747a9ae0e7108efc4976e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58c4c9555a4747a9ae0e7108efc4976e" member_type: VOTER } }
I20251211 09:08:26.705726 3319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:26.705704 3320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58c4c9555a4747a9ae0e7108efc4976e. Latest consensus state: current_term: 1 leader_uuid: "58c4c9555a4747a9ae0e7108efc4976e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58c4c9555a4747a9ae0e7108efc4976e" member_type: VOTER } }
I20251211 09:08:26.705955 3320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:26.705987 3323 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:08:26.706167 3323 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:08:26.706699 3323 catalog_manager.cc:1357] Generated new cluster ID: fc3f8f7a3f534c418f19d30468d2acd7
I20251211 09:08:26.706696 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:08:26.706764 3323 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:08:26.715260 3323 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:08:26.715654 3323 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:08:26.719415 3323 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e: Generated new TSK 0
I20251211 09:08:26.719503 3323 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:08:26.725814 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:26.727011 3336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:26.727129 3339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:26.727185 3337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:26.727751 479 server_base.cc:1047] running on GCE node
I20251211 09:08:26.727828 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:26.727864 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:26.727888 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444106727888 us; error 0 us; skew 500 ppm
I20251211 09:08:26.728392 479 webserver.cc:492] Webserver started at http://127.0.119.193:37903/ using document root <none> and password file <none>
I20251211 09:08:26.728473 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:26.728516 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:26.728569 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:26.728813 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "b78910dca59d44a48149f4d9dff56ae7"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.729696 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:26.730139 3344 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.730255 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.730296 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "b78910dca59d44a48149f4d9dff56ae7"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.730341 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:26.735687 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:26.735832 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:26.735971 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:26.736135 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:26.736159 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.736191 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:26.736217 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.738878 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:43041
I20251211 09:08:26.738932 3407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:43041 every 8 connection(s)
I20251211 09:08:26.739224 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:26.740224 3413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:26.740247 3412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:26.741604 3415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:26.741681 479 server_base.cc:1047] running on GCE node
I20251211 09:08:26.741833 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:26.741871 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:26.741887 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444106741888 us; error 0 us; skew 500 ppm
I20251211 09:08:26.742453 479 webserver.cc:492] Webserver started at http://127.0.119.194:44019/ using document root <none> and password file <none>
I20251211 09:08:26.742465 3408 heartbeater.cc:344] Connected to a master server at 127.0.119.254:33425
I20251211 09:08:26.742538 3408 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:26.742548 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:26.742594 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:26.742638 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:26.742655 3408 heartbeater.cc:507] Master 127.0.119.254:33425 requested a full tablet report, sending...
I20251211 09:08:26.742882 3279 ts_manager.cc:194] Registered new tserver with Master: b78910dca59d44a48149f4d9dff56ae7 (127.0.119.193:43041)
I20251211 09:08:26.743018 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "0f78139935d14170900d9a8e280474bd"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.743754 3279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55226
I20251211 09:08:26.744095 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:26.744544 3420 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.744663 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.744729 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "0f78139935d14170900d9a8e280474bd"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.744796 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:26.748871 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:26.749048 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:26.749182 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:26.749374 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:26.749401 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.749433 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:26.749464 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.752069 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:34895
I20251211 09:08:26.752125 3483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:34895 every 8 connection(s)
I20251211 09:08:26.752408 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:26.753453 3487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:26.753533 3490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:26.753974 479 server_base.cc:1047] running on GCE node
W20251211 09:08:26.753978 3488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:26.754215 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:26.754247 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:26.754259 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444106754260 us; error 0 us; skew 500 ppm
I20251211 09:08:26.754848 479 webserver.cc:492] Webserver started at http://127.0.119.195:40783/ using document root <none> and password file <none>
I20251211 09:08:26.754932 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:26.754978 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:26.755026 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:26.755314 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "f4f33d23fb464dd49effbd9145e76ca1"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.755417 3484 heartbeater.cc:344] Connected to a master server at 127.0.119.254:33425
I20251211 09:08:26.755482 3484 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:26.755587 3484 heartbeater.cc:507] Master 127.0.119.254:33425 requested a full tablet report, sending...
I20251211 09:08:26.755810 3279 ts_manager.cc:194] Registered new tserver with Master: 0f78139935d14170900d9a8e280474bd (127.0.119.194:34895)
I20251211 09:08:26.756274 3279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55232
I20251211 09:08:26.756345 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:26.756841 3495 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.756985 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.757030 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "f4f33d23fb464dd49effbd9145e76ca1"
format_stamp: "Formatted at 2025-12-11 09:08:26 on dist-test-slave-hb70"
I20251211 09:08:26.757076 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:26.769532 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:26.769757 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:26.769914 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:26.770110 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:26.770138 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.770174 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:26.770207 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.773676 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:40709
I20251211 09:08:26.773748 3558 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:40709 every 8 connection(s)
I20251211 09:08:26.776795 3559 heartbeater.cc:344] Connected to a master server at 127.0.119.254:33425
I20251211 09:08:26.776850 3559 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:26.776942 3559 heartbeater.cc:507] Master 127.0.119.254:33425 requested a full tablet report, sending...
I20251211 09:08:26.777161 3279 ts_manager.cc:194] Registered new tserver with Master: f4f33d23fb464dd49effbd9145e76ca1 (127.0.119.195:40709)
I20251211 09:08:26.777204 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00333044s
I20251211 09:08:26.777549 479 test_util.cc:276] Using random seed: 2094724044
I20251211 09:08:26.777554 3279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55244
I20251211 09:08:26.781945 3279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55252:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:08:26.782068 3279 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:08:26.787618 3372 tablet_service.cc:1505] Processing CreateTablet for tablet 2b2f35f91d6d4af797166350ce202935 (DEFAULT_TABLE table=test-workload [id=b37facc4ddae49248d541e851cd8492e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:26.787791 3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2f35f91d6d4af797166350ce202935. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:26.788017 3448 tablet_service.cc:1505] Processing CreateTablet for tablet 2b2f35f91d6d4af797166350ce202935 (DEFAULT_TABLE table=test-workload [id=b37facc4ddae49248d541e851cd8492e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:26.788096 3448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2f35f91d6d4af797166350ce202935. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:26.788733 3523 tablet_service.cc:1505] Processing CreateTablet for tablet 2b2f35f91d6d4af797166350ce202935 (DEFAULT_TABLE table=test-workload [id=b37facc4ddae49248d541e851cd8492e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:26.788820 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b2f35f91d6d4af797166350ce202935. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:26.789597 3574 tablet_bootstrap.cc:492] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7: Bootstrap starting.
I20251211 09:08:26.790063 3576 tablet_bootstrap.cc:492] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1: Bootstrap starting.
I20251211 09:08:26.790091 3574 tablet_bootstrap.cc:654] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:26.790421 3575 tablet_bootstrap.cc:492] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd: Bootstrap starting.
I20251211 09:08:26.790424 3576 tablet_bootstrap.cc:654] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:26.790742 3574 tablet_bootstrap.cc:492] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7: No bootstrap required, opened a new log
I20251211 09:08:26.790814 3575 tablet_bootstrap.cc:654] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:26.790822 3574 ts_tablet_manager.cc:1403] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:26.791059 3576 tablet_bootstrap.cc:492] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1: No bootstrap required, opened a new log
I20251211 09:08:26.791015 3574 raft_consensus.cc:359] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.791147 3576 ts_tablet_manager.cc:1403] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:26.791172 3574 raft_consensus.cc:385] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:26.791213 3574 raft_consensus.cc:740] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b78910dca59d44a48149f4d9dff56ae7, State: Initialized, Role: FOLLOWER
I20251211 09:08:26.791277 3576 raft_consensus.cc:359] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.791335 3576 raft_consensus.cc:385] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:26.791288 3574 consensus_queue.cc:260] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.791352 3575 tablet_bootstrap.cc:492] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd: No bootstrap required, opened a new log
I20251211 09:08:26.791359 3576 raft_consensus.cc:740] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f33d23fb464dd49effbd9145e76ca1, State: Initialized, Role: FOLLOWER
I20251211 09:08:26.791399 3575 ts_tablet_manager.cc:1403] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:26.791447 3576 consensus_queue.cc:260] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.791489 3574 ts_tablet_manager.cc:1434] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:08:26.791560 3408 heartbeater.cc:499] Master 127.0.119.254:33425 was elected leader, sending a full tablet report...
I20251211 09:08:26.791606 3576 ts_tablet_manager.cc:1434] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:26.791546 3575 raft_consensus.cc:359] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.791685 3559 heartbeater.cc:499] Master 127.0.119.254:33425 was elected leader, sending a full tablet report...
I20251211 09:08:26.791781 3575 raft_consensus.cc:385] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:26.791821 3575 raft_consensus.cc:740] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f78139935d14170900d9a8e280474bd, State: Initialized, Role: FOLLOWER
I20251211 09:08:26.791882 3575 consensus_queue.cc:260] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.792151 3575 ts_tablet_manager.cc:1434] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:26.792160 3484 heartbeater.cc:499] Master 127.0.119.254:33425 was elected leader, sending a full tablet report...
I20251211 09:08:26.806403 3580 raft_consensus.cc:493] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:08:26.806506 3580 raft_consensus.cc:515] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.806679 3580 leader_election.cc:290] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f78139935d14170900d9a8e280474bd (127.0.119.194:34895), f4f33d23fb464dd49effbd9145e76ca1 (127.0.119.195:40709)
I20251211 09:08:26.809038 3458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b2f35f91d6d4af797166350ce202935" candidate_uuid: "b78910dca59d44a48149f4d9dff56ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f78139935d14170900d9a8e280474bd" is_pre_election: true
I20251211 09:08:26.809137 3458 raft_consensus.cc:2468] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b78910dca59d44a48149f4d9dff56ae7 in term 0.
I20251211 09:08:26.809228 3533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b2f35f91d6d4af797166350ce202935" candidate_uuid: "b78910dca59d44a48149f4d9dff56ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f33d23fb464dd49effbd9145e76ca1" is_pre_election: true
I20251211 09:08:26.809295 3348 leader_election.cc:304] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f78139935d14170900d9a8e280474bd, b78910dca59d44a48149f4d9dff56ae7; no voters:
I20251211 09:08:26.809326 3533 raft_consensus.cc:2468] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b78910dca59d44a48149f4d9dff56ae7 in term 0.
I20251211 09:08:26.809372 3580 raft_consensus.cc:2804] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:08:26.809406 3580 raft_consensus.cc:493] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:08:26.809427 3580 raft_consensus.cc:3060] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:26.810030 3580 raft_consensus.cc:515] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.810127 3580 leader_election.cc:290] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [CANDIDATE]: Term 1 election: Requested vote from peers 0f78139935d14170900d9a8e280474bd (127.0.119.194:34895), f4f33d23fb464dd49effbd9145e76ca1 (127.0.119.195:40709)
I20251211 09:08:26.810268 3533 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b2f35f91d6d4af797166350ce202935" candidate_uuid: "b78910dca59d44a48149f4d9dff56ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4f33d23fb464dd49effbd9145e76ca1"
I20251211 09:08:26.810293 3458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b2f35f91d6d4af797166350ce202935" candidate_uuid: "b78910dca59d44a48149f4d9dff56ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f78139935d14170900d9a8e280474bd"
I20251211 09:08:26.810324 3533 raft_consensus.cc:3060] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:26.810340 3458 raft_consensus.cc:3060] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:26.810921 3458 raft_consensus.cc:2468] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b78910dca59d44a48149f4d9dff56ae7 in term 1.
I20251211 09:08:26.810979 3533 raft_consensus.cc:2468] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b78910dca59d44a48149f4d9dff56ae7 in term 1.
I20251211 09:08:26.811100 3348 leader_election.cc:304] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f78139935d14170900d9a8e280474bd, b78910dca59d44a48149f4d9dff56ae7; no voters:
I20251211 09:08:26.811179 3580 raft_consensus.cc:2804] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:26.811321 3580 raft_consensus.cc:697] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 1 LEADER]: Becoming Leader. State: Replica: b78910dca59d44a48149f4d9dff56ae7, State: Running, Role: LEADER
I20251211 09:08:26.811371 3580 consensus_queue.cc:237] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } }
I20251211 09:08:26.811915 3279 catalog_manager.cc:5654] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b78910dca59d44a48149f4d9dff56ae7 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "b78910dca59d44a48149f4d9dff56ae7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b78910dca59d44a48149f4d9dff56ae7" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 } health_report { overall_health: UNKNOWN } } }
I20251211 09:08:26.826170 3533 raft_consensus.cc:1275] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 1 FOLLOWER]: Refusing update from remote peer b78910dca59d44a48149f4d9dff56ae7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:26.826237 3458 raft_consensus.cc:1275] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 1 FOLLOWER]: Refusing update from remote peer b78910dca59d44a48149f4d9dff56ae7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:26.826377 3584 consensus_queue.cc:1048] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4f33d23fb464dd49effbd9145e76ca1" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 40709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:26.826465 3580 consensus_queue.cc:1048] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f78139935d14170900d9a8e280474bd" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 09:08:36.831619 3591 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43170: Illegal state: Transaction 0 already open
W20251211 09:08:36.831981 3591 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43170: Illegal state: Cannot finalize transaction in state: OPEN
W20251211 09:08:36.833189 3591 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43170: Illegal state: Transaction metadata for transaction 0 already set
W20251211 09:08:36.833546 3591 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43170: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:08:36.833820 3591 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43170: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:08:36.834090 3591 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43170: Illegal state: Cannot begin committing transaction in state: INITIALIZING
I20251211 09:08:36.834264 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:08:36.836647 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:36.836758 479 tablet_replica.cc:333] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7: stopping tablet replica
I20251211 09:08:36.836825 479 raft_consensus.cc:2243] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:08:36.836881 479 raft_consensus.cc:2272] T 2b2f35f91d6d4af797166350ce202935 P b78910dca59d44a48149f4d9dff56ae7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:36.853639 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:08:36.854399 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:08:36.857800 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:36.857923 479 tablet_replica.cc:333] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd: stopping tablet replica
I20251211 09:08:36.857980 479 raft_consensus.cc:2243] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:36.858023 479 raft_consensus.cc:2272] T 2b2f35f91d6d4af797166350ce202935 P 0f78139935d14170900d9a8e280474bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:36.861105 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:08:36.861835 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:08:36.864044 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:36.864138 479 tablet_replica.cc:333] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1: stopping tablet replica
I20251211 09:08:36.864193 479 raft_consensus.cc:2243] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:36.864230 479 raft_consensus.cc:2272] T 2b2f35f91d6d4af797166350ce202935 P f4f33d23fb464dd49effbd9145e76ca1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:36.876677 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:08:36.877514 479 master.cc:561] Master@127.0.119.254:33425 shutting down...
I20251211 09:08:36.879557 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:08:36.879613 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:36.879631 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 58c4c9555a4747a9ae0e7108efc4976e: stopping tablet replica
I20251211 09:08:36.891158 479 master.cc:583] Master@127.0.119.254:33425 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyIllegalStatesInAbortSequence (10229 ms)
[ RUN ] TxnParticipantITest.TestProxyNonLeader
I20251211 09:08:36.910233 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:38581
I20251211 09:08:36.910415 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:08:36.911945 479 server_base.cc:1047] running on GCE node
W20251211 09:08:36.912326 3633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:36.912330 3631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:36.912403 3630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:36.912606 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:36.912637 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:36.912659 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444116912658 us; error 0 us; skew 500 ppm
I20251211 09:08:36.913213 479 webserver.cc:492] Webserver started at http://127.0.119.254:43213/ using document root <none> and password file <none>
I20251211 09:08:36.913316 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:36.913362 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:36.913419 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:36.913697 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "6415823ecd514d8e9a0f55c6301f852b"
format_stamp: "Formatted at 2025-12-11 09:08:36 on dist-test-slave-hb70"
I20251211 09:08:36.914543 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:36.914992 3638 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.915140 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.915182 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "6415823ecd514d8e9a0f55c6301f852b"
format_stamp: "Formatted at 2025-12-11 09:08:36 on dist-test-slave-hb70"
I20251211 09:08:36.915228 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:36.925738 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:36.925913 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:36.928287 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:38581
I20251211 09:08:36.933692 3690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:38581 every 8 connection(s)
I20251211 09:08:36.933844 3691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:36.934875 3691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b: Bootstrap starting.
I20251211 09:08:36.935148 3691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:36.935572 3691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b: No bootstrap required, opened a new log
I20251211 09:08:36.935696 3691 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6415823ecd514d8e9a0f55c6301f852b" member_type: VOTER }
I20251211 09:08:36.935745 3691 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:36.935770 3691 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6415823ecd514d8e9a0f55c6301f852b, State: Initialized, Role: FOLLOWER
I20251211 09:08:36.935827 3691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6415823ecd514d8e9a0f55c6301f852b" member_type: VOTER }
I20251211 09:08:36.935858 3691 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:08:36.935879 3691 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:08:36.935910 3691 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:36.936350 3691 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6415823ecd514d8e9a0f55c6301f852b" member_type: VOTER }
I20251211 09:08:36.936406 3691 leader_election.cc:304] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6415823ecd514d8e9a0f55c6301f852b; no voters:
I20251211 09:08:36.936504 3691 leader_election.cc:290] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:08:36.936549 3694 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:36.936642 3691 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:08:36.936679 3694 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 1 LEADER]: Becoming Leader. State: Replica: 6415823ecd514d8e9a0f55c6301f852b, State: Running, Role: LEADER
I20251211 09:08:36.936734 3694 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6415823ecd514d8e9a0f55c6301f852b" member_type: VOTER }
I20251211 09:08:36.936904 3695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6415823ecd514d8e9a0f55c6301f852b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6415823ecd514d8e9a0f55c6301f852b" member_type: VOTER } }
I20251211 09:08:36.936956 3695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:36.937075 3696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6415823ecd514d8e9a0f55c6301f852b. Latest consensus state: current_term: 1 leader_uuid: "6415823ecd514d8e9a0f55c6301f852b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6415823ecd514d8e9a0f55c6301f852b" member_type: VOTER } }
I20251211 09:08:36.937152 3696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:36.937110 3699 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:08:36.937376 3699 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:08:36.937920 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:08:36.937968 3699 catalog_manager.cc:1357] Generated new cluster ID: f68031531c274569ad6f91491de8d0fb
I20251211 09:08:36.938014 3699 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:08:36.962047 3699 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:08:36.962488 3699 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:08:36.967437 3699 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b: Generated new TSK 0
I20251211 09:08:36.967512 3699 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:08:36.969759 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:36.971189 3713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:36.971302 3712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:36.971284 479 server_base.cc:1047] running on GCE node
W20251211 09:08:36.971212 3715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:36.971536 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:36.971575 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:36.971588 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444116971588 us; error 0 us; skew 500 ppm
I20251211 09:08:36.972146 479 webserver.cc:492] Webserver started at http://127.0.119.193:44081/ using document root <none> and password file <none>
I20251211 09:08:36.972224 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:36.972270 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:36.972318 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:36.972581 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "0e1c720782114890abcee9555d939b64"
format_stamp: "Formatted at 2025-12-11 09:08:36 on dist-test-slave-hb70"
I20251211 09:08:36.973434 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:36.973892 3720 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.974012 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.974056 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "0e1c720782114890abcee9555d939b64"
format_stamp: "Formatted at 2025-12-11 09:08:36 on dist-test-slave-hb70"
I20251211 09:08:36.974097 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:36.981762 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:36.981917 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:36.982036 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:36.982194 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:36.982218 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.982249 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:36.982275 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.984900 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:36987
I20251211 09:08:36.984958 3783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:36987 every 8 connection(s)
I20251211 09:08:36.985291 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:36.986331 3788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:36.986635 479 server_base.cc:1047] running on GCE node
W20251211 09:08:36.987310 3791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:36.987413 3789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:36.987567 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:36.987601 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:36.987623 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444116987624 us; error 0 us; skew 500 ppm
I20251211 09:08:36.988221 479 webserver.cc:492] Webserver started at http://127.0.119.194:40027/ using document root <none> and password file <none>
I20251211 09:08:36.988310 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:36.988358 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:36.988409 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:36.988562 3784 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38581
I20251211 09:08:36.988617 3784 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:36.988708 3784 heartbeater.cc:507] Master 127.0.119.254:38581 requested a full tablet report, sending...
I20251211 09:08:36.988763 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "79a055e4a5d04571abd8e4f79a83d320"
format_stamp: "Formatted at 2025-12-11 09:08:36 on dist-test-slave-hb70"
I20251211 09:08:36.988917 3655 ts_manager.cc:194] Registered new tserver with Master: 0e1c720782114890abcee9555d939b64 (127.0.119.193:36987)
I20251211 09:08:36.989464 3655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38440
I20251211 09:08:36.989708 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:36.990171 3796 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.990315 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:36.990357 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "79a055e4a5d04571abd8e4f79a83d320"
format_stamp: "Formatted at 2025-12-11 09:08:36 on dist-test-slave-hb70"
I20251211 09:08:36.990409 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:36.999584 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:36.999744 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:36.999874 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:37.000042 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:37.000067 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:37.000099 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:37.000125 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:37.002784 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:36237
I20251211 09:08:37.002832 3859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:36237 every 8 connection(s)
I20251211 09:08:37.003129 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:37.004187 3864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:37.004189 3863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:37.004328 3866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:37.004549 479 server_base.cc:1047] running on GCE node
I20251211 09:08:37.004668 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:37.004707 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:37.004730 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444117004730 us; error 0 us; skew 500 ppm
I20251211 09:08:37.005379 479 webserver.cc:492] Webserver started at http://127.0.119.195:36753/ using document root <none> and password file <none>
I20251211 09:08:37.005477 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:37.005525 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:37.005566 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:37.005805 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "c7fe1aa9935e498ab2fce51432af1336"
format_stamp: "Formatted at 2025-12-11 09:08:37 on dist-test-slave-hb70"
I20251211 09:08:37.006367 3860 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38581
I20251211 09:08:37.006426 3860 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:37.006527 3860 heartbeater.cc:507] Master 127.0.119.254:38581 requested a full tablet report, sending...
I20251211 09:08:37.006717 3655 ts_manager.cc:194] Registered new tserver with Master: 79a055e4a5d04571abd8e4f79a83d320 (127.0.119.194:36237)
I20251211 09:08:37.006843 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:37.007144 3655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38454
I20251211 09:08:37.007418 3871 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:37.007532 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:37.007588 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "c7fe1aa9935e498ab2fce51432af1336"
format_stamp: "Formatted at 2025-12-11 09:08:37 on dist-test-slave-hb70"
I20251211 09:08:37.007639 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:37.013718 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:37.013891 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:37.014014 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:37.014189 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:37.014214 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:37.014259 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:37.014286 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:37.017482 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:39357
I20251211 09:08:37.017539 3934 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:39357 every 8 connection(s)
I20251211 09:08:37.020252 3935 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38581
I20251211 09:08:37.020303 3935 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:37.020390 3935 heartbeater.cc:507] Master 127.0.119.254:38581 requested a full tablet report, sending...
I20251211 09:08:37.020608 3655 ts_manager.cc:194] Registered new tserver with Master: c7fe1aa9935e498ab2fce51432af1336 (127.0.119.195:39357)
I20251211 09:08:37.020923 3655 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38466
I20251211 09:08:37.020963 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003294911s
I20251211 09:08:37.021312 479 test_util.cc:276] Using random seed: 2104967807
I20251211 09:08:37.025453 3655 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38482:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:08:37.025579 3655 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:08:37.030062 3824 tablet_service.cc:1505] Processing CreateTablet for tablet 88d65380ac1e4731ba0b4bbd064b41cf (DEFAULT_TABLE table=test-workload [id=d9eea156cd114d3faa70d9a83a46d203]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:37.030216 3824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d65380ac1e4731ba0b4bbd064b41cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:37.030303 3748 tablet_service.cc:1505] Processing CreateTablet for tablet 88d65380ac1e4731ba0b4bbd064b41cf (DEFAULT_TABLE table=test-workload [id=d9eea156cd114d3faa70d9a83a46d203]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:37.030395 3899 tablet_service.cc:1505] Processing CreateTablet for tablet 88d65380ac1e4731ba0b4bbd064b41cf (DEFAULT_TABLE table=test-workload [id=d9eea156cd114d3faa70d9a83a46d203]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:37.030412 3748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d65380ac1e4731ba0b4bbd064b41cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:37.030476 3899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d65380ac1e4731ba0b4bbd064b41cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:37.031342 3950 tablet_bootstrap.cc:492] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320: Bootstrap starting.
I20251211 09:08:37.031764 3950 tablet_bootstrap.cc:654] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:37.031823 3952 tablet_bootstrap.cc:492] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: Bootstrap starting.
I20251211 09:08:37.032253 3952 tablet_bootstrap.cc:654] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:37.032375 3950 tablet_bootstrap.cc:492] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320: No bootstrap required, opened a new log
I20251211 09:08:37.032426 3950 ts_tablet_manager.cc:1403] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:37.032608 3951 tablet_bootstrap.cc:492] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336: Bootstrap starting.
I20251211 09:08:37.032593 3950 raft_consensus.cc:359] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.032656 3950 raft_consensus.cc:385] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:37.032678 3950 raft_consensus.cc:740] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79a055e4a5d04571abd8e4f79a83d320, State: Initialized, Role: FOLLOWER
I20251211 09:08:37.032800 3952 tablet_bootstrap.cc:492] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: No bootstrap required, opened a new log
I20251211 09:08:37.032781 3950 consensus_queue.cc:260] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.032861 3952 ts_tablet_manager.cc:1403] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:37.032974 3950 ts_tablet_manager.cc:1434] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:37.033072 3951 tablet_bootstrap.cc:654] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:37.033000 3860 heartbeater.cc:499] Master 127.0.119.254:38581 was elected leader, sending a full tablet report...
I20251211 09:08:37.033046 3952 raft_consensus.cc:359] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.033195 3952 raft_consensus.cc:385] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:37.033215 3952 raft_consensus.cc:740] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1c720782114890abcee9555d939b64, State: Initialized, Role: FOLLOWER
I20251211 09:08:37.033304 3952 consensus_queue.cc:260] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.033468 3952 ts_tablet_manager.cc:1434] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:08:37.033506 3784 heartbeater.cc:499] Master 127.0.119.254:38581 was elected leader, sending a full tablet report...
I20251211 09:08:37.033798 3951 tablet_bootstrap.cc:492] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336: No bootstrap required, opened a new log
I20251211 09:08:37.033842 3951 ts_tablet_manager.cc:1403] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:37.033967 3951 raft_consensus.cc:359] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.034011 3951 raft_consensus.cc:385] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:37.034035 3951 raft_consensus.cc:740] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7fe1aa9935e498ab2fce51432af1336, State: Initialized, Role: FOLLOWER
I20251211 09:08:37.034086 3951 consensus_queue.cc:260] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.034250 3951 ts_tablet_manager.cc:1434] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251211 09:08:37.034279 3935 heartbeater.cc:499] Master 127.0.119.254:38581 was elected leader, sending a full tablet report...
I20251211 09:08:37.071131 3955 raft_consensus.cc:493] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:08:37.071226 3955 raft_consensus.cc:515] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.071391 3955 leader_election.cc:290] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7fe1aa9935e498ab2fce51432af1336 (127.0.119.195:39357), 0e1c720782114890abcee9555d939b64 (127.0.119.193:36987)
I20251211 09:08:37.073925 3909 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88d65380ac1e4731ba0b4bbd064b41cf" candidate_uuid: "79a055e4a5d04571abd8e4f79a83d320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7fe1aa9935e498ab2fce51432af1336" is_pre_election: true
I20251211 09:08:37.074009 3909 raft_consensus.cc:2468] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79a055e4a5d04571abd8e4f79a83d320 in term 0.
I20251211 09:08:37.074023 3758 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88d65380ac1e4731ba0b4bbd064b41cf" candidate_uuid: "79a055e4a5d04571abd8e4f79a83d320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1c720782114890abcee9555d939b64" is_pre_election: true
I20251211 09:08:37.074113 3758 raft_consensus.cc:2468] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79a055e4a5d04571abd8e4f79a83d320 in term 0.
I20251211 09:08:37.074160 3799 leader_election.cc:304] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79a055e4a5d04571abd8e4f79a83d320, c7fe1aa9935e498ab2fce51432af1336; no voters:
I20251211 09:08:37.074258 3955 raft_consensus.cc:2804] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:08:37.074311 3955 raft_consensus.cc:493] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:08:37.074332 3955 raft_consensus.cc:3060] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:37.074985 3955 raft_consensus.cc:515] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.075099 3955 leader_election.cc:290] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [CANDIDATE]: Term 1 election: Requested vote from peers c7fe1aa9935e498ab2fce51432af1336 (127.0.119.195:39357), 0e1c720782114890abcee9555d939b64 (127.0.119.193:36987)
I20251211 09:08:37.075210 3909 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88d65380ac1e4731ba0b4bbd064b41cf" candidate_uuid: "79a055e4a5d04571abd8e4f79a83d320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7fe1aa9935e498ab2fce51432af1336"
I20251211 09:08:37.075273 3909 raft_consensus.cc:3060] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:37.075812 3909 raft_consensus.cc:2468] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79a055e4a5d04571abd8e4f79a83d320 in term 1.
I20251211 09:08:37.075901 3758 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88d65380ac1e4731ba0b4bbd064b41cf" candidate_uuid: "79a055e4a5d04571abd8e4f79a83d320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e1c720782114890abcee9555d939b64"
I20251211 09:08:37.075951 3799 leader_election.cc:304] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79a055e4a5d04571abd8e4f79a83d320, c7fe1aa9935e498ab2fce51432af1336; no voters:
I20251211 09:08:37.075958 3758 raft_consensus.cc:3060] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:37.076081 3955 raft_consensus.cc:2804] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:37.076234 3955 raft_consensus.cc:697] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 1 LEADER]: Becoming Leader. State: Replica: 79a055e4a5d04571abd8e4f79a83d320, State: Running, Role: LEADER
I20251211 09:08:37.076283 3955 consensus_queue.cc:237] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:37.076728 3758 raft_consensus.cc:2468] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79a055e4a5d04571abd8e4f79a83d320 in term 1.
I20251211 09:08:37.076781 3653 catalog_manager.cc:5654] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79a055e4a5d04571abd8e4f79a83d320 (127.0.119.194). New cstate: current_term: 1 leader_uuid: "79a055e4a5d04571abd8e4f79a83d320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } health_report { overall_health: HEALTHY } } }
I20251211 09:08:37.090308 3758 raft_consensus.cc:1275] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 1 FOLLOWER]: Refusing update from remote peer 79a055e4a5d04571abd8e4f79a83d320: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:37.090310 3909 raft_consensus.cc:1275] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 1 FOLLOWER]: Refusing update from remote peer 79a055e4a5d04571abd8e4f79a83d320: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:37.090517 3955 consensus_queue.cc:1048] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:37.090653 3960 consensus_queue.cc:1048] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:47.552371 3973 raft_consensus.cc:993] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320: : Instructing follower 0e1c720782114890abcee9555d939b64 to start an election
I20251211 09:08:47.552448 3973 raft_consensus.cc:1081] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 1 LEADER]: Signalling peer 0e1c720782114890abcee9555d939b64 to start an election
I20251211 09:08:47.552637 3757 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "88d65380ac1e4731ba0b4bbd064b41cf"
dest_uuid: "0e1c720782114890abcee9555d939b64"
from {username='slave'} at 127.0.0.1:41588
I20251211 09:08:47.552716 3757 raft_consensus.cc:493] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:08:47.552743 3757 raft_consensus.cc:3060] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:47.553403 3757 raft_consensus.cc:515] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:47.553565 3757 leader_election.cc:290] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [CANDIDATE]: Term 2 election: Requested vote from peers c7fe1aa9935e498ab2fce51432af1336 (127.0.119.195:39357), 79a055e4a5d04571abd8e4f79a83d320 (127.0.119.194:36237)
I20251211 09:08:47.556109 3909 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88d65380ac1e4731ba0b4bbd064b41cf" candidate_uuid: "0e1c720782114890abcee9555d939b64" candidate_term: 2 candidate_status { last_received { term: 1 index: 14014 } } ignore_live_leader: true dest_uuid: "c7fe1aa9935e498ab2fce51432af1336"
I20251211 09:08:47.556128 3834 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88d65380ac1e4731ba0b4bbd064b41cf" candidate_uuid: "0e1c720782114890abcee9555d939b64" candidate_term: 2 candidate_status { last_received { term: 1 index: 14014 } } ignore_live_leader: true dest_uuid: "79a055e4a5d04571abd8e4f79a83d320"
I20251211 09:08:47.556191 3834 raft_consensus.cc:3055] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:08:47.556180 3909 raft_consensus.cc:3060] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:47.556213 3834 raft_consensus.cc:740] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79a055e4a5d04571abd8e4f79a83d320, State: Running, Role: LEADER
I20251211 09:08:47.556265 3834 consensus_queue.cc:260] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14014, Committed index: 14014, Last appended: 1.14014, Last appended by leader: 14014, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:47.556334 3834 raft_consensus.cc:3060] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:47.556816 3909 raft_consensus.cc:2468] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1c720782114890abcee9555d939b64 in term 2.
I20251211 09:08:47.556915 3834 raft_consensus.cc:2468] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1c720782114890abcee9555d939b64 in term 2.
I20251211 09:08:47.556999 3723 leader_election.cc:304] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1c720782114890abcee9555d939b64, c7fe1aa9935e498ab2fce51432af1336; no voters:
I20251211 09:08:47.557188 4005 raft_consensus.cc:2804] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:08:47.557324 4005 raft_consensus.cc:697] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 2 LEADER]: Becoming Leader. State: Replica: 0e1c720782114890abcee9555d939b64, State: Running, Role: LEADER
I20251211 09:08:47.557381 4005 consensus_queue.cc:237] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14014, Committed index: 14014, Last appended: 1.14014, Last appended by leader: 14014, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } }
I20251211 09:08:47.557749 3654 catalog_manager.cc:5654] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 reported cstate change: term changed from 1 to 2, leader changed from 79a055e4a5d04571abd8e4f79a83d320 (127.0.119.194) to 0e1c720782114890abcee9555d939b64 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "0e1c720782114890abcee9555d939b64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7fe1aa9935e498ab2fce51432af1336" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1c720782114890abcee9555d939b64" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79a055e4a5d04571abd8e4f79a83d320" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20251211 09:08:47.566107 3824 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32874: Illegal state: replica 79a055e4a5d04571abd8e4f79a83d320 is not leader of this config: current role FOLLOWER
W20251211 09:08:47.566495 3824 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32874: Illegal state: replica 79a055e4a5d04571abd8e4f79a83d320 is not leader of this config: current role FOLLOWER
W20251211 09:08:47.566780 3824 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:32874: Illegal state: replica 79a055e4a5d04571abd8e4f79a83d320 is not leader of this config: current role FOLLOWER
I20251211 09:08:47.566954 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:08:47.569655 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:47.569751 479 tablet_replica.cc:333] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: stopping tablet replica
I20251211 09:08:47.569802 479 raft_consensus.cc:2243] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:08:47.569867 479 pending_rounds.cc:70] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: Trying to abort 1 pending ops.
I20251211 09:08:47.569921 479 pending_rounds.cc:77] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64: Aborting op as it isn't in flight: id { term: 2 index: 14015 } timestamp: 7231259146475483136 op_type: NO_OP noop_request { }
I20251211 09:08:47.569972 479 raft_consensus.cc:2889] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 09:08:47.570006 479 raft_consensus.cc:2272] T 88d65380ac1e4731ba0b4bbd064b41cf P 0e1c720782114890abcee9555d939b64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:47.587044 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:08:47.587888 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:08:47.590695 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:47.590818 479 tablet_replica.cc:333] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320: stopping tablet replica
I20251211 09:08:47.590893 479 raft_consensus.cc:2243] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:47.590926 479 raft_consensus.cc:2272] T 88d65380ac1e4731ba0b4bbd064b41cf P 79a055e4a5d04571abd8e4f79a83d320 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:47.604368 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:08:47.605114 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:08:47.608058 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:47.608182 479 tablet_replica.cc:333] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336: stopping tablet replica
I20251211 09:08:47.608245 479 raft_consensus.cc:2243] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:08:47.608306 479 raft_consensus.cc:2272] T 88d65380ac1e4731ba0b4bbd064b41cf P c7fe1aa9935e498ab2fce51432af1336 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:47.630967 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:08:47.631745 479 master.cc:561] Master@127.0.119.254:38581 shutting down...
I20251211 09:08:47.633775 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:08:47.633839 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:47.633868 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6415823ecd514d8e9a0f55c6301f852b: stopping tablet replica
I20251211 09:08:47.645550 479 master.cc:583] Master@127.0.119.254:38581 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyNonLeader (10753 ms)
[ RUN ] TxnParticipantITest.TestProxyTabletBootstrapping
I20251211 09:08:47.663859 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:40089
I20251211 09:08:47.664000 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:47.665042 4011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:47.665114 4014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:47.665122 4012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:47.665323 479 server_base.cc:1047] running on GCE node
I20251211 09:08:47.665448 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:47.665482 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:47.665494 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444127665495 us; error 0 us; skew 500 ppm
I20251211 09:08:47.666064 479 webserver.cc:492] Webserver started at http://127.0.119.254:41491/ using document root <none> and password file <none>
I20251211 09:08:47.666138 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:47.666184 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:47.666229 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:47.666476 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "a0fd7a131e434f6ca4bff8478567d689"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.667304 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:47.667786 4019 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.667909 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.667951 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "a0fd7a131e434f6ca4bff8478567d689"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.667999 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:47.677115 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:47.677304 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:47.679598 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:40089
I20251211 09:08:47.682492 4071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:40089 every 8 connection(s)
I20251211 09:08:47.682596 4072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:47.683497 4072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689: Bootstrap starting.
I20251211 09:08:47.683776 4072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:47.684231 4072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689: No bootstrap required, opened a new log
I20251211 09:08:47.684350 4072 raft_consensus.cc:359] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd7a131e434f6ca4bff8478567d689" member_type: VOTER }
I20251211 09:08:47.684396 4072 raft_consensus.cc:385] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:47.684409 4072 raft_consensus.cc:740] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0fd7a131e434f6ca4bff8478567d689, State: Initialized, Role: FOLLOWER
I20251211 09:08:47.684460 4072 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd7a131e434f6ca4bff8478567d689" member_type: VOTER }
I20251211 09:08:47.684499 4072 raft_consensus.cc:399] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:08:47.684513 4072 raft_consensus.cc:493] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:08:47.684540 4072 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:47.684994 4072 raft_consensus.cc:515] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd7a131e434f6ca4bff8478567d689" member_type: VOTER }
I20251211 09:08:47.685046 4072 leader_election.cc:304] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0fd7a131e434f6ca4bff8478567d689; no voters:
I20251211 09:08:47.685151 4072 leader_election.cc:290] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:08:47.685197 4075 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:47.685315 4072 sys_catalog.cc:565] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:08:47.685387 4075 raft_consensus.cc:697] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 1 LEADER]: Becoming Leader. State: Replica: a0fd7a131e434f6ca4bff8478567d689, State: Running, Role: LEADER
I20251211 09:08:47.685436 4075 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd7a131e434f6ca4bff8478567d689" member_type: VOTER }
I20251211 09:08:47.685616 4076 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0fd7a131e434f6ca4bff8478567d689" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd7a131e434f6ca4bff8478567d689" member_type: VOTER } }
I20251211 09:08:47.685621 4077 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0fd7a131e434f6ca4bff8478567d689. Latest consensus state: current_term: 1 leader_uuid: "a0fd7a131e434f6ca4bff8478567d689" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd7a131e434f6ca4bff8478567d689" member_type: VOTER } }
I20251211 09:08:47.685680 4076 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:47.685683 4077 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [sys.catalog]: This master's current role is: LEADER
I20251211 09:08:47.686043 4080 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:08:47.686177 4080 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:08:47.686664 4080 catalog_manager.cc:1357] Generated new cluster ID: 6f516b900dfc4472ab0add8234cdca93
I20251211 09:08:47.686719 4080 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:08:47.686736 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:08:47.716145 4080 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:08:47.716584 4080 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:08:47.727286 4080 catalog_manager.cc:6027] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689: Generated new TSK 0
I20251211 09:08:47.727365 4080 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:08:47.750592 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:47.751878 4093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:47.751941 479 server_base.cc:1047] running on GCE node
W20251211 09:08:47.752077 4094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:47.752110 4096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:47.752218 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:47.752264 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:47.752282 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444127752281 us; error 0 us; skew 500 ppm
I20251211 09:08:47.752794 479 webserver.cc:492] Webserver started at http://127.0.119.193:41145/ using document root <none> and password file <none>
I20251211 09:08:47.752873 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:47.752918 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:47.752969 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:47.753211 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "89ff937e5589479a8f3a65429574168a"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.754014 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:47.754421 4101 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.754547 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.754597 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "89ff937e5589479a8f3a65429574168a"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.754635 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:47.766366 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:47.766510 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:47.766615 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:47.766757 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:47.766777 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.766810 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:47.766827 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.769372 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:44263
I20251211 09:08:47.769804 4164 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:44263 every 8 connection(s)
I20251211 09:08:47.769887 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:47.771093 4170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:47.771243 4172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:47.771772 479 server_base.cc:1047] running on GCE node
W20251211 09:08:47.771822 4169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:47.771965 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:47.772019 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:47.772042 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444127772042 us; error 0 us; skew 500 ppm
I20251211 09:08:47.772670 479 webserver.cc:492] Webserver started at http://127.0.119.194:44971/ using document root <none> and password file <none>
I20251211 09:08:47.772761 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:47.772807 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:47.772886 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:47.773134 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "d9514bddefca4765bda1482cbd63105b"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.773859 4165 heartbeater.cc:344] Connected to a master server at 127.0.119.254:40089
I20251211 09:08:47.773922 4165 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:47.774044 4165 heartbeater.cc:507] Master 127.0.119.254:40089 requested a full tablet report, sending...
I20251211 09:08:47.774273 4036 ts_manager.cc:194] Registered new tserver with Master: 89ff937e5589479a8f3a65429574168a (127.0.119.193:44263)
I20251211 09:08:47.774293 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:47.774823 4177 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.774948 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251211 09:08:47.774995 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "d9514bddefca4765bda1482cbd63105b"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.775031 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:47.775050 4036 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60252
I20251211 09:08:47.783991 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:47.784201 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:47.784339 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:47.784513 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:47.784548 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.784590 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:47.784617 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.787334 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:41825
I20251211 09:08:47.787384 4240 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:41825 every 8 connection(s)
I20251211 09:08:47.787679 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:47.788750 4244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:47.788823 4245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:47.789033 4247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:47.789201 479 server_base.cc:1047] running on GCE node
I20251211 09:08:47.789302 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:47.789340 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:47.789356 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444127789357 us; error 0 us; skew 500 ppm
I20251211 09:08:47.789921 479 webserver.cc:492] Webserver started at http://127.0.119.195:45457/ using document root <none> and password file <none>
I20251211 09:08:47.790001 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:47.790050 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:08:47.790087 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:08:47.790408 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "ef498cd869d44d30b259c8cd2389ba0b"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.790513 4241 heartbeater.cc:344] Connected to a master server at 127.0.119.254:40089
I20251211 09:08:47.790570 4241 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:47.790668 4241 heartbeater.cc:507] Master 127.0.119.254:40089 requested a full tablet report, sending...
I20251211 09:08:47.790849 4036 ts_manager.cc:194] Registered new tserver with Master: d9514bddefca4765bda1482cbd63105b (127.0.119.194:41825)
I20251211 09:08:47.791133 4036 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60266
I20251211 09:08:47.791342 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:47.791849 4252 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.791976 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.792018 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "ef498cd869d44d30b259c8cd2389ba0b"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:47.792093 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:47.826923 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:47.827165 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:47.827339 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:47.827533 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:08:47.827558 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.827591 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:08:47.827616 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.830655 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:34481
I20251211 09:08:47.830746 4315 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:34481 every 8 connection(s)
I20251211 09:08:47.833652 4316 heartbeater.cc:344] Connected to a master server at 127.0.119.254:40089
I20251211 09:08:47.833709 4316 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:47.833809 4316 heartbeater.cc:507] Master 127.0.119.254:40089 requested a full tablet report, sending...
I20251211 09:08:47.834019 4036 ts_manager.cc:194] Registered new tserver with Master: ef498cd869d44d30b259c8cd2389ba0b (127.0.119.195:34481)
I20251211 09:08:47.834164 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003305039s
I20251211 09:08:47.834395 4036 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60276
I20251211 09:08:47.834513 479 test_util.cc:276] Using random seed: 2115781009
I20251211 09:08:47.838690 4036 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60292:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:08:47.838832 4036 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:08:47.842773 4280 tablet_service.cc:1505] Processing CreateTablet for tablet 886f3fcb144c43b28f6b0442ea454823 (DEFAULT_TABLE table=test-workload [id=82565d6b8ab24782ab0cb8b9f91eba4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:47.842909 4280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886f3fcb144c43b28f6b0442ea454823. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:47.843052 4129 tablet_service.cc:1505] Processing CreateTablet for tablet 886f3fcb144c43b28f6b0442ea454823 (DEFAULT_TABLE table=test-workload [id=82565d6b8ab24782ab0cb8b9f91eba4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:47.843159 4129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886f3fcb144c43b28f6b0442ea454823. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:47.844132 4331 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b: Bootstrap starting.
I20251211 09:08:47.844491 4205 tablet_service.cc:1505] Processing CreateTablet for tablet 886f3fcb144c43b28f6b0442ea454823 (DEFAULT_TABLE table=test-workload [id=82565d6b8ab24782ab0cb8b9f91eba4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:08:47.844602 4205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886f3fcb144c43b28f6b0442ea454823. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:08:47.844610 4331 tablet_bootstrap.cc:654] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:47.844671 4332 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Bootstrap starting.
I20251211 09:08:47.845114 4332 tablet_bootstrap.cc:654] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:47.845752 4332 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: No bootstrap required, opened a new log
I20251211 09:08:47.845808 4332 ts_tablet_manager.cc:1403] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:47.845955 4335 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: Bootstrap starting.
I20251211 09:08:47.845978 4332 raft_consensus.cc:359] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:47.846114 4332 raft_consensus.cc:385] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:47.846156 4332 raft_consensus.cc:740] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ff937e5589479a8f3a65429574168a, State: Initialized, Role: FOLLOWER
I20251211 09:08:47.846172 4331 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b: No bootstrap required, opened a new log
I20251211 09:08:47.846211 4331 ts_tablet_manager.cc:1403] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:08:47.846232 4332 consensus_queue.cc:260] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:47.846336 4331 raft_consensus.cc:359] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:47.846374 4335 tablet_bootstrap.cc:654] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: Neither blocks nor log segments found. Creating new log.
I20251211 09:08:47.846432 4165 heartbeater.cc:499] Master 127.0.119.254:40089 was elected leader, sending a full tablet report...
I20251211 09:08:47.846376 4331 raft_consensus.cc:385] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:47.846379 4332 ts_tablet_manager.cc:1434] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251211 09:08:47.846583 4331 raft_consensus.cc:740] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef498cd869d44d30b259c8cd2389ba0b, State: Initialized, Role: FOLLOWER
I20251211 09:08:47.846630 4331 consensus_queue.cc:260] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:47.846760 4331 ts_tablet_manager.cc:1434] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:08:47.846824 4316 heartbeater.cc:499] Master 127.0.119.254:40089 was elected leader, sending a full tablet report...
I20251211 09:08:47.847095 4335 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: No bootstrap required, opened a new log
I20251211 09:08:47.847172 4335 ts_tablet_manager.cc:1403] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:08:47.847316 4335 raft_consensus.cc:359] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:47.847370 4335 raft_consensus.cc:385] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:08:47.847391 4335 raft_consensus.cc:740] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9514bddefca4765bda1482cbd63105b, State: Initialized, Role: FOLLOWER
I20251211 09:08:47.847442 4335 consensus_queue.cc:260] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:47.847579 4335 ts_tablet_manager.cc:1434] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:47.847621 4241 heartbeater.cc:499] Master 127.0.119.254:40089 was elected leader, sending a full tablet report...
W20251211 09:08:48.020025 4166 tablet.cc:2378] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 09:08:48.138371 4339 raft_consensus.cc:493] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:08:48.138478 4339 raft_consensus.cc:515] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:48.138720 4339 leader_election.cc:290] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef498cd869d44d30b259c8cd2389ba0b (127.0.119.195:34481), 89ff937e5589479a8f3a65429574168a (127.0.119.193:44263)
I20251211 09:08:48.141301 4139 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "886f3fcb144c43b28f6b0442ea454823" candidate_uuid: "d9514bddefca4765bda1482cbd63105b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ff937e5589479a8f3a65429574168a" is_pre_election: true
I20251211 09:08:48.141304 4290 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "886f3fcb144c43b28f6b0442ea454823" candidate_uuid: "d9514bddefca4765bda1482cbd63105b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef498cd869d44d30b259c8cd2389ba0b" is_pre_election: true
I20251211 09:08:48.141407 4139 raft_consensus.cc:2468] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9514bddefca4765bda1482cbd63105b in term 0.
I20251211 09:08:48.141431 4290 raft_consensus.cc:2468] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9514bddefca4765bda1482cbd63105b in term 0.
I20251211 09:08:48.141567 4179 leader_election.cc:304] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ff937e5589479a8f3a65429574168a, d9514bddefca4765bda1482cbd63105b; no voters:
I20251211 09:08:48.141665 4339 raft_consensus.cc:2804] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:08:48.141716 4339 raft_consensus.cc:493] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:08:48.141732 4339 raft_consensus.cc:3060] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:48.142367 4339 raft_consensus.cc:515] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:48.142488 4339 leader_election.cc:290] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [CANDIDATE]: Term 1 election: Requested vote from peers ef498cd869d44d30b259c8cd2389ba0b (127.0.119.195:34481), 89ff937e5589479a8f3a65429574168a (127.0.119.193:44263)
I20251211 09:08:48.142663 4290 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "886f3fcb144c43b28f6b0442ea454823" candidate_uuid: "d9514bddefca4765bda1482cbd63105b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef498cd869d44d30b259c8cd2389ba0b"
I20251211 09:08:48.142663 4139 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "886f3fcb144c43b28f6b0442ea454823" candidate_uuid: "d9514bddefca4765bda1482cbd63105b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ff937e5589479a8f3a65429574168a"
I20251211 09:08:48.142737 4290 raft_consensus.cc:3060] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:48.142741 4139 raft_consensus.cc:3060] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:08:48.143366 4139 raft_consensus.cc:2468] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9514bddefca4765bda1482cbd63105b in term 1.
I20251211 09:08:48.143436 4290 raft_consensus.cc:2468] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9514bddefca4765bda1482cbd63105b in term 1.
I20251211 09:08:48.143536 4179 leader_election.cc:304] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ff937e5589479a8f3a65429574168a, d9514bddefca4765bda1482cbd63105b; no voters:
I20251211 09:08:48.143637 4339 raft_consensus.cc:2804] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:08:48.143766 4339 raft_consensus.cc:697] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 1 LEADER]: Becoming Leader. State: Replica: d9514bddefca4765bda1482cbd63105b, State: Running, Role: LEADER
I20251211 09:08:48.143812 4339 consensus_queue.cc:237] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:48.144356 4035 catalog_manager.cc:5654] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b reported cstate change: term changed from 0 to 1, leader changed from <none> to d9514bddefca4765bda1482cbd63105b (127.0.119.194). New cstate: current_term: 1 leader_uuid: "d9514bddefca4765bda1482cbd63105b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } health_report { overall_health: UNKNOWN } } }
I20251211 09:08:48.201231 4290 raft_consensus.cc:1275] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 1 FOLLOWER]: Refusing update from remote peer d9514bddefca4765bda1482cbd63105b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:48.201277 4139 raft_consensus.cc:1275] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 1 FOLLOWER]: Refusing update from remote peer d9514bddefca4765bda1482cbd63105b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:08:48.201498 4339 consensus_queue.cc:1048] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:48.201587 4341 consensus_queue.cc:1048] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:08:48.202751 4348 mvcc.cc:204] Tried to move back new op lower bound from 7231259149110919168 to 7231259148877619200. Current Snapshot: MvccSnapshot[applied={T|T < 7231259149110919168}]
I20251211 09:08:58.717336 4390 raft_consensus.cc:993] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: : Instructing follower 89ff937e5589479a8f3a65429574168a to start an election
I20251211 09:08:58.717435 4390 raft_consensus.cc:1081] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 1 LEADER]: Signalling peer 89ff937e5589479a8f3a65429574168a to start an election
I20251211 09:08:58.717661 4138 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "886f3fcb144c43b28f6b0442ea454823"
dest_uuid: "89ff937e5589479a8f3a65429574168a"
from {username='slave'} at 127.0.0.1:51198
I20251211 09:08:58.717743 4138 raft_consensus.cc:493] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:08:58.717777 4138 raft_consensus.cc:3060] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:58.718803 4138 raft_consensus.cc:515] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:58.718986 4138 leader_election.cc:290] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [CANDIDATE]: Term 2 election: Requested vote from peers ef498cd869d44d30b259c8cd2389ba0b (127.0.119.195:34481), d9514bddefca4765bda1482cbd63105b (127.0.119.194:41825)
I20251211 09:08:58.726423 4215 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "886f3fcb144c43b28f6b0442ea454823" candidate_uuid: "89ff937e5589479a8f3a65429574168a" candidate_term: 2 candidate_status { last_received { term: 1 index: 13996 } } ignore_live_leader: true dest_uuid: "d9514bddefca4765bda1482cbd63105b"
I20251211 09:08:58.726609 4215 raft_consensus.cc:3055] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:08:58.726688 4215 raft_consensus.cc:740] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9514bddefca4765bda1482cbd63105b, State: Running, Role: LEADER
I20251211 09:08:58.726778 4215 consensus_queue.cc:260] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13996, Committed index: 13996, Last appended: 1.13996, Last appended by leader: 13996, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:58.726935 4215 raft_consensus.cc:3060] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:58.728155 4215 raft_consensus.cc:2468] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ff937e5589479a8f3a65429574168a in term 2.
I20251211 09:08:58.728376 4104 leader_election.cc:304] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ff937e5589479a8f3a65429574168a, d9514bddefca4765bda1482cbd63105b; no voters:
I20251211 09:08:58.728919 4290 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "886f3fcb144c43b28f6b0442ea454823" candidate_uuid: "89ff937e5589479a8f3a65429574168a" candidate_term: 2 candidate_status { last_received { term: 1 index: 13996 } } ignore_live_leader: true dest_uuid: "ef498cd869d44d30b259c8cd2389ba0b"
I20251211 09:08:58.728998 4290 raft_consensus.cc:3060] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:08:58.729187 4396 raft_consensus.cc:2804] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:08:58.729344 4396 raft_consensus.cc:697] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 LEADER]: Becoming Leader. State: Replica: 89ff937e5589479a8f3a65429574168a, State: Running, Role: LEADER
I20251211 09:08:58.729413 4396 consensus_queue.cc:237] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13996, Committed index: 13996, Last appended: 1.13996, Last appended by leader: 13996, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:08:58.729704 4290 raft_consensus.cc:2468] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ff937e5589479a8f3a65429574168a in term 2.
I20251211 09:08:58.730461 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:08:58.730837 4027 catalog_manager.cc:5654] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a reported cstate change: term changed from 1 to 2, leader changed from d9514bddefca4765bda1482cbd63105b (127.0.119.194) to 89ff937e5589479a8f3a65429574168a (127.0.119.193). New cstate: current_term: 2 leader_uuid: "89ff937e5589479a8f3a65429574168a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } health_report { overall_health: HEALTHY } } }
I20251211 09:08:58.733775 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:58.733873 479 tablet_replica.cc:333] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: stopping tablet replica
I20251211 09:08:58.733943 479 raft_consensus.cc:2243] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:08:58.734000 479 pending_rounds.cc:70] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Trying to abort 1 pending ops.
I20251211 09:08:58.734019 479 pending_rounds.cc:77] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Aborting op as it isn't in flight: id { term: 2 index: 13997 } timestamp: 7231259192236224512 op_type: NO_OP noop_request { }
I20251211 09:08:58.734051 479 raft_consensus.cc:2889] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 09:08:58.734074 479 raft_consensus.cc:2272] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:08:58.737490 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:08:58.738433 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:08:58.739447 4402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:08:58.739454 4405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:58.739566 479 server_base.cc:1047] running on GCE node
W20251211 09:08:58.739713 4403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:08:58.739835 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:08:58.739869 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:08:58.739897 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444138739897 us; error 0 us; skew 500 ppm
I20251211 09:08:58.740432 479 webserver.cc:492] Webserver started at http://127.0.119.193:41145/ using document root <none> and password file <none>
I20251211 09:08:58.740496 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:08:58.740522 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:08:58.741075 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:58.741552 4410 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:58.741672 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:58.741722 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "89ff937e5589479a8f3a65429574168a"
format_stamp: "Formatted at 2025-12-11 09:08:47 on dist-test-slave-hb70"
I20251211 09:08:58.741771 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:08:58.750669 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:08:58.750849 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:08:58.750991 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:08:58.751336 4417 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251211 09:08:58.752039 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:08:58.752076 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:08:58.752099 479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251211 09:08:58.752496 479 ts_tablet_manager.cc:616] Registered 1 tablets
W20251211 09:08:58.752512 4417 ts_tablet_manager.cc:1382] Injecting 1000ms delay in tablet bootstrapping
I20251211 09:08:58.752526 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:08:58.755184 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:44263
I20251211 09:08:58.763720 4474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:44263 every 8 connection(s)
I20251211 09:08:58.766806 4475 heartbeater.cc:344] Connected to a master server at 127.0.119.254:40089
I20251211 09:08:58.766880 4475 heartbeater.cc:461] Registering TS with master...
I20251211 09:08:58.767016 4475 heartbeater.cc:507] Master 127.0.119.254:40089 requested a full tablet report, sending...
I20251211 09:08:58.767295 4027 ts_manager.cc:194] Re-registered known tserver with Master: 89ff937e5589479a8f3a65429574168a (127.0.119.193:44263)
I20251211 09:08:58.767562 479 tablet_server.cc:178] TabletServer@127.0.119.193:44263 shutting down...
I20251211 09:08:58.767777 4027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55022
I20251211 09:08:58.769769 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:08:59.752763 4417 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Bootstrap starting.
W20251211 09:09:00.279438 4482 raft_consensus.cc:670] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: failed to trigger leader election: Illegal state: leader elections are disabled
I20251211 09:09:00.544806 4417 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Bootstrap replayed 1/3 log segments. Stats: ops{read=4946 overwritten=0 applied=4943 ignored=0} inserts{seen=247100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20251211 09:09:01.360534 4417 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Bootstrap replayed 2/3 log segments. Stats: ops{read=9893 overwritten=0 applied=9892 ignored=0} inserts{seen=494550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:09:02.035504 4417 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Bootstrap replayed 3/3 log segments. Stats: ops{read=13997 overwritten=0 applied=13996 ignored=0} inserts{seen=699750 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:09:02.035933 4417 tablet_bootstrap.cc:492] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Bootstrap complete.
I20251211 09:09:02.040508 4417 ts_tablet_manager.cc:1403] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Time spent bootstrapping tablet: real 2.288s user 1.976s sys 0.307s
I20251211 09:09:02.040673 4417 raft_consensus.cc:359] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:09:02.040735 4417 raft_consensus.cc:740] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ff937e5589479a8f3a65429574168a, State: Initialized, Role: FOLLOWER
I20251211 09:09:02.040777 4417 consensus_queue.cc:260] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13996, Last appended: 2.13997, Last appended by leader: 13997, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef498cd869d44d30b259c8cd2389ba0b" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34481 } } peers { permanent_uuid: "d9514bddefca4765bda1482cbd63105b" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41825 } } peers { permanent_uuid: "89ff937e5589479a8f3a65429574168a" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44263 } }
I20251211 09:09:02.040936 4417 ts_tablet_manager.cc:1434] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Time spent starting tablet: real 0.000s user 0.003s sys 0.000s
I20251211 09:09:02.041072 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:09:02.041128 479 raft_consensus.cc:2243] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:02.041172 479 pending_rounds.cc:70] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Trying to abort 1 pending ops.
I20251211 09:09:02.041198 479 pending_rounds.cc:77] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a: Aborting op as it isn't in flight: id { term: 2 index: 13997 } timestamp: 7231259192236224512 op_type: NO_OP noop_request { }
I20251211 09:09:02.041234 479 raft_consensus.cc:2889] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251211 09:09:02.041296 479 raft_consensus.cc:2272] T 886f3fcb144c43b28f6b0442ea454823 P 89ff937e5589479a8f3a65429574168a [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:02.054037 479 tablet_server.cc:195] TabletServer@127.0.119.193:44263 shutdown complete.
I20251211 09:09:02.054865 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:09:02.057657 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:02.057758 479 tablet_replica.cc:333] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b: stopping tablet replica
I20251211 09:09:02.057819 479 raft_consensus.cc:2243] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:02.057873 479 raft_consensus.cc:2272] T 886f3fcb144c43b28f6b0442ea454823 P d9514bddefca4765bda1482cbd63105b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:02.080080 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:09:02.080832 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:09:02.083712 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:02.083904 479 tablet_replica.cc:333] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b: stopping tablet replica
I20251211 09:09:02.083961 479 raft_consensus.cc:2243] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:02.084022 479 raft_consensus.cc:2272] T 886f3fcb144c43b28f6b0442ea454823 P ef498cd869d44d30b259c8cd2389ba0b [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:02.097831 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:09:02.098601 479 master.cc:561] Master@127.0.119.254:40089 shutting down...
I20251211 09:09:02.101069 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:02.101135 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:02.101174 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P a0fd7a131e434f6ca4bff8478567d689: stopping tablet replica
I20251211 09:09:02.112727 479 master.cc:583] Master@127.0.119.254:40089 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyTabletBootstrapping (14467 ms)
[ RUN ] TxnParticipantITest.TestProxyTabletNotRunning
I20251211 09:09:02.131392 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:39791
I20251211 09:09:02.131551 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:02.132714 4488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:02.132743 4489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:02.132859 4491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:02.132995 479 server_base.cc:1047] running on GCE node
I20251211 09:09:02.133101 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:02.133132 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:02.133147 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444142133148 us; error 0 us; skew 500 ppm
I20251211 09:09:02.133713 479 webserver.cc:492] Webserver started at http://127.0.119.254:45997/ using document root <none> and password file <none>
I20251211 09:09:02.133777 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:02.133821 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:02.133868 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:02.134119 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "90bc61593e8e444b87c9257bb4caaa80"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.134965 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:02.135356 4496 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.135468 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.135511 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "90bc61593e8e444b87c9257bb4caaa80"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.135550 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:02.148823 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:02.148981 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:02.151391 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:39791
I20251211 09:09:02.157768 4548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:39791 every 8 connection(s)
I20251211 09:09:02.160216 4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:02.161185 4549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80: Bootstrap starting.
I20251211 09:09:02.161504 4549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:02.161978 4549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80: No bootstrap required, opened a new log
I20251211 09:09:02.162078 4549 raft_consensus.cc:359] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc61593e8e444b87c9257bb4caaa80" member_type: VOTER }
I20251211 09:09:02.162122 4549 raft_consensus.cc:385] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:02.162135 4549 raft_consensus.cc:740] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90bc61593e8e444b87c9257bb4caaa80, State: Initialized, Role: FOLLOWER
I20251211 09:09:02.162170 4549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc61593e8e444b87c9257bb4caaa80" member_type: VOTER }
I20251211 09:09:02.162216 4549 raft_consensus.cc:399] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:09:02.162240 4549 raft_consensus.cc:493] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:09:02.162256 4549 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:02.162678 4549 raft_consensus.cc:515] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc61593e8e444b87c9257bb4caaa80" member_type: VOTER }
I20251211 09:09:02.162735 4549 leader_election.cc:304] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90bc61593e8e444b87c9257bb4caaa80; no voters:
I20251211 09:09:02.162812 4549 leader_election.cc:290] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:09:02.162882 4552 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:02.162974 4549 sys_catalog.cc:565] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:09:02.163014 4552 raft_consensus.cc:697] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 1 LEADER]: Becoming Leader. State: Replica: 90bc61593e8e444b87c9257bb4caaa80, State: Running, Role: LEADER
I20251211 09:09:02.163098 4552 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc61593e8e444b87c9257bb4caaa80" member_type: VOTER }
I20251211 09:09:02.163302 4553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90bc61593e8e444b87c9257bb4caaa80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc61593e8e444b87c9257bb4caaa80" member_type: VOTER } }
I20251211 09:09:02.163442 4553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:02.163316 4554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90bc61593e8e444b87c9257bb4caaa80. Latest consensus state: current_term: 1 leader_uuid: "90bc61593e8e444b87c9257bb4caaa80" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc61593e8e444b87c9257bb4caaa80" member_type: VOTER } }
I20251211 09:09:02.163590 4554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:02.163633 4559 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:09:02.163795 4559 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:09:02.164290 4559 catalog_manager.cc:1357] Generated new cluster ID: c0fdda6fa22648f2a4909334615c5a79
I20251211 09:09:02.164314 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:09:02.164343 4559 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:09:02.171964 4559 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:09:02.172380 4559 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:09:02.178720 4559 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80: Generated new TSK 0
I20251211 09:09:02.178802 4559 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:09:02.179899 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:02.181114 4570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:02.181180 4573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:02.181239 479 server_base.cc:1047] running on GCE node
W20251211 09:09:02.181138 4571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:02.181475 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:02.181505 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:02.181525 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444142181524 us; error 0 us; skew 500 ppm
I20251211 09:09:02.182039 479 webserver.cc:492] Webserver started at http://127.0.119.193:33075/ using document root <none> and password file <none>
I20251211 09:09:02.182121 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:02.182168 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:02.182226 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:02.182482 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "627363fcfdcc4e4184b92b31038522a8"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.183297 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:02.183748 4578 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.183866 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.183907 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "627363fcfdcc4e4184b92b31038522a8"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.183954 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:02.206630 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:02.206880 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:02.207056 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:02.207259 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:02.207286 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.207320 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:02.207347 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.210191 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:41017
I20251211 09:09:02.210232 4641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:41017 every 8 connection(s)
I20251211 09:09:02.210556 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:02.211825 4649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:02.211915 4646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:02.211993 4647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:02.212075 479 server_base.cc:1047] running on GCE node
I20251211 09:09:02.212298 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:02.212353 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:02.212370 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444142212370 us; error 0 us; skew 500 ppm
I20251211 09:09:02.213083 479 webserver.cc:492] Webserver started at http://127.0.119.194:43101/ using document root <none> and password file <none>
I20251211 09:09:02.213171 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:02.213217 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:02.213296 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:02.213614 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "018a36d3c1e54384b555f317b0d5a64f"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.214448 4642 heartbeater.cc:344] Connected to a master server at 127.0.119.254:39791
I20251211 09:09:02.214520 4642 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:02.214624 4642 heartbeater.cc:507] Master 127.0.119.254:39791 requested a full tablet report, sending...
I20251211 09:09:02.214864 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:09:02.214867 4513 ts_manager.cc:194] Registered new tserver with Master: 627363fcfdcc4e4184b92b31038522a8 (127.0.119.193:41017)
I20251211 09:09:02.215400 4654 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.215528 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.215572 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "018a36d3c1e54384b555f317b0d5a64f"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.215626 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:02.215658 4513 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40772
I20251211 09:09:02.230507 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:02.230712 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:02.230871 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:02.231073 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:02.231101 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.231137 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:02.231168 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.233870 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:40071
I20251211 09:09:02.233928 4717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:40071 every 8 connection(s)
I20251211 09:09:02.234246 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:02.235459 4724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:02.235459 4721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:02.235544 4722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:02.235760 479 server_base.cc:1047] running on GCE node
I20251211 09:09:02.235879 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:02.235915 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:02.235939 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444142235938 us; error 0 us; skew 500 ppm
I20251211 09:09:02.236900 479 webserver.cc:492] Webserver started at http://127.0.119.195:33003/ using document root <none> and password file <none>
I20251211 09:09:02.236994 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:02.237049 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:02.237100 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:02.237462 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "b9988f84996a4e198af83663e864eb77"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.237573 4718 heartbeater.cc:344] Connected to a master server at 127.0.119.254:39791
I20251211 09:09:02.237643 4718 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:02.237731 4718 heartbeater.cc:507] Master 127.0.119.254:39791 requested a full tablet report, sending...
I20251211 09:09:02.237977 4513 ts_manager.cc:194] Registered new tserver with Master: 018a36d3c1e54384b555f317b0d5a64f (127.0.119.194:40071)
I20251211 09:09:02.238479 4513 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40774
I20251211 09:09:02.238600 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:09:02.239163 4729 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.239305 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251211 09:09:02.239354 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "b9988f84996a4e198af83663e864eb77"
format_stamp: "Formatted at 2025-12-11 09:09:02 on dist-test-slave-hb70"
I20251211 09:09:02.239392 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:02.245529 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:02.245728 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:02.245850 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:02.246016 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:02.246038 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.246071 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:02.246089 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.249514 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:37953
I20251211 09:09:02.249590 4792 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:37953 every 8 connection(s)
I20251211 09:09:02.252388 4793 heartbeater.cc:344] Connected to a master server at 127.0.119.254:39791
I20251211 09:09:02.252444 4793 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:02.252545 4793 heartbeater.cc:507] Master 127.0.119.254:39791 requested a full tablet report, sending...
I20251211 09:09:02.252779 4513 ts_manager.cc:194] Registered new tserver with Master: b9988f84996a4e198af83663e864eb77 (127.0.119.195:37953)
I20251211 09:09:02.253026 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003310292s
I20251211 09:09:02.253159 4513 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40782
I20251211 09:09:02.253388 479 test_util.cc:276] Using random seed: 2130199883
I20251211 09:09:02.257752 4513 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40794:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:09:02.257884 4513 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:09:02.262311 4757 tablet_service.cc:1505] Processing CreateTablet for tablet ad77f9f25a074eaabd76e1dd246d671a (DEFAULT_TABLE table=test-workload [id=980526c20721402487288fab3171c56f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:02.262435 4757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad77f9f25a074eaabd76e1dd246d671a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:02.262797 4606 tablet_service.cc:1505] Processing CreateTablet for tablet ad77f9f25a074eaabd76e1dd246d671a (DEFAULT_TABLE table=test-workload [id=980526c20721402487288fab3171c56f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:02.262878 4682 tablet_service.cc:1505] Processing CreateTablet for tablet ad77f9f25a074eaabd76e1dd246d671a (DEFAULT_TABLE table=test-workload [id=980526c20721402487288fab3171c56f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:02.262900 4606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad77f9f25a074eaabd76e1dd246d671a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:02.262979 4682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad77f9f25a074eaabd76e1dd246d671a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:02.264154 4808 tablet_bootstrap.cc:492] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77: Bootstrap starting.
I20251211 09:09:02.264451 4810 tablet_bootstrap.cc:492] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: Bootstrap starting.
I20251211 09:09:02.264772 4808 tablet_bootstrap.cc:654] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:02.264937 4810 tablet_bootstrap.cc:654] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:02.265267 4809 tablet_bootstrap.cc:492] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f: Bootstrap starting.
I20251211 09:09:02.265340 4808 tablet_bootstrap.cc:492] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77: No bootstrap required, opened a new log
I20251211 09:09:02.265399 4808 ts_tablet_manager.cc:1403] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:02.265463 4810 tablet_bootstrap.cc:492] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: No bootstrap required, opened a new log
I20251211 09:09:02.265537 4810 ts_tablet_manager.cc:1403] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:02.265600 4808 raft_consensus.cc:359] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.265642 4810 raft_consensus.cc:359] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.265682 4808 raft_consensus.cc:385] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:02.265686 4810 raft_consensus.cc:385] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:02.265717 4809 tablet_bootstrap.cc:654] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:02.265789 4810 raft_consensus.cc:740] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 627363fcfdcc4e4184b92b31038522a8, State: Initialized, Role: FOLLOWER
I20251211 09:09:02.265743 4808 raft_consensus.cc:740] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9988f84996a4e198af83663e864eb77, State: Initialized, Role: FOLLOWER
I20251211 09:09:02.265844 4810 consensus_queue.cc:260] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.265857 4808 consensus_queue.cc:260] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.266055 4793 heartbeater.cc:499] Master 127.0.119.254:39791 was elected leader, sending a full tablet report...
I20251211 09:09:02.266108 4642 heartbeater.cc:499] Master 127.0.119.254:39791 was elected leader, sending a full tablet report...
I20251211 09:09:02.266031 4810 ts_tablet_manager.cc:1434] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.266029 4808 ts_tablet_manager.cc:1434] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:09:02.266644 4809 tablet_bootstrap.cc:492] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f: No bootstrap required, opened a new log
I20251211 09:09:02.266700 4809 ts_tablet_manager.cc:1403] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:02.266917 4809 raft_consensus.cc:359] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.266983 4809 raft_consensus.cc:385] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:02.266996 4809 raft_consensus.cc:740] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018a36d3c1e54384b555f317b0d5a64f, State: Initialized, Role: FOLLOWER
I20251211 09:09:02.267050 4809 consensus_queue.cc:260] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.267205 4809 ts_tablet_manager.cc:1434] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:02.267237 4718 heartbeater.cc:499] Master 127.0.119.254:39791 was elected leader, sending a full tablet report...
I20251211 09:09:02.409271 4814 raft_consensus.cc:493] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:09:02.409370 4814 raft_consensus.cc:515] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.409569 4814 leader_election.cc:290] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 018a36d3c1e54384b555f317b0d5a64f (127.0.119.194:40071), b9988f84996a4e198af83663e864eb77 (127.0.119.195:37953)
I20251211 09:09:02.412284 4767 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad77f9f25a074eaabd76e1dd246d671a" candidate_uuid: "627363fcfdcc4e4184b92b31038522a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9988f84996a4e198af83663e864eb77" is_pre_election: true
I20251211 09:09:02.412426 4767 raft_consensus.cc:2468] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 627363fcfdcc4e4184b92b31038522a8 in term 0.
I20251211 09:09:02.412523 4692 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad77f9f25a074eaabd76e1dd246d671a" candidate_uuid: "627363fcfdcc4e4184b92b31038522a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018a36d3c1e54384b555f317b0d5a64f" is_pre_election: true
I20251211 09:09:02.412611 4692 raft_consensus.cc:2468] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 627363fcfdcc4e4184b92b31038522a8 in term 0.
I20251211 09:09:02.412621 4579 leader_election.cc:304] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 627363fcfdcc4e4184b92b31038522a8, b9988f84996a4e198af83663e864eb77; no voters:
I20251211 09:09:02.412757 4814 raft_consensus.cc:2804] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:09:02.412801 4814 raft_consensus.cc:493] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:09:02.412824 4814 raft_consensus.cc:3060] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:02.413520 4814 raft_consensus.cc:515] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.413635 4814 leader_election.cc:290] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [CANDIDATE]: Term 1 election: Requested vote from peers 018a36d3c1e54384b555f317b0d5a64f (127.0.119.194:40071), b9988f84996a4e198af83663e864eb77 (127.0.119.195:37953)
I20251211 09:09:02.413820 4692 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad77f9f25a074eaabd76e1dd246d671a" candidate_uuid: "627363fcfdcc4e4184b92b31038522a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "018a36d3c1e54384b555f317b0d5a64f"
I20251211 09:09:02.413879 4767 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad77f9f25a074eaabd76e1dd246d671a" candidate_uuid: "627363fcfdcc4e4184b92b31038522a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9988f84996a4e198af83663e864eb77"
I20251211 09:09:02.413882 4692 raft_consensus.cc:3060] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:02.413985 4767 raft_consensus.cc:3060] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:02.414614 4692 raft_consensus.cc:2468] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 627363fcfdcc4e4184b92b31038522a8 in term 1.
I20251211 09:09:02.414660 4767 raft_consensus.cc:2468] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 627363fcfdcc4e4184b92b31038522a8 in term 1.
I20251211 09:09:02.414804 4581 leader_election.cc:304] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018a36d3c1e54384b555f317b0d5a64f, 627363fcfdcc4e4184b92b31038522a8; no voters:
I20251211 09:09:02.414911 4814 raft_consensus.cc:2804] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:02.415071 4814 raft_consensus.cc:697] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 1 LEADER]: Becoming Leader. State: Replica: 627363fcfdcc4e4184b92b31038522a8, State: Running, Role: LEADER
I20251211 09:09:02.415123 4814 consensus_queue.cc:237] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } }
I20251211 09:09:02.415640 4512 catalog_manager.cc:5654] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 627363fcfdcc4e4184b92b31038522a8 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "627363fcfdcc4e4184b92b31038522a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "627363fcfdcc4e4184b92b31038522a8" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41017 } health_report { overall_health: HEALTHY } } }
I20251211 09:09:02.450748 4692 raft_consensus.cc:1275] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 1 FOLLOWER]: Refusing update from remote peer 627363fcfdcc4e4184b92b31038522a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:02.450760 4767 raft_consensus.cc:1275] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 1 FOLLOWER]: Refusing update from remote peer 627363fcfdcc4e4184b92b31038522a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:02.451031 4818 consensus_queue.cc:1048] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "018a36d3c1e54384b555f317b0d5a64f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:02.451165 4814 consensus_queue.cc:1048] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9988f84996a4e198af83663e864eb77" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:12.445947 479 tablet_replica.cc:333] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: stopping tablet replica
I20251211 09:09:12.446012 479 raft_consensus.cc:2243] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:12.446054 479 raft_consensus.cc:2272] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:12.449227 479 ts_tablet_manager.cc:1916] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 09:09:12.450894 479 ts_tablet_manager.cc:1929] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.14146
I20251211 09:09:12.450964 479 log.cc:1199] T ad77f9f25a074eaabd76e1dd246d671a P 627363fcfdcc4e4184b92b31038522a8: Deleting WAL directory at /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1765444027994158-479-0/minicluster-data/ts-0-root/wals/ad77f9f25a074eaabd76e1dd246d671a
I20251211 09:09:12.459744 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:09:12.462288 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:12.464686 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:09:12.465596 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:09:12.468254 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:12.468379 479 tablet_replica.cc:333] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f: stopping tablet replica
I20251211 09:09:12.468442 479 raft_consensus.cc:2243] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:12.468520 479 raft_consensus.cc:2272] T ad77f9f25a074eaabd76e1dd246d671a P 018a36d3c1e54384b555f317b0d5a64f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:12.471664 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:09:12.472420 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:09:12.475031 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:12.475121 479 tablet_replica.cc:333] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77: stopping tablet replica
I20251211 09:09:12.475181 479 raft_consensus.cc:2243] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:12.475234 479 raft_consensus.cc:2272] T ad77f9f25a074eaabd76e1dd246d671a P b9988f84996a4e198af83663e864eb77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:12.497977 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:09:12.498910 479 master.cc:561] Master@127.0.119.254:39791 shutting down...
I20251211 09:09:12.501405 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:12.501473 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:12.501492 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 90bc61593e8e444b87c9257bb4caaa80: stopping tablet replica
I20251211 09:09:12.513180 479 master.cc:583] Master@127.0.119.254:39791 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyTabletNotRunning (10396 ms)
[ RUN ] TxnParticipantITest.TestProxyTabletNotFound
I20251211 09:09:12.527796 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:45605
I20251211 09:09:12.527978 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:12.529417 4867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:12.529462 479 server_base.cc:1047] running on GCE node
W20251211 09:09:12.529564 4869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:12.529436 4866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:12.529789 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:12.529826 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:12.529839 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444152529839 us; error 0 us; skew 500 ppm
I20251211 09:09:12.530347 479 webserver.cc:492] Webserver started at http://127.0.119.254:36645/ using document root <none> and password file <none>
I20251211 09:09:12.530419 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:12.530462 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:12.530512 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:12.530771 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "930b86782a7f4bdb899cba6d67c02cd2"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.531589 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:12.532080 4874 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.532194 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.532238 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "930b86782a7f4bdb899cba6d67c02cd2"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.532289 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:12.553715 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:12.553923 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:12.556310 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:45605
I20251211 09:09:12.564114 4926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:45605 every 8 connection(s)
I20251211 09:09:12.564229 4927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:12.565366 4927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2: Bootstrap starting.
I20251211 09:09:12.565651 4927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:12.566159 4927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2: No bootstrap required, opened a new log
I20251211 09:09:12.566278 4927 raft_consensus.cc:359] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b86782a7f4bdb899cba6d67c02cd2" member_type: VOTER }
I20251211 09:09:12.566334 4927 raft_consensus.cc:385] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:12.566349 4927 raft_consensus.cc:740] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930b86782a7f4bdb899cba6d67c02cd2, State: Initialized, Role: FOLLOWER
I20251211 09:09:12.566403 4927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b86782a7f4bdb899cba6d67c02cd2" member_type: VOTER }
I20251211 09:09:12.566443 4927 raft_consensus.cc:399] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:09:12.566463 4927 raft_consensus.cc:493] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:09:12.566494 4927 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:12.566977 4927 raft_consensus.cc:515] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b86782a7f4bdb899cba6d67c02cd2" member_type: VOTER }
I20251211 09:09:12.567028 4927 leader_election.cc:304] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 930b86782a7f4bdb899cba6d67c02cd2; no voters:
I20251211 09:09:12.567139 4927 leader_election.cc:290] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:09:12.567189 4930 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:12.567305 4927 sys_catalog.cc:565] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:09:12.567330 4930 raft_consensus.cc:697] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 930b86782a7f4bdb899cba6d67c02cd2, State: Running, Role: LEADER
I20251211 09:09:12.567447 4930 consensus_queue.cc:237] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b86782a7f4bdb899cba6d67c02cd2" member_type: VOTER }
I20251211 09:09:12.567657 4931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "930b86782a7f4bdb899cba6d67c02cd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b86782a7f4bdb899cba6d67c02cd2" member_type: VOTER } }
I20251211 09:09:12.567772 4931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:12.567659 4932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 930b86782a7f4bdb899cba6d67c02cd2. Latest consensus state: current_term: 1 leader_uuid: "930b86782a7f4bdb899cba6d67c02cd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "930b86782a7f4bdb899cba6d67c02cd2" member_type: VOTER } }
I20251211 09:09:12.567974 4932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:12.568040 4935 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:09:12.568181 4935 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:09:12.568662 4935 catalog_manager.cc:1357] Generated new cluster ID: e29a99cfc6f94a7092c91574260579ee
I20251211 09:09:12.568689 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:09:12.568722 4935 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:09:12.586030 4935 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:09:12.586478 4935 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:09:12.593274 4935 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2: Generated new TSK 0
I20251211 09:09:12.593351 4935 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:09:12.600708 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:12.602144 4949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:12.602162 4948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:12.602315 479 server_base.cc:1047] running on GCE node
W20251211 09:09:12.602272 4951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:12.602540 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:12.602572 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:12.602584 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444152602585 us; error 0 us; skew 500 ppm
I20251211 09:09:12.603098 479 webserver.cc:492] Webserver started at http://127.0.119.193:45191/ using document root <none> and password file <none>
I20251211 09:09:12.603165 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:12.603199 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:12.603240 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:12.603468 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "a7d927b64bad487689bf59649c909af0"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.604312 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:12.604722 4956 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.604866 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.604912 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "a7d927b64bad487689bf59649c909af0"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.604951 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:12.612717 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:12.612874 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:12.613013 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:12.613163 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:12.613185 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.613212 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:12.613230 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.615833 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:34079
I20251211 09:09:12.615881 5019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:34079 every 8 connection(s)
I20251211 09:09:12.616194 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:12.617482 5027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:12.617522 5025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:12.617643 5024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:12.617883 479 server_base.cc:1047] running on GCE node
I20251211 09:09:12.618021 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:12.618053 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:12.618077 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444152618078 us; error 0 us; skew 500 ppm
I20251211 09:09:12.618809 479 webserver.cc:492] Webserver started at http://127.0.119.194:41341/ using document root <none> and password file <none>
I20251211 09:09:12.618902 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:12.618952 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:12.619012 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:12.619302 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "5b455ec3868742538695bb20e1b9faef"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.619747 5020 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45605
I20251211 09:09:12.619812 5020 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:12.619926 5020 heartbeater.cc:507] Master 127.0.119.254:45605 requested a full tablet report, sending...
I20251211 09:09:12.620152 4891 ts_manager.cc:194] Registered new tserver with Master: a7d927b64bad487689bf59649c909af0 (127.0.119.193:34079)
I20251211 09:09:12.620438 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20251211 09:09:12.620916 5032 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.620945 4891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41146
I20251211 09:09:12.621062 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.621119 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "5b455ec3868742538695bb20e1b9faef"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.621168 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:12.647377 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:12.647591 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:12.647758 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:12.647981 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:12.648008 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.648046 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:12.648077 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.650876 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:43569
I20251211 09:09:12.650924 5095 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:43569 every 8 connection(s)
I20251211 09:09:12.651259 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:12.652578 5099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:12.652837 479 server_base.cc:1047] running on GCE node
W20251211 09:09:12.652666 5102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:12.652587 5100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:12.653115 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:12.653159 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:12.653178 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444152653179 us; error 0 us; skew 500 ppm
I20251211 09:09:12.653879 479 webserver.cc:492] Webserver started at http://127.0.119.195:36843/ using document root <none> and password file <none>
I20251211 09:09:12.653980 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:12.654031 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:12.654079 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:12.654414 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "0d0ef32ea3284d8bb804dc121689e465"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.654493 5096 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45605
I20251211 09:09:12.654565 5096 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:12.654668 5096 heartbeater.cc:507] Master 127.0.119.254:45605 requested a full tablet report, sending...
I20251211 09:09:12.654881 4891 ts_manager.cc:194] Registered new tserver with Master: 5b455ec3868742538695bb20e1b9faef (127.0.119.194:43569)
I20251211 09:09:12.655187 4891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41156
I20251211 09:09:12.655596 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:12.656078 5107 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.656201 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.656242 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "0d0ef32ea3284d8bb804dc121689e465"
format_stamp: "Formatted at 2025-12-11 09:09:12 on dist-test-slave-hb70"
I20251211 09:09:12.656286 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:12.664829 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:12.665031 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:12.665171 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:12.665380 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:12.665409 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.665438 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:12.665467 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.668709 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:42159
I20251211 09:09:12.668781 5170 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:42159 every 8 connection(s)
I20251211 09:09:12.671463 5171 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45605
I20251211 09:09:12.671514 5171 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:12.671602 5171 heartbeater.cc:507] Master 127.0.119.254:45605 requested a full tablet report, sending...
I20251211 09:09:12.671772 4891 ts_manager.cc:194] Registered new tserver with Master: 0d0ef32ea3284d8bb804dc121689e465 (127.0.119.195:42159)
I20251211 09:09:12.672083 4891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41158
I20251211 09:09:12.672211 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00331385s
I20251211 09:09:12.672567 479 test_util.cc:276] Using random seed: 2140619063
I20251211 09:09:12.677135 4891 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41168:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:09:12.677284 4891 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:09:12.681735 5135 tablet_service.cc:1505] Processing CreateTablet for tablet bf881aaa906f407bbf2cffe82575ce85 (DEFAULT_TABLE table=test-workload [id=deb9a738fe114478a01dd18a0f41ecd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:12.681854 5135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf881aaa906f407bbf2cffe82575ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:12.681970 4984 tablet_service.cc:1505] Processing CreateTablet for tablet bf881aaa906f407bbf2cffe82575ce85 (DEFAULT_TABLE table=test-workload [id=deb9a738fe114478a01dd18a0f41ecd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:12.682085 4984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf881aaa906f407bbf2cffe82575ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:12.682987 5186 tablet_bootstrap.cc:492] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465: Bootstrap starting.
I20251211 09:09:12.683473 5186 tablet_bootstrap.cc:654] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:12.683857 5187 tablet_bootstrap.cc:492] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0: Bootstrap starting.
I20251211 09:09:12.683861 5060 tablet_service.cc:1505] Processing CreateTablet for tablet bf881aaa906f407bbf2cffe82575ce85 (DEFAULT_TABLE table=test-workload [id=deb9a738fe114478a01dd18a0f41ecd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:12.684005 5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf881aaa906f407bbf2cffe82575ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:12.684108 5186 tablet_bootstrap.cc:492] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465: No bootstrap required, opened a new log
I20251211 09:09:12.684154 5186 ts_tablet_manager.cc:1403] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:12.684293 5187 tablet_bootstrap.cc:654] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:12.684295 5186 raft_consensus.cc:359] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.684427 5186 raft_consensus.cc:385] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:12.684449 5186 raft_consensus.cc:740] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d0ef32ea3284d8bb804dc121689e465, State: Initialized, Role: FOLLOWER
I20251211 09:09:12.684535 5186 consensus_queue.cc:260] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.684695 5186 ts_tablet_manager.cc:1434] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:12.684772 5171 heartbeater.cc:499] Master 127.0.119.254:45605 was elected leader, sending a full tablet report...
I20251211 09:09:12.684909 5187 tablet_bootstrap.cc:492] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0: No bootstrap required, opened a new log
I20251211 09:09:12.684959 5187 ts_tablet_manager.cc:1403] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:12.685099 5187 raft_consensus.cc:359] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.685163 5187 raft_consensus.cc:385] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:12.685199 5187 raft_consensus.cc:740] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7d927b64bad487689bf59649c909af0, State: Initialized, Role: FOLLOWER
I20251211 09:09:12.685297 5187 consensus_queue.cc:260] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.685393 5191 tablet_bootstrap.cc:492] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef: Bootstrap starting.
I20251211 09:09:12.685462 5187 ts_tablet_manager.cc:1434] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251211 09:09:12.685544 5020 heartbeater.cc:499] Master 127.0.119.254:45605 was elected leader, sending a full tablet report...
I20251211 09:09:12.686033 5191 tablet_bootstrap.cc:654] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:12.686538 5191 tablet_bootstrap.cc:492] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef: No bootstrap required, opened a new log
I20251211 09:09:12.686576 5191 ts_tablet_manager.cc:1403] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:12.686677 5191 raft_consensus.cc:359] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.686728 5191 raft_consensus.cc:385] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:12.686741 5191 raft_consensus.cc:740] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b455ec3868742538695bb20e1b9faef, State: Initialized, Role: FOLLOWER
I20251211 09:09:12.686795 5191 consensus_queue.cc:260] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.686936 5191 ts_tablet_manager.cc:1434] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:12.686975 5096 heartbeater.cc:499] Master 127.0.119.254:45605 was elected leader, sending a full tablet report...
I20251211 09:09:12.763881 5194 raft_consensus.cc:493] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:09:12.764008 5194 raft_consensus.cc:515] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.764194 5194 leader_election.cc:290] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d0ef32ea3284d8bb804dc121689e465 (127.0.119.195:42159), a7d927b64bad487689bf59649c909af0 (127.0.119.193:34079)
I20251211 09:09:12.766642 5145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf881aaa906f407bbf2cffe82575ce85" candidate_uuid: "5b455ec3868742538695bb20e1b9faef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0ef32ea3284d8bb804dc121689e465" is_pre_election: true
I20251211 09:09:12.766752 5145 raft_consensus.cc:2468] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b455ec3868742538695bb20e1b9faef in term 0.
I20251211 09:09:12.766938 5036 leader_election.cc:304] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0ef32ea3284d8bb804dc121689e465, 5b455ec3868742538695bb20e1b9faef; no voters:
I20251211 09:09:12.767024 5194 raft_consensus.cc:2804] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:09:12.767059 5194 raft_consensus.cc:493] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:09:12.767046 4994 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf881aaa906f407bbf2cffe82575ce85" candidate_uuid: "5b455ec3868742538695bb20e1b9faef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7d927b64bad487689bf59649c909af0" is_pre_election: true
I20251211 09:09:12.767098 5194 raft_consensus.cc:3060] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:12.767127 4994 raft_consensus.cc:2468] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b455ec3868742538695bb20e1b9faef in term 0.
I20251211 09:09:12.767765 5194 raft_consensus.cc:515] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.767877 5194 leader_election.cc:290] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [CANDIDATE]: Term 1 election: Requested vote from peers 0d0ef32ea3284d8bb804dc121689e465 (127.0.119.195:42159), a7d927b64bad487689bf59649c909af0 (127.0.119.193:34079)
I20251211 09:09:12.768008 5145 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf881aaa906f407bbf2cffe82575ce85" candidate_uuid: "5b455ec3868742538695bb20e1b9faef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d0ef32ea3284d8bb804dc121689e465"
I20251211 09:09:12.768071 5145 raft_consensus.cc:3060] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:12.768057 4994 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf881aaa906f407bbf2cffe82575ce85" candidate_uuid: "5b455ec3868742538695bb20e1b9faef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7d927b64bad487689bf59649c909af0"
I20251211 09:09:12.768154 4994 raft_consensus.cc:3060] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:12.768859 5145 raft_consensus.cc:2468] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b455ec3868742538695bb20e1b9faef in term 1.
I20251211 09:09:12.768847 4994 raft_consensus.cc:2468] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b455ec3868742538695bb20e1b9faef in term 1.
I20251211 09:09:12.769043 5036 leader_election.cc:304] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d0ef32ea3284d8bb804dc121689e465, 5b455ec3868742538695bb20e1b9faef; no voters:
I20251211 09:09:12.769120 5194 raft_consensus.cc:2804] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:12.769281 5194 raft_consensus.cc:697] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 1 LEADER]: Becoming Leader. State: Replica: 5b455ec3868742538695bb20e1b9faef, State: Running, Role: LEADER
I20251211 09:09:12.769351 5194 consensus_queue.cc:237] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } }
I20251211 09:09:12.769906 4891 catalog_manager.cc:5654] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b455ec3868742538695bb20e1b9faef (127.0.119.194). New cstate: current_term: 1 leader_uuid: "5b455ec3868742538695bb20e1b9faef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b455ec3868742538695bb20e1b9faef" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43569 } health_report { overall_health: HEALTHY } } }
I20251211 09:09:12.779090 4994 raft_consensus.cc:1275] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 1 FOLLOWER]: Refusing update from remote peer 5b455ec3868742538695bb20e1b9faef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:12.779090 5145 raft_consensus.cc:1275] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 1 FOLLOWER]: Refusing update from remote peer 5b455ec3868742538695bb20e1b9faef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:12.779341 5196 consensus_queue.cc:1048] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7d927b64bad487689bf59649c909af0" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:12.779453 5194 consensus_queue.cc:1048] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d0ef32ea3284d8bb804dc121689e465" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:22.788815 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:09:22.791445 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:22.791536 479 tablet_replica.cc:333] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0: stopping tablet replica
I20251211 09:09:22.791587 479 raft_consensus.cc:2243] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:22.791638 479 raft_consensus.cc:2272] T bf881aaa906f407bbf2cffe82575ce85 P a7d927b64bad487689bf59649c909af0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:22.797703 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:09:22.798492 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:09:22.801795 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:22.801889 479 tablet_replica.cc:333] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef: stopping tablet replica
I20251211 09:09:22.801937 479 raft_consensus.cc:2243] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:22.801990 479 raft_consensus.cc:2272] T bf881aaa906f407bbf2cffe82575ce85 P 5b455ec3868742538695bb20e1b9faef [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:22.805480 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:09:22.806183 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:09:22.809756 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:22.809860 479 tablet_replica.cc:333] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465: stopping tablet replica
I20251211 09:09:22.809930 479 raft_consensus.cc:2243] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:22.809983 479 raft_consensus.cc:2272] T bf881aaa906f407bbf2cffe82575ce85 P 0d0ef32ea3284d8bb804dc121689e465 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:22.833715 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:09:22.834546 479 master.cc:561] Master@127.0.119.254:45605 shutting down...
I20251211 09:09:22.836874 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:22.836934 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:22.836951 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 930b86782a7f4bdb899cba6d67c02cd2: stopping tablet replica
I20251211 09:09:22.849114 479 master.cc:583] Master@127.0.119.254:45605 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyTabletNotFound (10339 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientGetMetadata
I20251211 09:09:22.867187 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:38875
I20251211 09:09:22.867333 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:22.868450 5238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:22.868505 5241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:22.868614 479 server_base.cc:1047] running on GCE node
W20251211 09:09:22.868520 5239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:22.868806 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:22.868839 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:22.868861 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444162868860 us; error 0 us; skew 500 ppm
I20251211 09:09:22.869393 479 webserver.cc:492] Webserver started at http://127.0.119.254:37307/ using document root <none> and password file <none>
I20251211 09:09:22.869472 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:22.869521 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:22.869570 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:22.869887 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "51b68b67ab8043ceba1cb1df2cd69de5"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.870682 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:09:22.871093 5246 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.871218 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.871261 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "51b68b67ab8043ceba1cb1df2cd69de5"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.871310 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:22.876194 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:22.876345 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:22.878713 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:38875
I20251211 09:09:22.883431 5298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:38875 every 8 connection(s)
I20251211 09:09:22.883622 5299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:22.884567 5299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5: Bootstrap starting.
I20251211 09:09:22.884826 5299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:22.885303 5299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5: No bootstrap required, opened a new log
I20251211 09:09:22.885419 5299 raft_consensus.cc:359] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" member_type: VOTER }
I20251211 09:09:22.885462 5299 raft_consensus.cc:385] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:22.885475 5299 raft_consensus.cc:740] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51b68b67ab8043ceba1cb1df2cd69de5, State: Initialized, Role: FOLLOWER
I20251211 09:09:22.885524 5299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" member_type: VOTER }
I20251211 09:09:22.885557 5299 raft_consensus.cc:399] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:09:22.885582 5299 raft_consensus.cc:493] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:09:22.885607 5299 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:22.886068 5299 raft_consensus.cc:515] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" member_type: VOTER }
I20251211 09:09:22.886118 5299 leader_election.cc:304] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51b68b67ab8043ceba1cb1df2cd69de5; no voters:
I20251211 09:09:22.886209 5299 leader_election.cc:290] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:09:22.886251 5302 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:22.886343 5299 sys_catalog.cc:565] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:09:22.886359 5302 raft_consensus.cc:697] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 1 LEADER]: Becoming Leader. State: Replica: 51b68b67ab8043ceba1cb1df2cd69de5, State: Running, Role: LEADER
I20251211 09:09:22.886422 5302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" member_type: VOTER }
I20251211 09:09:22.886648 5304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" member_type: VOTER } }
I20251211 09:09:22.886673 5303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51b68b67ab8043ceba1cb1df2cd69de5. Latest consensus state: current_term: 1 leader_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b68b67ab8043ceba1cb1df2cd69de5" member_type: VOTER } }
I20251211 09:09:22.886801 5303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:22.886943 5310 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:09:22.886981 5304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:22.887089 5310 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:09:22.887589 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:09:22.887599 5310 catalog_manager.cc:1357] Generated new cluster ID: 99ac39da3f48434bb4bb16e75d59b5d4
I20251211 09:09:22.887666 5310 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:09:22.910396 5310 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:09:22.910818 5310 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:09:22.915957 5310 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5: Generated new TSK 0
I20251211 09:09:22.916033 5310 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:09:22.919286 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:22.920563 5320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:22.920630 5323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:22.920684 479 server_base.cc:1047] running on GCE node
W20251211 09:09:22.920787 5321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:22.920913 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:22.920949 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:22.920962 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444162920963 us; error 0 us; skew 500 ppm
I20251211 09:09:22.921562 479 webserver.cc:492] Webserver started at http://127.0.119.193:46731/ using document root <none> and password file <none>
I20251211 09:09:22.921643 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:22.921689 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:22.921742 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:22.921993 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "b15c2396a6d44176b112d58f51a53b76"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.923439 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:22.923900 5328 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.924018 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.924062 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "b15c2396a6d44176b112d58f51a53b76"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.924110 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:22.938040 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:22.938211 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:22.938344 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:22.938531 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:22.938558 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.938593 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:22.938620 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.941326 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:34289
I20251211 09:09:22.941720 5391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:34289 every 8 connection(s)
I20251211 09:09:22.941841 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:22.942864 5396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:22.942967 5397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:22.943189 5399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:22.943346 479 server_base.cc:1047] running on GCE node
I20251211 09:09:22.943457 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:22.943488 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:22.943511 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444162943510 us; error 0 us; skew 500 ppm
I20251211 09:09:22.944180 479 webserver.cc:492] Webserver started at http://127.0.119.194:38041/ using document root <none> and password file <none>
I20251211 09:09:22.944254 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:22.944307 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:22.944353 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:22.944605 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "cd57ce6029244ae8994f1cff9215a55d"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.945472 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:22.945583 5392 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38875
I20251211 09:09:22.945642 5392 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:22.945745 5392 heartbeater.cc:507] Master 127.0.119.254:38875 requested a full tablet report, sending...
I20251211 09:09:22.945994 5263 ts_manager.cc:194] Registered new tserver with Master: b15c2396a6d44176b112d58f51a53b76 (127.0.119.193:34289)
I20251211 09:09:22.946004 5404 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.946177 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.946219 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "cd57ce6029244ae8994f1cff9215a55d"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.946270 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:22.946686 5263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54338
I20251211 09:09:22.953138 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:22.953346 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:22.953466 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:22.953619 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:22.953642 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.953670 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:22.953696 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.956249 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:33891
I20251211 09:09:22.956298 5467 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:33891 every 8 connection(s)
I20251211 09:09:22.956605 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:22.957692 5471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:22.957922 5474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:22.958016 479 server_base.cc:1047] running on GCE node
W20251211 09:09:22.958925 5472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:22.959116 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:22.959146 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:22.959167 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444162959166 us; error 0 us; skew 500 ppm
I20251211 09:09:22.959661 5468 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38875
I20251211 09:09:22.959692 479 webserver.cc:492] Webserver started at http://127.0.119.195:43585/ using document root <none> and password file <none>
I20251211 09:09:22.959720 5468 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:22.959767 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:22.959810 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:22.959815 5468 heartbeater.cc:507] Master 127.0.119.254:38875 requested a full tablet report, sending...
I20251211 09:09:22.959862 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:22.960017 5263 ts_manager.cc:194] Registered new tserver with Master: cd57ce6029244ae8994f1cff9215a55d (127.0.119.194:33891)
I20251211 09:09:22.960129 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "541162dbdd564c0faf4ea33c9ac469d8"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.960287 5263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54344
I20251211 09:09:22.960945 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:22.961371 5479 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.961480 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.961519 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "541162dbdd564c0faf4ea33c9ac469d8"
format_stamp: "Formatted at 2025-12-11 09:09:22 on dist-test-slave-hb70"
I20251211 09:09:22.961560 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:22.984241 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:22.984428 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:22.984580 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:22.984753 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:22.984784 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.984820 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:22.984848 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:22.987903 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:44677
I20251211 09:09:22.987955 5542 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:44677 every 8 connection(s)
I20251211 09:09:22.990521 5543 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38875
I20251211 09:09:22.990566 5543 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:22.990649 5543 heartbeater.cc:507] Master 127.0.119.254:38875 requested a full tablet report, sending...
I20251211 09:09:22.990835 5263 ts_manager.cc:194] Registered new tserver with Master: 541162dbdd564c0faf4ea33c9ac469d8 (127.0.119.195:44677)
I20251211 09:09:22.991132 5263 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54346
I20251211 09:09:22.991395 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003314502s
I20251211 09:09:22.991714 479 test_util.cc:276] Using random seed: -2144029087
I20251211 09:09:22.995743 5263 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54348:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:09:22.995879 5263 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:09:22.999848 5507 tablet_service.cc:1505] Processing CreateTablet for tablet b5a8785685754a8585241c9ba2d9c638 (DEFAULT_TABLE table=test-workload [id=f87ecb7c5d994a30bebe0bef9d0853e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:22.999971 5507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a8785685754a8585241c9ba2d9c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:23.000973 5432 tablet_service.cc:1505] Processing CreateTablet for tablet b5a8785685754a8585241c9ba2d9c638 (DEFAULT_TABLE table=test-workload [id=f87ecb7c5d994a30bebe0bef9d0853e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:23.001065 5432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a8785685754a8585241c9ba2d9c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:23.001317 5558 tablet_bootstrap.cc:492] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8: Bootstrap starting.
I20251211 09:09:23.001325 5356 tablet_service.cc:1505] Processing CreateTablet for tablet b5a8785685754a8585241c9ba2d9c638 (DEFAULT_TABLE table=test-workload [id=f87ecb7c5d994a30bebe0bef9d0853e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:23.001471 5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a8785685754a8585241c9ba2d9c638. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:23.001699 5558 tablet_bootstrap.cc:654] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:23.002321 5558 tablet_bootstrap.cc:492] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8: No bootstrap required, opened a new log
I20251211 09:09:23.002455 5558 ts_tablet_manager.cc:1403] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:23.002652 5561 tablet_bootstrap.cc:492] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76: Bootstrap starting.
I20251211 09:09:23.002628 5560 tablet_bootstrap.cc:492] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d: Bootstrap starting.
I20251211 09:09:23.002640 5558 raft_consensus.cc:359] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.002847 5558 raft_consensus.cc:385] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:23.002887 5558 raft_consensus.cc:740] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 541162dbdd564c0faf4ea33c9ac469d8, State: Initialized, Role: FOLLOWER
I20251211 09:09:23.002957 5558 consensus_queue.cc:260] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.003103 5560 tablet_bootstrap.cc:654] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:23.003137 5558 ts_tablet_manager.cc:1434] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:23.003103 5561 tablet_bootstrap.cc:654] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:23.003268 5543 heartbeater.cc:499] Master 127.0.119.254:38875 was elected leader, sending a full tablet report...
I20251211 09:09:23.003754 5560 tablet_bootstrap.cc:492] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d: No bootstrap required, opened a new log
I20251211 09:09:23.003816 5560 ts_tablet_manager.cc:1403] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:23.003866 5561 tablet_bootstrap.cc:492] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76: No bootstrap required, opened a new log
I20251211 09:09:23.003913 5561 ts_tablet_manager.cc:1403] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:23.003963 5560 raft_consensus.cc:359] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.004029 5560 raft_consensus.cc:385] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:23.004065 5560 raft_consensus.cc:740] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd57ce6029244ae8994f1cff9215a55d, State: Initialized, Role: FOLLOWER
I20251211 09:09:23.004035 5561 raft_consensus.cc:359] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.004115 5561 raft_consensus.cc:385] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:23.004145 5561 raft_consensus.cc:740] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b15c2396a6d44176b112d58f51a53b76, State: Initialized, Role: FOLLOWER
I20251211 09:09:23.004137 5560 consensus_queue.cc:260] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.004235 5561 consensus_queue.cc:260] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.004307 5560 ts_tablet_manager.cc:1434] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:09:23.004341 5468 heartbeater.cc:499] Master 127.0.119.254:38875 was elected leader, sending a full tablet report...
I20251211 09:09:23.004385 5561 ts_tablet_manager.cc:1434] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:09:23.004434 5392 heartbeater.cc:499] Master 127.0.119.254:38875 was elected leader, sending a full tablet report...
I20251211 09:09:23.052203 5562 raft_consensus.cc:493] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:09:23.052304 5562 raft_consensus.cc:515] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.052501 5562 leader_election.cc:290] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd57ce6029244ae8994f1cff9215a55d (127.0.119.194:33891), b15c2396a6d44176b112d58f51a53b76 (127.0.119.193:34289)
I20251211 09:09:23.054998 5442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5a8785685754a8585241c9ba2d9c638" candidate_uuid: "541162dbdd564c0faf4ea33c9ac469d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd57ce6029244ae8994f1cff9215a55d" is_pre_election: true
I20251211 09:09:23.055088 5442 raft_consensus.cc:2468] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 541162dbdd564c0faf4ea33c9ac469d8 in term 0.
I20251211 09:09:23.055120 5366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5a8785685754a8585241c9ba2d9c638" candidate_uuid: "541162dbdd564c0faf4ea33c9ac469d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b15c2396a6d44176b112d58f51a53b76" is_pre_election: true
I20251211 09:09:23.055184 5366 raft_consensus.cc:2468] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 541162dbdd564c0faf4ea33c9ac469d8 in term 0.
I20251211 09:09:23.055230 5480 leader_election.cc:304] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 541162dbdd564c0faf4ea33c9ac469d8, cd57ce6029244ae8994f1cff9215a55d; no voters:
I20251211 09:09:23.055348 5562 raft_consensus.cc:2804] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:09:23.055387 5562 raft_consensus.cc:493] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:09:23.055402 5562 raft_consensus.cc:3060] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:23.056011 5562 raft_consensus.cc:515] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.056139 5562 leader_election.cc:290] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [CANDIDATE]: Term 1 election: Requested vote from peers cd57ce6029244ae8994f1cff9215a55d (127.0.119.194:33891), b15c2396a6d44176b112d58f51a53b76 (127.0.119.193:34289)
I20251211 09:09:23.056346 5442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5a8785685754a8585241c9ba2d9c638" candidate_uuid: "541162dbdd564c0faf4ea33c9ac469d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd57ce6029244ae8994f1cff9215a55d"
I20251211 09:09:23.056358 5366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5a8785685754a8585241c9ba2d9c638" candidate_uuid: "541162dbdd564c0faf4ea33c9ac469d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b15c2396a6d44176b112d58f51a53b76"
I20251211 09:09:23.056417 5442 raft_consensus.cc:3060] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:23.056422 5366 raft_consensus.cc:3060] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:23.057109 5366 raft_consensus.cc:2468] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 541162dbdd564c0faf4ea33c9ac469d8 in term 1.
I20251211 09:09:23.057204 5442 raft_consensus.cc:2468] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 541162dbdd564c0faf4ea33c9ac469d8 in term 1.
I20251211 09:09:23.057272 5480 leader_election.cc:304] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 541162dbdd564c0faf4ea33c9ac469d8, b15c2396a6d44176b112d58f51a53b76; no voters:
I20251211 09:09:23.057379 5562 raft_consensus.cc:2804] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:23.057502 5562 raft_consensus.cc:697] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 1 LEADER]: Becoming Leader. State: Replica: 541162dbdd564c0faf4ea33c9ac469d8, State: Running, Role: LEADER
I20251211 09:09:23.057552 5562 consensus_queue.cc:237] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:23.058123 5263 catalog_manager.cc:5654] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 541162dbdd564c0faf4ea33c9ac469d8 (127.0.119.195). New cstate: current_term: 1 leader_uuid: "541162dbdd564c0faf4ea33c9ac469d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } health_report { overall_health: UNKNOWN } } }
I20251211 09:09:23.076347 5366 raft_consensus.cc:1275] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 1 FOLLOWER]: Refusing update from remote peer 541162dbdd564c0faf4ea33c9ac469d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:23.076347 5442 raft_consensus.cc:1275] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 1 FOLLOWER]: Refusing update from remote peer 541162dbdd564c0faf4ea33c9ac469d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:23.076711 5568 consensus_queue.cc:1048] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:23.076800 5562 consensus_queue.cc:1048] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:33.676162 5614 raft_consensus.cc:993] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8: : Instructing follower b15c2396a6d44176b112d58f51a53b76 to start an election
I20251211 09:09:33.676246 5614 raft_consensus.cc:1081] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 1 LEADER]: Signalling peer b15c2396a6d44176b112d58f51a53b76 to start an election
I20251211 09:09:33.676474 5365 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5a8785685754a8585241c9ba2d9c638"
dest_uuid: "b15c2396a6d44176b112d58f51a53b76"
from {username='slave'} at 127.0.0.1:39606
I20251211 09:09:33.676539 5365 raft_consensus.cc:493] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:09:33.676558 5365 raft_consensus.cc:3060] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:09:33.677307 5365 raft_consensus.cc:515] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:33.677457 5365 leader_election.cc:290] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [CANDIDATE]: Term 2 election: Requested vote from peers cd57ce6029244ae8994f1cff9215a55d (127.0.119.194:33891), 541162dbdd564c0faf4ea33c9ac469d8 (127.0.119.195:44677)
I20251211 09:09:33.681159 5517 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5a8785685754a8585241c9ba2d9c638" candidate_uuid: "b15c2396a6d44176b112d58f51a53b76" candidate_term: 2 candidate_status { last_received { term: 1 index: 13797 } } ignore_live_leader: true dest_uuid: "541162dbdd564c0faf4ea33c9ac469d8"
I20251211 09:09:33.681155 5442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5a8785685754a8585241c9ba2d9c638" candidate_uuid: "b15c2396a6d44176b112d58f51a53b76" candidate_term: 2 candidate_status { last_received { term: 1 index: 13797 } } ignore_live_leader: true dest_uuid: "cd57ce6029244ae8994f1cff9215a55d"
I20251211 09:09:33.681274 5517 raft_consensus.cc:3055] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:09:33.681334 5442 raft_consensus.cc:3060] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:09:33.681370 5517 raft_consensus.cc:740] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 541162dbdd564c0faf4ea33c9ac469d8, State: Running, Role: LEADER
I20251211 09:09:33.681439 5517 consensus_queue.cc:260] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13797, Committed index: 13797, Last appended: 1.13797, Last appended by leader: 13797, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:33.681525 5517 raft_consensus.cc:3060] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:09:33.681998 5442 raft_consensus.cc:2468] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15c2396a6d44176b112d58f51a53b76 in term 2.
I20251211 09:09:33.682159 5517 raft_consensus.cc:2468] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15c2396a6d44176b112d58f51a53b76 in term 2.
I20251211 09:09:33.682185 5329 leader_election.cc:304] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b15c2396a6d44176b112d58f51a53b76, cd57ce6029244ae8994f1cff9215a55d; no voters:
I20251211 09:09:33.682386 5620 raft_consensus.cc:2804] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:09:33.682483 5620 raft_consensus.cc:697] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 2 LEADER]: Becoming Leader. State: Replica: b15c2396a6d44176b112d58f51a53b76, State: Running, Role: LEADER
I20251211 09:09:33.682539 5620 consensus_queue.cc:237] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13797, Committed index: 13797, Last appended: 1.13797, Last appended by leader: 13797, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } }
I20251211 09:09:33.682932 5256 catalog_manager.cc:5654] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 reported cstate change: term changed from 1 to 2, leader changed from 541162dbdd564c0faf4ea33c9ac469d8 (127.0.119.195) to b15c2396a6d44176b112d58f51a53b76 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "b15c2396a6d44176b112d58f51a53b76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15c2396a6d44176b112d58f51a53b76" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 34289 } health_report { overall_health: HEALTHY } } }
I20251211 09:09:33.694706 5517 raft_consensus.cc:1275] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 2 FOLLOWER]: Refusing update from remote peer b15c2396a6d44176b112d58f51a53b76: Log matching property violated. Preceding OpId in replica: term: 1 index: 13797. Preceding OpId from leader: term: 2 index: 13799. (index mismatch)
I20251211 09:09:33.694829 5442 raft_consensus.cc:1275] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 2 FOLLOWER]: Refusing update from remote peer b15c2396a6d44176b112d58f51a53b76: Log matching property violated. Preceding OpId in replica: term: 1 index: 13797. Preceding OpId from leader: term: 2 index: 13799. (index mismatch)
I20251211 09:09:33.694900 5621 consensus_queue.cc:1048] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "541162dbdd564c0faf4ea33c9ac469d8" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 44677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13798, Last known committed idx: 13797, Time since last communication: 0.000s
I20251211 09:09:33.695003 5620 consensus_queue.cc:1048] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd57ce6029244ae8994f1cff9215a55d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13798, Last known committed idx: 13797, Time since last communication: 0.000s
I20251211 09:09:33.695739 5629 mvcc.cc:204] Tried to move back new op lower bound from 7231259335452307456 to 7231259335404126208. Current Snapshot: MvccSnapshot[applied={T|T < 7231259335452307456}]
I20251211 09:09:33.701130 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:09:33.704214 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:33.704311 479 tablet_replica.cc:333] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76: stopping tablet replica
I20251211 09:09:33.704372 479 raft_consensus.cc:2243] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:09:33.704429 479 raft_consensus.cc:2272] T b5a8785685754a8585241c9ba2d9c638 P b15c2396a6d44176b112d58f51a53b76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:33.708403 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:09:33.709175 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:09:33.711894 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:33.711988 479 tablet_replica.cc:333] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d: stopping tablet replica
I20251211 09:09:33.712046 479 raft_consensus.cc:2243] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:33.712087 479 raft_consensus.cc:2272] T b5a8785685754a8585241c9ba2d9c638 P cd57ce6029244ae8994f1cff9215a55d [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:33.730621 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:09:33.731407 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:09:33.734311 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:33.734413 479 tablet_replica.cc:333] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8: stopping tablet replica
I20251211 09:09:33.734464 479 raft_consensus.cc:2243] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:33.734510 479 raft_consensus.cc:2272] T b5a8785685754a8585241c9ba2d9c638 P 541162dbdd564c0faf4ea33c9ac469d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:33.756706 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:09:33.757601 479 master.cc:561] Master@127.0.119.254:38875 shutting down...
I20251211 09:09:33.760089 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:33.760164 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:33.760182 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 51b68b67ab8043ceba1cb1df2cd69de5: stopping tablet replica
I20251211 09:09:33.771955 479 master.cc:583] Master@127.0.119.254:38875 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientGetMetadata (10923 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock
I20251211 09:09:33.790855 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:43135
I20251211 09:09:33.791011 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:33.792493 5640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:33.792570 5637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:33.792500 5638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:33.792685 479 server_base.cc:1047] running on GCE node
I20251211 09:09:33.792770 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:33.792801 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:33.792814 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444173792814 us; error 0 us; skew 500 ppm
I20251211 09:09:33.793347 479 webserver.cc:492] Webserver started at http://127.0.119.254:45023/ using document root <none> and password file <none>
I20251211 09:09:33.793411 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:33.793442 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:33.793474 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:33.793689 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "b33865cac2d54c3f9eb2f37663cd4f38"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.794495 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:33.794916 5645 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.795029 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.795092 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "b33865cac2d54c3f9eb2f37663cd4f38"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.795138 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:33.804847 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:33.805038 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:33.807286 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:43135
I20251211 09:09:33.809417 5697 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:43135 every 8 connection(s)
I20251211 09:09:33.809533 5698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:33.810470 5698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38: Bootstrap starting.
I20251211 09:09:33.810721 5698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:33.811151 5698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38: No bootstrap required, opened a new log
I20251211 09:09:33.811260 5698 raft_consensus.cc:359] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" member_type: VOTER }
I20251211 09:09:33.811323 5698 raft_consensus.cc:385] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:33.811337 5698 raft_consensus.cc:740] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b33865cac2d54c3f9eb2f37663cd4f38, State: Initialized, Role: FOLLOWER
I20251211 09:09:33.811383 5698 consensus_queue.cc:260] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" member_type: VOTER }
I20251211 09:09:33.811431 5698 raft_consensus.cc:399] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:09:33.811455 5698 raft_consensus.cc:493] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:09:33.811478 5698 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:33.811924 5698 raft_consensus.cc:515] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" member_type: VOTER }
I20251211 09:09:33.811975 5698 leader_election.cc:304] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b33865cac2d54c3f9eb2f37663cd4f38; no voters:
I20251211 09:09:33.812072 5698 leader_election.cc:290] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:09:33.812126 5701 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:33.812214 5698 sys_catalog.cc:565] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:09:33.812258 5701 raft_consensus.cc:697] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 1 LEADER]: Becoming Leader. State: Replica: b33865cac2d54c3f9eb2f37663cd4f38, State: Running, Role: LEADER
I20251211 09:09:33.812312 5701 consensus_queue.cc:237] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" member_type: VOTER }
I20251211 09:09:33.812510 5702 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" member_type: VOTER } }
I20251211 09:09:33.812516 5703 sys_catalog.cc:455] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b33865cac2d54c3f9eb2f37663cd4f38. Latest consensus state: current_term: 1 leader_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b33865cac2d54c3f9eb2f37663cd4f38" member_type: VOTER } }
I20251211 09:09:33.812602 5702 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:33.812932 5710 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:09:33.812939 5703 sys_catalog.cc:458] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:33.813077 5710 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:09:33.813617 5710 catalog_manager.cc:1357] Generated new cluster ID: 631b30bed2674e37ba88d75495776e8d
I20251211 09:09:33.813617 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:09:33.813666 5710 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:09:33.834236 5710 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:09:33.834667 5710 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:09:33.839115 5710 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38: Generated new TSK 0
I20251211 09:09:33.839190 5710 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:09:33.845475 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:33.846712 5720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:33.846798 5722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:33.846921 479 server_base.cc:1047] running on GCE node
W20251211 09:09:33.846793 5719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:33.847040 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:33.847072 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:33.847101 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444173847094 us; error 0 us; skew 500 ppm
I20251211 09:09:33.847664 479 webserver.cc:492] Webserver started at http://127.0.119.193:34259/ using document root <none> and password file <none>
I20251211 09:09:33.847754 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:33.847798 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:33.847849 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:33.848078 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "a7c56224097f425ea386d0f682084745"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.848834 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:33.849296 5727 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.849427 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.849470 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "a7c56224097f425ea386d0f682084745"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.849516 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:33.873944 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:33.874150 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:33.874307 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:33.874503 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:33.874531 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.874567 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:33.874598 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.877056 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:43611
I20251211 09:09:33.877125 5790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:43611 every 8 connection(s)
I20251211 09:09:33.877444 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:33.878633 5795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:33.878729 5796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:33.878890 5798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:33.879072 479 server_base.cc:1047] running on GCE node
I20251211 09:09:33.879197 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:33.879245 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:33.879262 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444173879262 us; error 0 us; skew 500 ppm
I20251211 09:09:33.879949 479 webserver.cc:492] Webserver started at http://127.0.119.194:46161/ using document root <none> and password file <none>
I20251211 09:09:33.880031 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:33.880091 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:33.880141 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:33.880445 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "b94013c5084e4d6292cbf2f8a0a9c208"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.880803 5791 heartbeater.cc:344] Connected to a master server at 127.0.119.254:43135
I20251211 09:09:33.880863 5791 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:33.880959 5791 heartbeater.cc:507] Master 127.0.119.254:43135 requested a full tablet report, sending...
I20251211 09:09:33.881210 5662 ts_manager.cc:194] Registered new tserver with Master: a7c56224097f425ea386d0f682084745 (127.0.119.193:43611)
I20251211 09:09:33.881489 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:09:33.882041 5803 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.882026 5662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54102
I20251211 09:09:33.882249 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.882299 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "b94013c5084e4d6292cbf2f8a0a9c208"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.882344 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:33.894142 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:33.894356 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:33.894502 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:33.894662 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:33.894686 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.894716 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:33.894740 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.897430 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:37157
I20251211 09:09:33.897472 5866 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:37157 every 8 connection(s)
I20251211 09:09:33.897766 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:33.898970 5870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:33.898980 5871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:33.899071 479 server_base.cc:1047] running on GCE node
W20251211 09:09:33.899305 5873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:33.899494 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:33.899530 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:33.899547 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444173899547 us; error 0 us; skew 500 ppm
I20251211 09:09:33.900138 479 webserver.cc:492] Webserver started at http://127.0.119.195:46717/ using document root <none> and password file <none>
I20251211 09:09:33.900233 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:33.900274 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:33.900316 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:33.900624 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "0f0a217f2e704ecfa4d2846678cb96a0"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.900995 5867 heartbeater.cc:344] Connected to a master server at 127.0.119.254:43135
I20251211 09:09:33.901053 5867 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:33.901139 5867 heartbeater.cc:507] Master 127.0.119.254:43135 requested a full tablet report, sending...
I20251211 09:09:33.901360 5662 ts_manager.cc:194] Registered new tserver with Master: b94013c5084e4d6292cbf2f8a0a9c208 (127.0.119.194:37157)
I20251211 09:09:33.901679 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:33.901728 5662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54118
I20251211 09:09:33.902130 5878 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.902271 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.902313 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "0f0a217f2e704ecfa4d2846678cb96a0"
format_stamp: "Formatted at 2025-12-11 09:09:33 on dist-test-slave-hb70"
I20251211 09:09:33.902360 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:33.916217 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:33.916450 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:33.916651 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:33.916839 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:33.916877 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.916909 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:33.916935 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.920152 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:38479
I20251211 09:09:33.920204 5941 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:38479 every 8 connection(s)
I20251211 09:09:33.922919 5942 heartbeater.cc:344] Connected to a master server at 127.0.119.254:43135
I20251211 09:09:33.922967 5942 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:33.923053 5942 heartbeater.cc:507] Master 127.0.119.254:43135 requested a full tablet report, sending...
I20251211 09:09:33.923241 5662 ts_manager.cc:194] Registered new tserver with Master: 0f0a217f2e704ecfa4d2846678cb96a0 (127.0.119.195:38479)
I20251211 09:09:33.923533 5662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54126
I20251211 09:09:33.923595 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003289245s
I20251211 09:09:33.924024 479 test_util.cc:276] Using random seed: -2133096776
I20251211 09:09:33.927987 5662 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54128:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:09:33.928126 5662 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:09:33.932428 5831 tablet_service.cc:1505] Processing CreateTablet for tablet c628a0aa47a547dc89d47ab2c45d2387 (DEFAULT_TABLE table=test-workload [id=50bbfd74f668400aa4b9270ca16c65bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:33.932580 5831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c628a0aa47a547dc89d47ab2c45d2387. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:33.932596 5755 tablet_service.cc:1505] Processing CreateTablet for tablet c628a0aa47a547dc89d47ab2c45d2387 (DEFAULT_TABLE table=test-workload [id=50bbfd74f668400aa4b9270ca16c65bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:33.932693 5755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c628a0aa47a547dc89d47ab2c45d2387. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:33.934021 5957 tablet_bootstrap.cc:492] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208: Bootstrap starting.
I20251211 09:09:33.934165 5906 tablet_service.cc:1505] Processing CreateTablet for tablet c628a0aa47a547dc89d47ab2c45d2387 (DEFAULT_TABLE table=test-workload [id=50bbfd74f668400aa4b9270ca16c65bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:33.934253 5906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c628a0aa47a547dc89d47ab2c45d2387. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:33.934474 5957 tablet_bootstrap.cc:654] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:33.934820 5958 tablet_bootstrap.cc:492] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745: Bootstrap starting.
I20251211 09:09:33.935020 5957 tablet_bootstrap.cc:492] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208: No bootstrap required, opened a new log
I20251211 09:09:33.935077 5957 ts_tablet_manager.cc:1403] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:33.935249 5958 tablet_bootstrap.cc:654] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:33.935276 5957 raft_consensus.cc:359] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.935387 5957 raft_consensus.cc:385] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:33.935448 5957 raft_consensus.cc:740] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b94013c5084e4d6292cbf2f8a0a9c208, State: Initialized, Role: FOLLOWER
I20251211 09:09:33.935539 5957 consensus_queue.cc:260] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.935722 5957 ts_tablet_manager.cc:1434] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:09:33.935740 5867 heartbeater.cc:499] Master 127.0.119.254:43135 was elected leader, sending a full tablet report...
I20251211 09:09:33.935756 5960 tablet_bootstrap.cc:492] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0: Bootstrap starting.
I20251211 09:09:33.935806 5958 tablet_bootstrap.cc:492] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745: No bootstrap required, opened a new log
I20251211 09:09:33.935921 5958 ts_tablet_manager.cc:1403] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:33.936079 5958 raft_consensus.cc:359] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.936126 5958 raft_consensus.cc:385] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:33.936149 5958 raft_consensus.cc:740] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7c56224097f425ea386d0f682084745, State: Initialized, Role: FOLLOWER
I20251211 09:09:33.936228 5958 consensus_queue.cc:260] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.936264 5960 tablet_bootstrap.cc:654] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:33.936385 5958 ts_tablet_manager.cc:1434] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:33.936404 5791 heartbeater.cc:499] Master 127.0.119.254:43135 was elected leader, sending a full tablet report...
I20251211 09:09:33.936807 5960 tablet_bootstrap.cc:492] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0: No bootstrap required, opened a new log
I20251211 09:09:33.936862 5960 ts_tablet_manager.cc:1403] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:33.937004 5960 raft_consensus.cc:359] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.937055 5960 raft_consensus.cc:385] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:33.937077 5960 raft_consensus.cc:740] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0a217f2e704ecfa4d2846678cb96a0, State: Initialized, Role: FOLLOWER
I20251211 09:09:33.937125 5960 consensus_queue.cc:260] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.937309 5960 ts_tablet_manager.cc:1434] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251211 09:09:33.937317 5942 heartbeater.cc:499] Master 127.0.119.254:43135 was elected leader, sending a full tablet report...
I20251211 09:09:33.972851 5962 raft_consensus.cc:493] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:09:33.972949 5962 raft_consensus.cc:515] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.973158 5962 leader_election.cc:290] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7c56224097f425ea386d0f682084745 (127.0.119.193:43611), 0f0a217f2e704ecfa4d2846678cb96a0 (127.0.119.195:38479)
I20251211 09:09:33.976125 5916 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c628a0aa47a547dc89d47ab2c45d2387" candidate_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" is_pre_election: true
I20251211 09:09:33.976202 5916 raft_consensus.cc:2468] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94013c5084e4d6292cbf2f8a0a9c208 in term 0.
I20251211 09:09:33.976171 5765 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c628a0aa47a547dc89d47ab2c45d2387" candidate_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7c56224097f425ea386d0f682084745" is_pre_election: true
I20251211 09:09:33.976269 5765 raft_consensus.cc:2468] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b94013c5084e4d6292cbf2f8a0a9c208 in term 0.
I20251211 09:09:33.976361 5805 leader_election.cc:304] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0a217f2e704ecfa4d2846678cb96a0, b94013c5084e4d6292cbf2f8a0a9c208; no voters:
I20251211 09:09:33.976462 5962 raft_consensus.cc:2804] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:09:33.976509 5962 raft_consensus.cc:493] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:09:33.976526 5962 raft_consensus.cc:3060] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:33.977144 5962 raft_consensus.cc:515] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.977280 5962 leader_election.cc:290] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [CANDIDATE]: Term 1 election: Requested vote from peers a7c56224097f425ea386d0f682084745 (127.0.119.193:43611), 0f0a217f2e704ecfa4d2846678cb96a0 (127.0.119.195:38479)
I20251211 09:09:33.977391 5916 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c628a0aa47a547dc89d47ab2c45d2387" candidate_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0a217f2e704ecfa4d2846678cb96a0"
I20251211 09:09:33.977447 5916 raft_consensus.cc:3060] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:33.977404 5765 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c628a0aa47a547dc89d47ab2c45d2387" candidate_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7c56224097f425ea386d0f682084745"
I20251211 09:09:33.977476 5765 raft_consensus.cc:3060] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:33.977993 5916 raft_consensus.cc:2468] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94013c5084e4d6292cbf2f8a0a9c208 in term 1.
I20251211 09:09:33.978154 5765 raft_consensus.cc:2468] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b94013c5084e4d6292cbf2f8a0a9c208 in term 1.
I20251211 09:09:33.978156 5805 leader_election.cc:304] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0a217f2e704ecfa4d2846678cb96a0, b94013c5084e4d6292cbf2f8a0a9c208; no voters:
I20251211 09:09:33.978287 5962 raft_consensus.cc:2804] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:33.978430 5962 raft_consensus.cc:697] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 1 LEADER]: Becoming Leader. State: Replica: b94013c5084e4d6292cbf2f8a0a9c208, State: Running, Role: LEADER
I20251211 09:09:33.978480 5962 consensus_queue.cc:237] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:33.978945 5662 catalog_manager.cc:5654] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 reported cstate change: term changed from 0 to 1, leader changed from <none> to b94013c5084e4d6292cbf2f8a0a9c208 (127.0.119.194). New cstate: current_term: 1 leader_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } health_report { overall_health: UNKNOWN } } }
I20251211 09:09:33.994715 5916 raft_consensus.cc:1275] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 1 FOLLOWER]: Refusing update from remote peer b94013c5084e4d6292cbf2f8a0a9c208: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:33.994738 5765 raft_consensus.cc:1275] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 1 FOLLOWER]: Refusing update from remote peer b94013c5084e4d6292cbf2f8a0a9c208: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:33.994979 5967 consensus_queue.cc:1048] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:33.995078 5962 consensus_queue.cc:1048] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:44.531653 5967 raft_consensus.cc:993] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208: : Instructing follower a7c56224097f425ea386d0f682084745 to start an election
I20251211 09:09:44.531733 5967 raft_consensus.cc:1081] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 1 LEADER]: Signalling peer a7c56224097f425ea386d0f682084745 to start an election
I20251211 09:09:44.531900 5764 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c628a0aa47a547dc89d47ab2c45d2387"
dest_uuid: "a7c56224097f425ea386d0f682084745"
from {username='slave'} at 127.0.0.1:34618
I20251211 09:09:44.531982 5764 raft_consensus.cc:493] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:09:44.532004 5764 raft_consensus.cc:3060] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:09:44.532673 5764 raft_consensus.cc:515] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:44.532827 5764 leader_election.cc:290] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [CANDIDATE]: Term 2 election: Requested vote from peers b94013c5084e4d6292cbf2f8a0a9c208 (127.0.119.194:37157), 0f0a217f2e704ecfa4d2846678cb96a0 (127.0.119.195:38479)
I20251211 09:09:44.535553 5916 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c628a0aa47a547dc89d47ab2c45d2387" candidate_uuid: "a7c56224097f425ea386d0f682084745" candidate_term: 2 candidate_status { last_received { term: 1 index: 13946 } } ignore_live_leader: true dest_uuid: "0f0a217f2e704ecfa4d2846678cb96a0"
I20251211 09:09:44.535632 5916 raft_consensus.cc:3060] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:09:44.535558 5841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c628a0aa47a547dc89d47ab2c45d2387" candidate_uuid: "a7c56224097f425ea386d0f682084745" candidate_term: 2 candidate_status { last_received { term: 1 index: 13946 } } ignore_live_leader: true dest_uuid: "b94013c5084e4d6292cbf2f8a0a9c208"
I20251211 09:09:44.535672 5841 raft_consensus.cc:3055] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:09:44.535712 5841 raft_consensus.cc:740] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b94013c5084e4d6292cbf2f8a0a9c208, State: Running, Role: LEADER
I20251211 09:09:44.535778 5841 consensus_queue.cc:260] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13946, Committed index: 13946, Last appended: 1.13946, Last appended by leader: 13946, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:44.535849 5841 raft_consensus.cc:3060] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:09:44.536321 5916 raft_consensus.cc:2468] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7c56224097f425ea386d0f682084745 in term 2.
I20251211 09:09:44.536468 5841 raft_consensus.cc:2468] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7c56224097f425ea386d0f682084745 in term 2.
I20251211 09:09:44.536532 5729 leader_election.cc:304] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f0a217f2e704ecfa4d2846678cb96a0, a7c56224097f425ea386d0f682084745; no voters:
I20251211 09:09:44.536716 6020 raft_consensus.cc:2804] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:09:44.536837 6020 raft_consensus.cc:697] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 2 LEADER]: Becoming Leader. State: Replica: a7c56224097f425ea386d0f682084745, State: Running, Role: LEADER
I20251211 09:09:44.536899 6020 consensus_queue.cc:237] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13946, Committed index: 13946, Last appended: 1.13946, Last appended by leader: 13946, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } }
I20251211 09:09:44.537333 5662 catalog_manager.cc:5654] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 reported cstate change: term changed from 1 to 2, leader changed from b94013c5084e4d6292cbf2f8a0a9c208 (127.0.119.194) to a7c56224097f425ea386d0f682084745 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "a7c56224097f425ea386d0f682084745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7c56224097f425ea386d0f682084745" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 43611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 } health_report { overall_health: UNKNOWN } } }
I20251211 09:09:44.547425 5841 raft_consensus.cc:1275] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 2 FOLLOWER]: Refusing update from remote peer a7c56224097f425ea386d0f682084745: Log matching property violated. Preceding OpId in replica: term: 1 index: 13946. Preceding OpId from leader: term: 2 index: 13948. (index mismatch)
I20251211 09:09:44.547456 5916 raft_consensus.cc:1275] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 2 FOLLOWER]: Refusing update from remote peer a7c56224097f425ea386d0f682084745: Log matching property violated. Preceding OpId in replica: term: 1 index: 13946. Preceding OpId from leader: term: 2 index: 13948. (index mismatch)
I20251211 09:09:44.547617 6020 consensus_queue.cc:1048] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0a217f2e704ecfa4d2846678cb96a0" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 38479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13947, Last known committed idx: 13946, Time since last communication: 0.000s
I20251211 09:09:44.547704 6021 consensus_queue.cc:1048] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b94013c5084e4d6292cbf2f8a0a9c208" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13947, Last known committed idx: 13946, Time since last communication: 0.000s
I20251211 09:09:44.552558 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:09:44.555169 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:44.555275 479 tablet_replica.cc:333] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745: stopping tablet replica
I20251211 09:09:44.555330 479 raft_consensus.cc:2243] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:09:44.555367 479 raft_consensus.cc:2272] T c628a0aa47a547dc89d47ab2c45d2387 P a7c56224097f425ea386d0f682084745 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:44.568739 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:09:44.569576 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:09:44.572044 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:44.572147 479 tablet_replica.cc:333] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208: stopping tablet replica
I20251211 09:09:44.572204 479 raft_consensus.cc:2243] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:44.572253 479 raft_consensus.cc:2272] T c628a0aa47a547dc89d47ab2c45d2387 P b94013c5084e4d6292cbf2f8a0a9c208 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:44.592980 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:09:44.593933 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:09:44.596786 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:44.596903 479 tablet_replica.cc:333] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0: stopping tablet replica
I20251211 09:09:44.596952 479 raft_consensus.cc:2243] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:44.597004 479 raft_consensus.cc:2272] T c628a0aa47a547dc89d47ab2c45d2387 P 0f0a217f2e704ecfa4d2846678cb96a0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:44.610092 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:09:44.610914 479 master.cc:561] Master@127.0.119.254:43135 shutting down...
I20251211 09:09:44.613219 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:44.613348 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:44.613384 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P b33865cac2d54c3f9eb2f37663cd4f38: stopping tablet replica
I20251211 09:09:44.625211 479 master.cc:583] Master@127.0.119.254:43135 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock (10853 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientCommitSequence
I20251211 09:09:44.644243 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:45377
I20251211 09:09:44.644414 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:44.645632 6045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:44.645648 6043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:44.645777 479 server_base.cc:1047] running on GCE node
W20251211 09:09:44.645632 6042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:44.645978 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:44.646019 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:44.646032 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444184646032 us; error 0 us; skew 500 ppm
I20251211 09:09:44.646571 479 webserver.cc:492] Webserver started at http://127.0.119.254:42193/ using document root <none> and password file <none>
I20251211 09:09:44.646659 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:44.646701 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:44.646745 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:44.646998 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "e4a2ed966062469a8f357b62aeebe75c"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.647805 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:44.648239 6050 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.648362 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.648411 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "e4a2ed966062469a8f357b62aeebe75c"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.648452 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:44.655907 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:44.656055 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:44.658788 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:45377
I20251211 09:09:44.673403 6102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:45377 every 8 connection(s)
I20251211 09:09:44.673565 6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:44.674573 6103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c: Bootstrap starting.
I20251211 09:09:44.674899 6103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:44.675408 6103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c: No bootstrap required, opened a new log
I20251211 09:09:44.675535 6103 raft_consensus.cc:359] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a2ed966062469a8f357b62aeebe75c" member_type: VOTER }
I20251211 09:09:44.675587 6103 raft_consensus.cc:385] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:44.675612 6103 raft_consensus.cc:740] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a2ed966062469a8f357b62aeebe75c, State: Initialized, Role: FOLLOWER
I20251211 09:09:44.675663 6103 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a2ed966062469a8f357b62aeebe75c" member_type: VOTER }
I20251211 09:09:44.675707 6103 raft_consensus.cc:399] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:09:44.675734 6103 raft_consensus.cc:493] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:09:44.675767 6103 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:44.676236 6103 raft_consensus.cc:515] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a2ed966062469a8f357b62aeebe75c" member_type: VOTER }
I20251211 09:09:44.676292 6103 leader_election.cc:304] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4a2ed966062469a8f357b62aeebe75c; no voters:
I20251211 09:09:44.676406 6103 leader_election.cc:290] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:09:44.676455 6106 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:44.676546 6103 sys_catalog.cc:565] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:09:44.676643 6106 raft_consensus.cc:697] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 1 LEADER]: Becoming Leader. State: Replica: e4a2ed966062469a8f357b62aeebe75c, State: Running, Role: LEADER
I20251211 09:09:44.676705 6106 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a2ed966062469a8f357b62aeebe75c" member_type: VOTER }
I20251211 09:09:44.676967 6107 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4a2ed966062469a8f357b62aeebe75c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a2ed966062469a8f357b62aeebe75c" member_type: VOTER } }
I20251211 09:09:44.676992 6108 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4a2ed966062469a8f357b62aeebe75c. Latest consensus state: current_term: 1 leader_uuid: "e4a2ed966062469a8f357b62aeebe75c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a2ed966062469a8f357b62aeebe75c" member_type: VOTER } }
I20251211 09:09:44.677033 6107 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:44.677038 6108 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:44.677335 6112 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:09:44.677469 6112 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:09:44.677851 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:09:44.678035 6112 catalog_manager.cc:1357] Generated new cluster ID: 23bde805fa6c4c8c94b09e3e39353575
I20251211 09:09:44.678074 6112 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:09:44.689180 6112 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:09:44.689648 6112 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:09:44.703204 6112 catalog_manager.cc:6027] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c: Generated new TSK 0
I20251211 09:09:44.703295 6112 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:09:44.709668 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:44.710999 6125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:44.711108 6124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:44.711114 6127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:44.711127 479 server_base.cc:1047] running on GCE node
I20251211 09:09:44.711333 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:44.711359 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:44.711370 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444184711370 us; error 0 us; skew 500 ppm
I20251211 09:09:44.711887 479 webserver.cc:492] Webserver started at http://127.0.119.193:40039/ using document root <none> and password file <none>
I20251211 09:09:44.711956 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:44.711993 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:44.712029 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:44.712289 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "3ae5d9f4891d4505a02d71ab7f2f9755"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.713099 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:44.713577 6132 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.713723 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.713774 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "3ae5d9f4891d4505a02d71ab7f2f9755"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.713811 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:44.730356 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:44.730537 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:44.730674 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:44.730849 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:44.730885 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.730908 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:44.730938 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.733625 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:37431
I20251211 09:09:44.733677 6195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:37431 every 8 connection(s)
I20251211 09:09:44.734009 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:44.735080 6203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:44.735144 6200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:44.735224 6201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:44.735437 479 server_base.cc:1047] running on GCE node
I20251211 09:09:44.735579 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:44.735612 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:44.735631 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444184735632 us; error 0 us; skew 500 ppm
I20251211 09:09:44.736358 479 webserver.cc:492] Webserver started at http://127.0.119.194:41849/ using document root <none> and password file <none>
I20251211 09:09:44.736464 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:44.736512 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:44.736577 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:44.736920 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "2989e23bcb3044c5b990eac9bbca8a2f"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.737787 6196 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45377
I20251211 09:09:44.737850 6196 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:44.737955 6196 heartbeater.cc:507] Master 127.0.119.254:45377 requested a full tablet report, sending...
I20251211 09:09:44.738018 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:44.738206 6067 ts_manager.cc:194] Registered new tserver with Master: 3ae5d9f4891d4505a02d71ab7f2f9755 (127.0.119.193:37431)
I20251211 09:09:44.738539 6208 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.738674 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.738725 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "2989e23bcb3044c5b990eac9bbca8a2f"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.738775 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:44.738854 6067 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55212
I20251211 09:09:44.754065 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:44.754272 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:44.754434 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:44.754629 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:44.754657 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.754695 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:44.754721 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.759110 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:45507
I20251211 09:09:44.759188 6271 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:45507 every 8 connection(s)
I20251211 09:09:44.759542 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:44.760756 6275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:44.760839 479 server_base.cc:1047] running on GCE node
W20251211 09:09:44.760740 6276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:44.760890 6278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:44.761413 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:44.761451 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:44.761463 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444184761464 us; error 0 us; skew 500 ppm
I20251211 09:09:44.762152 479 webserver.cc:492] Webserver started at http://127.0.119.195:45543/ using document root <none> and password file <none>
I20251211 09:09:44.762244 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:44.762302 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:44.762356 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:44.762838 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "f33e213b49074c2a8e25527c0d22119a"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.762902 6272 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45377
I20251211 09:09:44.762957 6272 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:44.763067 6272 heartbeater.cc:507] Master 127.0.119.254:45377 requested a full tablet report, sending...
I20251211 09:09:44.763309 6067 ts_manager.cc:194] Registered new tserver with Master: 2989e23bcb3044c5b990eac9bbca8a2f (127.0.119.194:45507)
I20251211 09:09:44.763890 6067 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55226
I20251211 09:09:44.763943 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 09:09:44.764460 6283 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.764586 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.764644 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "f33e213b49074c2a8e25527c0d22119a"
format_stamp: "Formatted at 2025-12-11 09:09:44 on dist-test-slave-hb70"
I20251211 09:09:44.764691 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:44.792042 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:44.792260 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:44.792409 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:44.792599 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:44.792629 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.792650 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:44.792677 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.795823 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:36937
I20251211 09:09:44.795903 6346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:36937 every 8 connection(s)
I20251211 09:09:44.798848 6347 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45377
I20251211 09:09:44.798914 6347 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:44.799007 6347 heartbeater.cc:507] Master 127.0.119.254:45377 requested a full tablet report, sending...
I20251211 09:09:44.799223 6067 ts_manager.cc:194] Registered new tserver with Master: f33e213b49074c2a8e25527c0d22119a (127.0.119.195:36937)
I20251211 09:09:44.799338 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003307802s
I20251211 09:09:44.799696 6067 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55240
I20251211 09:09:44.799722 479 test_util.cc:276] Using random seed: -2122221078
I20251211 09:09:44.803822 6067 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55244:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:09:44.803983 6067 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:09:44.808662 6160 tablet_service.cc:1505] Processing CreateTablet for tablet 18caba6b96dc45b9b349a0d1758eafa0 (DEFAULT_TABLE table=test-workload [id=9a2216aa44ed42c48a384f79813daa38]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:44.808677 6236 tablet_service.cc:1505] Processing CreateTablet for tablet 18caba6b96dc45b9b349a0d1758eafa0 (DEFAULT_TABLE table=test-workload [id=9a2216aa44ed42c48a384f79813daa38]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:44.808800 6160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18caba6b96dc45b9b349a0d1758eafa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:44.808815 6236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18caba6b96dc45b9b349a0d1758eafa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:44.810145 6362 tablet_bootstrap.cc:492] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f: Bootstrap starting.
I20251211 09:09:44.810293 6311 tablet_service.cc:1505] Processing CreateTablet for tablet 18caba6b96dc45b9b349a0d1758eafa0 (DEFAULT_TABLE table=test-workload [id=9a2216aa44ed42c48a384f79813daa38]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:44.810389 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18caba6b96dc45b9b349a0d1758eafa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:44.810462 6363 tablet_bootstrap.cc:492] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755: Bootstrap starting.
I20251211 09:09:44.810595 6362 tablet_bootstrap.cc:654] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:44.810913 6363 tablet_bootstrap.cc:654] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:44.811244 6362 tablet_bootstrap.cc:492] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f: No bootstrap required, opened a new log
I20251211 09:09:44.811297 6362 ts_tablet_manager.cc:1403] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:44.811471 6363 tablet_bootstrap.cc:492] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755: No bootstrap required, opened a new log
I20251211 09:09:44.811448 6362 raft_consensus.cc:359] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.811511 6362 raft_consensus.cc:385] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:44.811549 6362 raft_consensus.cc:740] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2989e23bcb3044c5b990eac9bbca8a2f, State: Initialized, Role: FOLLOWER
I20251211 09:09:44.811520 6363 ts_tablet_manager.cc:1403] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:44.811625 6362 consensus_queue.cc:260] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.811786 6366 tablet_bootstrap.cc:492] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a: Bootstrap starting.
I20251211 09:09:44.811820 6362 ts_tablet_manager.cc:1434] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:09:44.811866 6363 raft_consensus.cc:359] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.811939 6363 raft_consensus.cc:385] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:44.811954 6272 heartbeater.cc:499] Master 127.0.119.254:45377 was elected leader, sending a full tablet report...
I20251211 09:09:44.811960 6363 raft_consensus.cc:740] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae5d9f4891d4505a02d71ab7f2f9755, State: Initialized, Role: FOLLOWER
I20251211 09:09:44.812040 6363 consensus_queue.cc:260] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.812225 6363 ts_tablet_manager.cc:1434] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:09:44.812258 6366 tablet_bootstrap.cc:654] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:44.812258 6196 heartbeater.cc:499] Master 127.0.119.254:45377 was elected leader, sending a full tablet report...
I20251211 09:09:44.812965 6366 tablet_bootstrap.cc:492] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a: No bootstrap required, opened a new log
I20251211 09:09:44.813014 6366 ts_tablet_manager.cc:1403] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:44.813158 6366 raft_consensus.cc:359] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.813212 6366 raft_consensus.cc:385] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:44.813230 6366 raft_consensus.cc:740] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f33e213b49074c2a8e25527c0d22119a, State: Initialized, Role: FOLLOWER
I20251211 09:09:44.813298 6366 consensus_queue.cc:260] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.813443 6366 ts_tablet_manager.cc:1434] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:44.813473 6347 heartbeater.cc:499] Master 127.0.119.254:45377 was elected leader, sending a full tablet report...
I20251211 09:09:44.864539 6368 raft_consensus.cc:493] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:09:44.864645 6368 raft_consensus.cc:515] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.864868 6368 leader_election.cc:290] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f33e213b49074c2a8e25527c0d22119a (127.0.119.195:36937), 2989e23bcb3044c5b990eac9bbca8a2f (127.0.119.194:45507)
I20251211 09:09:44.868042 6246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18caba6b96dc45b9b349a0d1758eafa0" candidate_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" is_pre_election: true
I20251211 09:09:44.868042 6321 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18caba6b96dc45b9b349a0d1758eafa0" candidate_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33e213b49074c2a8e25527c0d22119a" is_pre_election: true
I20251211 09:09:44.868188 6246 raft_consensus.cc:2468] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ae5d9f4891d4505a02d71ab7f2f9755 in term 0.
I20251211 09:09:44.868192 6321 raft_consensus.cc:2468] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ae5d9f4891d4505a02d71ab7f2f9755 in term 0.
I20251211 09:09:44.868396 6134 leader_election.cc:304] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2989e23bcb3044c5b990eac9bbca8a2f, 3ae5d9f4891d4505a02d71ab7f2f9755; no voters:
I20251211 09:09:44.868526 6368 raft_consensus.cc:2804] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:09:44.868575 6368 raft_consensus.cc:493] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:09:44.868592 6368 raft_consensus.cc:3060] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:44.869208 6368 raft_consensus.cc:515] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.869356 6368 leader_election.cc:290] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [CANDIDATE]: Term 1 election: Requested vote from peers f33e213b49074c2a8e25527c0d22119a (127.0.119.195:36937), 2989e23bcb3044c5b990eac9bbca8a2f (127.0.119.194:45507)
I20251211 09:09:44.869534 6246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18caba6b96dc45b9b349a0d1758eafa0" candidate_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2989e23bcb3044c5b990eac9bbca8a2f"
I20251211 09:09:44.869514 6321 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18caba6b96dc45b9b349a0d1758eafa0" candidate_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f33e213b49074c2a8e25527c0d22119a"
I20251211 09:09:44.869616 6246 raft_consensus.cc:3060] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:44.869627 6321 raft_consensus.cc:3060] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:44.870249 6246 raft_consensus.cc:2468] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ae5d9f4891d4505a02d71ab7f2f9755 in term 1.
I20251211 09:09:44.870324 6321 raft_consensus.cc:2468] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ae5d9f4891d4505a02d71ab7f2f9755 in term 1.
I20251211 09:09:44.870438 6134 leader_election.cc:304] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2989e23bcb3044c5b990eac9bbca8a2f, 3ae5d9f4891d4505a02d71ab7f2f9755; no voters:
I20251211 09:09:44.870522 6368 raft_consensus.cc:2804] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:44.870651 6368 raft_consensus.cc:697] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 1 LEADER]: Becoming Leader. State: Replica: 3ae5d9f4891d4505a02d71ab7f2f9755, State: Running, Role: LEADER
I20251211 09:09:44.870692 6368 consensus_queue.cc:237] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } }
I20251211 09:09:44.871240 6066 catalog_manager.cc:5654] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ae5d9f4891d4505a02d71ab7f2f9755 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ae5d9f4891d4505a02d71ab7f2f9755" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 } health_report { overall_health: UNKNOWN } } }
I20251211 09:09:44.891216 6321 raft_consensus.cc:1275] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 1 FOLLOWER]: Refusing update from remote peer 3ae5d9f4891d4505a02d71ab7f2f9755: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:44.891216 6246 raft_consensus.cc:1275] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 1 FOLLOWER]: Refusing update from remote peer 3ae5d9f4891d4505a02d71ab7f2f9755: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:44.891534 6368 consensus_queue.cc:1048] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2989e23bcb3044c5b990eac9bbca8a2f" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:44.891670 6372 consensus_queue.cc:1048] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f33e213b49074c2a8e25527c0d22119a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:44.893854 6381 mvcc.cc:204] Tried to move back new op lower bound from 7231259381314506752 to 7231259381230886912. Current Snapshot: MvccSnapshot[applied={T|T < 7231259381314506752 or (T in {7231259381314506752})}]
W20251211 09:09:54.893190 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Cannot finalize transaction in state: OPEN
W20251211 09:09:54.893606 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Transaction 0 already open
W20251211 09:09:54.896219 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:09:54.896615 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Transaction 0 commit already in progress
W20251211 09:09:54.898078 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:09:54.898447 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:09:54.898808 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Transaction 0 commit already in progress
W20251211 09:09:54.899255 6379 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59658: Illegal state: Transaction metadata for transaction 0 already set
I20251211 09:09:54.899677 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:09:54.902452 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:54.902554 479 tablet_replica.cc:333] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755: stopping tablet replica
I20251211 09:09:54.902608 479 raft_consensus.cc:2243] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:54.902666 479 raft_consensus.cc:2272] T 18caba6b96dc45b9b349a0d1758eafa0 P 3ae5d9f4891d4505a02d71ab7f2f9755 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:54.916839 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:09:54.917804 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:09:54.920516 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:54.920624 479 tablet_replica.cc:333] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f: stopping tablet replica
I20251211 09:09:54.920706 479 raft_consensus.cc:2243] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:54.920751 479 raft_consensus.cc:2272] T 18caba6b96dc45b9b349a0d1758eafa0 P 2989e23bcb3044c5b990eac9bbca8a2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:54.932425 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:09:54.933173 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:09:54.935657 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:09:54.935793 479 tablet_replica.cc:333] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a: stopping tablet replica
I20251211 09:09:54.935864 479 raft_consensus.cc:2243] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:09:54.935904 479 raft_consensus.cc:2272] T 18caba6b96dc45b9b349a0d1758eafa0 P f33e213b49074c2a8e25527c0d22119a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:54.949669 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:09:54.950508 479 master.cc:561] Master@127.0.119.254:45377 shutting down...
I20251211 09:09:54.952788 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:09:54.952857 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:09:54.952875 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P e4a2ed966062469a8f357b62aeebe75c: stopping tablet replica
I20251211 09:09:54.964490 479 master.cc:583] Master@127.0.119.254:45377 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientCommitSequence (10339 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientAbortSequence
I20251211 09:09:54.984030 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:43431
I20251211 09:09:54.984180 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:54.985311 6427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:54.985399 479 server_base.cc:1047] running on GCE node
W20251211 09:09:54.985476 6428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:54.985419 6430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:54.985671 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:54.985708 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:54.985729 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444194985729 us; error 0 us; skew 500 ppm
I20251211 09:09:54.986311 479 webserver.cc:492] Webserver started at http://127.0.119.254:40147/ using document root <none> and password file <none>
I20251211 09:09:54.986398 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:54.986457 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:54.986515 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:54.986786 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "31ab78634e0d48b88d489cdc43a86ae0"
format_stamp: "Formatted at 2025-12-11 09:09:54 on dist-test-slave-hb70"
I20251211 09:09:54.987660 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:09:54.988116 6435 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:54.988225 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:54.988270 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "31ab78634e0d48b88d489cdc43a86ae0"
format_stamp: "Formatted at 2025-12-11 09:09:54 on dist-test-slave-hb70"
I20251211 09:09:54.988322 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:55.001420 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:55.001622 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:55.004109 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:43431
I20251211 09:09:55.017671 6487 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:43431 every 8 connection(s)
I20251211 09:09:55.017825 6488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:55.018831 6488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0: Bootstrap starting.
I20251211 09:09:55.019125 6488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:55.019613 6488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0: No bootstrap required, opened a new log
I20251211 09:09:55.019738 6488 raft_consensus.cc:359] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ab78634e0d48b88d489cdc43a86ae0" member_type: VOTER }
I20251211 09:09:55.019789 6488 raft_consensus.cc:385] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:55.019804 6488 raft_consensus.cc:740] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ab78634e0d48b88d489cdc43a86ae0, State: Initialized, Role: FOLLOWER
I20251211 09:09:55.019862 6488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ab78634e0d48b88d489cdc43a86ae0" member_type: VOTER }
I20251211 09:09:55.019903 6488 raft_consensus.cc:399] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:09:55.019946 6488 raft_consensus.cc:493] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:09:55.019974 6488 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:55.020462 6488 raft_consensus.cc:515] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ab78634e0d48b88d489cdc43a86ae0" member_type: VOTER }
I20251211 09:09:55.020519 6488 leader_election.cc:304] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31ab78634e0d48b88d489cdc43a86ae0; no voters:
I20251211 09:09:55.020634 6488 leader_election.cc:290] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:09:55.020704 6491 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:55.020771 6488 sys_catalog.cc:565] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:09:55.020854 6491 raft_consensus.cc:697] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 1 LEADER]: Becoming Leader. State: Replica: 31ab78634e0d48b88d489cdc43a86ae0, State: Running, Role: LEADER
I20251211 09:09:55.020906 6491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ab78634e0d48b88d489cdc43a86ae0" member_type: VOTER }
I20251211 09:09:55.021149 6493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31ab78634e0d48b88d489cdc43a86ae0. Latest consensus state: current_term: 1 leader_uuid: "31ab78634e0d48b88d489cdc43a86ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ab78634e0d48b88d489cdc43a86ae0" member_type: VOTER } }
I20251211 09:09:55.021205 6493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:55.021477 6497 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:09:55.021459 6492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31ab78634e0d48b88d489cdc43a86ae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ab78634e0d48b88d489cdc43a86ae0" member_type: VOTER } }
I20251211 09:09:55.021531 6492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [sys.catalog]: This master's current role is: LEADER
I20251211 09:09:55.021629 6497 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:09:55.022236 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:09:55.022245 6497 catalog_manager.cc:1357] Generated new cluster ID: 37787ae663c1413fafddf566c28443cb
I20251211 09:09:55.022305 6497 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:09:55.038187 6497 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:09:55.038646 6497 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:09:55.048945 6497 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0: Generated new TSK 0
I20251211 09:09:55.049042 6497 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:09:55.054102 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:55.055459 6512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:55.055538 6510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:55.055578 6509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:55.055720 479 server_base.cc:1047] running on GCE node
I20251211 09:09:55.055819 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:55.055848 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:55.055877 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444195055878 us; error 0 us; skew 500 ppm
I20251211 09:09:55.056458 479 webserver.cc:492] Webserver started at http://127.0.119.193:39009/ using document root <none> and password file <none>
I20251211 09:09:55.056536 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:55.056587 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:55.056639 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:55.056912 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "3b65e8231c4540b5819b066bea6403da"
format_stamp: "Formatted at 2025-12-11 09:09:55 on dist-test-slave-hb70"
I20251211 09:09:55.057832 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:55.058306 6517 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.058450 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.058490 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "3b65e8231c4540b5819b066bea6403da"
format_stamp: "Formatted at 2025-12-11 09:09:55 on dist-test-slave-hb70"
I20251211 09:09:55.058532 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:55.088409 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:55.088649 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:55.088881 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:55.089149 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:55.089195 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.089227 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:55.089268 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.092651 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:41211
I20251211 09:09:55.092707 6580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:41211 every 8 connection(s)
I20251211 09:09:55.092989 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:55.094322 6585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:55.094435 6588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:55.094529 479 server_base.cc:1047] running on GCE node
W20251211 09:09:55.094617 6586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:55.094820 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:55.094871 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:55.094897 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444195094896 us; error 0 us; skew 500 ppm
I20251211 09:09:55.095613 479 webserver.cc:492] Webserver started at http://127.0.119.194:45629/ using document root <none> and password file <none>
I20251211 09:09:55.095708 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:55.095762 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:55.095806 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:55.096117 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "a21c11cffb344232a7865b5b0abc9169"
format_stamp: "Formatted at 2025-12-11 09:09:55 on dist-test-slave-hb70"
I20251211 09:09:55.096573 6581 heartbeater.cc:344] Connected to a master server at 127.0.119.254:43431
I20251211 09:09:55.096632 6581 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:55.096726 6581 heartbeater.cc:507] Master 127.0.119.254:43431 requested a full tablet report, sending...
I20251211 09:09:55.096992 6452 ts_manager.cc:194] Registered new tserver with Master: 3b65e8231c4540b5819b066bea6403da (127.0.119.193:41211)
I20251211 09:09:55.097231 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20251211 09:09:55.097625 6452 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36920
I20251211 09:09:55.097754 6593 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.098026 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.098076 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "a21c11cffb344232a7865b5b0abc9169"
format_stamp: "Formatted at 2025-12-11 09:09:55 on dist-test-slave-hb70"
I20251211 09:09:55.098145 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:55.122900 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:55.123112 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:55.123274 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:55.123467 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:55.123494 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.123517 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:55.123545 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.126665 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:43921
I20251211 09:09:55.126745 6656 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:43921 every 8 connection(s)
I20251211 09:09:55.127059 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:09:55.128204 6661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:09:55.128286 6660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:55.128379 479 server_base.cc:1047] running on GCE node
W20251211 09:09:55.128423 6663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:09:55.128607 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:09:55.128646 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:09:55.128662 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444195128663 us; error 0 us; skew 500 ppm
I20251211 09:09:55.129355 479 webserver.cc:492] Webserver started at http://127.0.119.195:45723/ using document root <none> and password file <none>
I20251211 09:09:55.129447 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:09:55.129499 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:09:55.129555 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:09:55.129793 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "b04da3ed744d4bcda0051f97d676d3af"
format_stamp: "Formatted at 2025-12-11 09:09:55 on dist-test-slave-hb70"
I20251211 09:09:55.130342 6657 heartbeater.cc:344] Connected to a master server at 127.0.119.254:43431
I20251211 09:09:55.130412 6657 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:55.130535 6657 heartbeater.cc:507] Master 127.0.119.254:43431 requested a full tablet report, sending...
I20251211 09:09:55.130748 6452 ts_manager.cc:194] Registered new tserver with Master: a21c11cffb344232a7865b5b0abc9169 (127.0.119.194:43921)
I20251211 09:09:55.130852 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:55.131150 6452 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36928
I20251211 09:09:55.131383 6668 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.131510 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.131558 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "b04da3ed744d4bcda0051f97d676d3af"
format_stamp: "Formatted at 2025-12-11 09:09:55 on dist-test-slave-hb70"
I20251211 09:09:55.131600 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:09:55.152812 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:09:55.153056 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:09:55.153203 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:09:55.153440 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:09:55.153470 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.153492 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:09:55.153517 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.156735 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:34363
I20251211 09:09:55.156805 6731 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:34363 every 8 connection(s)
I20251211 09:09:55.159781 6732 heartbeater.cc:344] Connected to a master server at 127.0.119.254:43431
I20251211 09:09:55.159843 6732 heartbeater.cc:461] Registering TS with master...
I20251211 09:09:55.159924 6732 heartbeater.cc:507] Master 127.0.119.254:43431 requested a full tablet report, sending...
I20251211 09:09:55.160151 6452 ts_manager.cc:194] Registered new tserver with Master: b04da3ed744d4bcda0051f97d676d3af (127.0.119.195:34363)
I20251211 09:09:55.160254 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003322213s
I20251211 09:09:55.160609 6452 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36944
I20251211 09:09:55.160653 479 test_util.cc:276] Using random seed: -2111860148
I20251211 09:09:55.164954 6452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36952:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:09:55.165096 6452 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:09:55.169327 6696 tablet_service.cc:1505] Processing CreateTablet for tablet ce3974b9a2b54066896f930c36ef32c6 (DEFAULT_TABLE table=test-workload [id=fa0d1f4cd73d4f86a9146772d3636279]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:55.169454 6696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3974b9a2b54066896f930c36ef32c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:55.169880 6621 tablet_service.cc:1505] Processing CreateTablet for tablet ce3974b9a2b54066896f930c36ef32c6 (DEFAULT_TABLE table=test-workload [id=fa0d1f4cd73d4f86a9146772d3636279]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:55.170004 6621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3974b9a2b54066896f930c36ef32c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:55.170379 6542 tablet_service.cc:1505] Processing CreateTablet for tablet ce3974b9a2b54066896f930c36ef32c6 (DEFAULT_TABLE table=test-workload [id=fa0d1f4cd73d4f86a9146772d3636279]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:09:55.170468 6542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3974b9a2b54066896f930c36ef32c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:09:55.171000 6747 tablet_bootstrap.cc:492] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af: Bootstrap starting.
I20251211 09:09:55.171367 6748 tablet_bootstrap.cc:492] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169: Bootstrap starting.
I20251211 09:09:55.171444 6747 tablet_bootstrap.cc:654] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:55.171698 6749 tablet_bootstrap.cc:492] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da: Bootstrap starting.
I20251211 09:09:55.171795 6748 tablet_bootstrap.cc:654] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:55.172241 6749 tablet_bootstrap.cc:654] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da: Neither blocks nor log segments found. Creating new log.
I20251211 09:09:55.172387 6747 tablet_bootstrap.cc:492] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af: No bootstrap required, opened a new log
I20251211 09:09:55.172430 6748 tablet_bootstrap.cc:492] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169: No bootstrap required, opened a new log
I20251211 09:09:55.172499 6748 ts_tablet_manager.cc:1403] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:55.172676 6748 raft_consensus.cc:359] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.172737 6748 raft_consensus.cc:385] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:55.172770 6748 raft_consensus.cc:740] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21c11cffb344232a7865b5b0abc9169, State: Initialized, Role: FOLLOWER
I20251211 09:09:55.172823 6748 consensus_queue.cc:260] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.172860 6749 tablet_bootstrap.cc:492] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da: No bootstrap required, opened a new log
I20251211 09:09:55.172894 6749 ts_tablet_manager.cc:1403] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:55.173028 6748 ts_tablet_manager.cc:1434] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:09:55.172447 6747 ts_tablet_manager.cc:1403] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:09:55.173058 6657 heartbeater.cc:499] Master 127.0.119.254:43431 was elected leader, sending a full tablet report...
I20251211 09:09:55.173064 6749 raft_consensus.cc:359] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.173158 6749 raft_consensus.cc:385] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:55.173190 6749 raft_consensus.cc:740] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b65e8231c4540b5819b066bea6403da, State: Initialized, Role: FOLLOWER
I20251211 09:09:55.173215 6747 raft_consensus.cc:359] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.173236 6749 consensus_queue.cc:260] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.173326 6747 raft_consensus.cc:385] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:09:55.173357 6747 raft_consensus.cc:740] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04da3ed744d4bcda0051f97d676d3af, State: Initialized, Role: FOLLOWER
I20251211 09:09:55.173425 6749 ts_tablet_manager.cc:1434] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:09:55.173478 6581 heartbeater.cc:499] Master 127.0.119.254:43431 was elected leader, sending a full tablet report...
I20251211 09:09:55.173425 6747 consensus_queue.cc:260] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.173736 6747 ts_tablet_manager.cc:1434] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:09:55.173759 6732 heartbeater.cc:499] Master 127.0.119.254:43431 was elected leader, sending a full tablet report...
I20251211 09:09:55.271648 6754 raft_consensus.cc:493] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:09:55.271764 6754 raft_consensus.cc:515] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.271965 6754 leader_election.cc:290] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b04da3ed744d4bcda0051f97d676d3af (127.0.119.195:34363), a21c11cffb344232a7865b5b0abc9169 (127.0.119.194:43921)
I20251211 09:09:55.275363 6706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce3974b9a2b54066896f930c36ef32c6" candidate_uuid: "3b65e8231c4540b5819b066bea6403da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04da3ed744d4bcda0051f97d676d3af" is_pre_election: true
I20251211 09:09:55.275460 6706 raft_consensus.cc:2468] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b65e8231c4540b5819b066bea6403da in term 0.
I20251211 09:09:55.275368 6631 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce3974b9a2b54066896f930c36ef32c6" candidate_uuid: "3b65e8231c4540b5819b066bea6403da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21c11cffb344232a7865b5b0abc9169" is_pre_election: true
I20251211 09:09:55.275508 6631 raft_consensus.cc:2468] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b65e8231c4540b5819b066bea6403da in term 0.
I20251211 09:09:55.275631 6520 leader_election.cc:304] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b65e8231c4540b5819b066bea6403da, b04da3ed744d4bcda0051f97d676d3af; no voters:
I20251211 09:09:55.275738 6754 raft_consensus.cc:2804] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:09:55.275781 6754 raft_consensus.cc:493] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:09:55.275796 6754 raft_consensus.cc:3060] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:55.276418 6754 raft_consensus.cc:515] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.276546 6754 leader_election.cc:290] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [CANDIDATE]: Term 1 election: Requested vote from peers b04da3ed744d4bcda0051f97d676d3af (127.0.119.195:34363), a21c11cffb344232a7865b5b0abc9169 (127.0.119.194:43921)
I20251211 09:09:55.276742 6631 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce3974b9a2b54066896f930c36ef32c6" candidate_uuid: "3b65e8231c4540b5819b066bea6403da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21c11cffb344232a7865b5b0abc9169"
I20251211 09:09:55.276741 6706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce3974b9a2b54066896f930c36ef32c6" candidate_uuid: "3b65e8231c4540b5819b066bea6403da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04da3ed744d4bcda0051f97d676d3af"
I20251211 09:09:55.276830 6631 raft_consensus.cc:3060] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:55.276839 6706 raft_consensus.cc:3060] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:09:55.277601 6631 raft_consensus.cc:2468] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b65e8231c4540b5819b066bea6403da in term 1.
I20251211 09:09:55.277603 6706 raft_consensus.cc:2468] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b65e8231c4540b5819b066bea6403da in term 1.
I20251211 09:09:55.277829 6519 leader_election.cc:304] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b65e8231c4540b5819b066bea6403da, a21c11cffb344232a7865b5b0abc9169; no voters:
I20251211 09:09:55.277944 6754 raft_consensus.cc:2804] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:09:55.278092 6754 raft_consensus.cc:697] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 1 LEADER]: Becoming Leader. State: Replica: 3b65e8231c4540b5819b066bea6403da, State: Running, Role: LEADER
I20251211 09:09:55.278147 6754 consensus_queue.cc:237] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } }
I20251211 09:09:55.278679 6451 catalog_manager.cc:5654] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b65e8231c4540b5819b066bea6403da (127.0.119.193). New cstate: current_term: 1 leader_uuid: "3b65e8231c4540b5819b066bea6403da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b65e8231c4540b5819b066bea6403da" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41211 } health_report { overall_health: HEALTHY } } }
I20251211 09:09:55.295293 6706 raft_consensus.cc:1275] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 1 FOLLOWER]: Refusing update from remote peer 3b65e8231c4540b5819b066bea6403da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:55.295293 6631 raft_consensus.cc:1275] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 1 FOLLOWER]: Refusing update from remote peer 3b65e8231c4540b5819b066bea6403da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:09:55.295611 6757 consensus_queue.cc:1048] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21c11cffb344232a7865b5b0abc9169" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 43921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:09:55.295728 6754 consensus_queue.cc:1048] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04da3ed744d4bcda0051f97d676d3af" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 09:10:05.309002 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:10:05.309482 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Transaction metadata for transaction 1 already exists
W20251211 09:10:05.309813 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Cannot begin committing transaction in state: INITIALIZING
W20251211 09:10:05.310112 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Cannot begin committing transaction in state: INITIALIZING
W20251211 09:10:05.310405 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Transaction metadata for transaction 0 already exists
W20251211 09:10:05.310691 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Transaction metadata for transaction 1 already exists
W20251211 09:10:05.311009 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Transaction metadata for transaction 0 already set
W20251211 09:10:05.311306 6764 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57996: Illegal state: Transaction metadata for transaction 1 already set
I20251211 09:10:05.311645 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:10:05.314384 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:05.314482 479 tablet_replica.cc:333] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da: stopping tablet replica
I20251211 09:10:05.314531 479 raft_consensus.cc:2243] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:05.314596 479 raft_consensus.cc:2272] T ce3974b9a2b54066896f930c36ef32c6 P 3b65e8231c4540b5819b066bea6403da [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:05.328593 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:10:05.329509 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:10:05.332258 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:05.332425 479 tablet_replica.cc:333] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169: stopping tablet replica
I20251211 09:10:05.332490 479 raft_consensus.cc:2243] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:05.332533 479 raft_consensus.cc:2272] T ce3974b9a2b54066896f930c36ef32c6 P a21c11cffb344232a7865b5b0abc9169 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:05.335848 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:10:05.336606 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:10:05.340061 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:05.340159 479 tablet_replica.cc:333] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af: stopping tablet replica
I20251211 09:10:05.340217 479 raft_consensus.cc:2243] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:05.340261 479 raft_consensus.cc:2272] T ce3974b9a2b54066896f930c36ef32c6 P b04da3ed744d4bcda0051f97d676d3af [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:05.363489 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:10:05.364372 479 master.cc:561] Master@127.0.119.254:43431 shutting down...
I20251211 09:10:05.366796 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:05.366870 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:05.366890 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 31ab78634e0d48b88d489cdc43a86ae0: stopping tablet replica
I20251211 09:10:05.379058 479 master.cc:583] Master@127.0.119.254:43431 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientAbortSequence (10412 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun
I20251211 09:10:05.396879 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:42703
I20251211 09:10:05.397023 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:05.398394 6812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:05.398531 6814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:05.398540 6811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:05.398624 479 server_base.cc:1047] running on GCE node
I20251211 09:10:05.398774 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:05.398810 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:05.398834 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444205398834 us; error 0 us; skew 500 ppm
I20251211 09:10:05.399375 479 webserver.cc:492] Webserver started at http://127.0.119.254:36811/ using document root <none> and password file <none>
I20251211 09:10:05.399456 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:05.399502 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:05.399556 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:05.399807 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "a487eb7e43834463aa372c035374705a"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.400664 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:10:05.401072 6819 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.401201 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.401260 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "a487eb7e43834463aa372c035374705a"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.401312 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:05.420667 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:05.420864 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:05.423353 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:42703
I20251211 09:10:05.434511 6871 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:42703 every 8 connection(s)
I20251211 09:10:05.434630 6872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:05.435647 6872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a: Bootstrap starting.
I20251211 09:10:05.435917 6872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:05.436378 6872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a: No bootstrap required, opened a new log
I20251211 09:10:05.436489 6872 raft_consensus.cc:359] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a487eb7e43834463aa372c035374705a" member_type: VOTER }
I20251211 09:10:05.436534 6872 raft_consensus.cc:385] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:05.436548 6872 raft_consensus.cc:740] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a487eb7e43834463aa372c035374705a, State: Initialized, Role: FOLLOWER
I20251211 09:10:05.436585 6872 consensus_queue.cc:260] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a487eb7e43834463aa372c035374705a" member_type: VOTER }
I20251211 09:10:05.436630 6872 raft_consensus.cc:399] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:10:05.436650 6872 raft_consensus.cc:493] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:10:05.436664 6872 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:05.437114 6872 raft_consensus.cc:515] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a487eb7e43834463aa372c035374705a" member_type: VOTER }
I20251211 09:10:05.437167 6872 leader_election.cc:304] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a487eb7e43834463aa372c035374705a; no voters:
I20251211 09:10:05.437320 6872 leader_election.cc:290] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:10:05.437361 6875 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:05.437475 6875 raft_consensus.cc:697] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 1 LEADER]: Becoming Leader. State: Replica: a487eb7e43834463aa372c035374705a, State: Running, Role: LEADER
I20251211 09:10:05.437490 6872 sys_catalog.cc:565] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:10:05.437574 6875 consensus_queue.cc:237] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a487eb7e43834463aa372c035374705a" member_type: VOTER }
I20251211 09:10:05.437783 6876 sys_catalog.cc:455] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a487eb7e43834463aa372c035374705a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a487eb7e43834463aa372c035374705a" member_type: VOTER } }
I20251211 09:10:05.437861 6876 sys_catalog.cc:458] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:05.438113 6879 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:10:05.438282 6879 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:10:05.438591 6877 sys_catalog.cc:455] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a487eb7e43834463aa372c035374705a. Latest consensus state: current_term: 1 leader_uuid: "a487eb7e43834463aa372c035374705a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a487eb7e43834463aa372c035374705a" member_type: VOTER } }
I20251211 09:10:05.438668 6877 sys_catalog.cc:458] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:05.438892 6879 catalog_manager.cc:1357] Generated new cluster ID: e90df16e660e4f58970a36f5d12bb17e
I20251211 09:10:05.438928 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:10:05.438946 6879 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:10:05.455884 6879 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:10:05.456319 6879 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:10:05.460642 6879 catalog_manager.cc:6027] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a: Generated new TSK 0
I20251211 09:10:05.460724 6879 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:10:05.470678 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:05.472007 6894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:05.472011 6896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:05.472183 6893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:05.472301 479 server_base.cc:1047] running on GCE node
I20251211 09:10:05.472380 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:05.472405 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:05.472424 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444205472423 us; error 0 us; skew 500 ppm
I20251211 09:10:05.472970 479 webserver.cc:492] Webserver started at http://127.0.119.193:41741/ using document root <none> and password file <none>
I20251211 09:10:05.473042 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:05.473078 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:05.473116 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:05.473409 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "b722c92666ec451ea311dd3918e82475"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.474311 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:05.474717 6901 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.474843 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.474892 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "b722c92666ec451ea311dd3918e82475"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.474922 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:05.486286 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:05.486445 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:05.486554 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:05.486694 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:05.486716 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.486740 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:05.486756 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.489437 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:44413
I20251211 09:10:05.489704 6964 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:44413 every 8 connection(s)
I20251211 09:10:05.489895 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:05.491150 6969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:05.491132 6972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:05.491179 6970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:05.491361 479 server_base.cc:1047] running on GCE node
I20251211 09:10:05.491465 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:05.491496 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:05.491523 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444205491523 us; error 0 us; skew 500 ppm
I20251211 09:10:05.492292 479 webserver.cc:492] Webserver started at http://127.0.119.194:41659/ using document root <none> and password file <none>
I20251211 09:10:05.492383 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:05.492425 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:05.492483 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:05.492786 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.493920 6965 heartbeater.cc:344] Connected to a master server at 127.0.119.254:42703
I20251211 09:10:05.493999 6965 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:05.494052 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:05.494115 6965 heartbeater.cc:507] Master 127.0.119.254:42703 requested a full tablet report, sending...
I20251211 09:10:05.494367 6836 ts_manager.cc:194] Registered new tserver with Master: b722c92666ec451ea311dd3918e82475 (127.0.119.193:44413)
I20251211 09:10:05.494621 6977 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.494751 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251211 09:10:05.494799 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.494845 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:05.495049 6836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45288
I20251211 09:10:05.517729 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:05.517946 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:05.518103 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:05.518311 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:05.518337 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.518360 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:05.518388 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.521555 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:40779
I20251211 09:10:05.521610 7040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:40779 every 8 connection(s)
I20251211 09:10:05.521914 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:05.523192 7045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:05.523308 479 server_base.cc:1047] running on GCE node
W20251211 09:10:05.523272 7047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:05.523689 7044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:05.523883 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:05.523924 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:05.523944 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444205523944 us; error 0 us; skew 500 ppm
I20251211 09:10:05.524595 479 webserver.cc:492] Webserver started at http://127.0.119.195:43349/ using document root <none> and password file <none>
I20251211 09:10:05.524688 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:05.524739 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:05.524789 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:05.525132 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "0a0f17a380a248cfbae69c6c05f11f7a"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.525219 7041 heartbeater.cc:344] Connected to a master server at 127.0.119.254:42703
I20251211 09:10:05.525305 7041 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:05.525414 7041 heartbeater.cc:507] Master 127.0.119.254:42703 requested a full tablet report, sending...
I20251211 09:10:05.525632 6836 ts_manager.cc:194] Registered new tserver with Master: 2fb9d3dd3ff74f38a53efa3636bc07c2 (127.0.119.194:40779)
I20251211 09:10:05.525962 6836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45290
I20251211 09:10:05.526185 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:10:05.526633 7052 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.526760 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.526803 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "0a0f17a380a248cfbae69c6c05f11f7a"
format_stamp: "Formatted at 2025-12-11 09:10:05 on dist-test-slave-hb70"
I20251211 09:10:05.526849 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:05.536137 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:05.536350 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:05.536520 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:05.536705 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:05.536733 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.536767 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:05.536792 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.540037 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:39153
I20251211 09:10:05.540095 7115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:39153 every 8 connection(s)
I20251211 09:10:05.542901 7116 heartbeater.cc:344] Connected to a master server at 127.0.119.254:42703
I20251211 09:10:05.542964 7116 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:05.543056 7116 heartbeater.cc:507] Master 127.0.119.254:42703 requested a full tablet report, sending...
I20251211 09:10:05.543243 6836 ts_manager.cc:194] Registered new tserver with Master: 0a0f17a380a248cfbae69c6c05f11f7a (127.0.119.195:39153)
I20251211 09:10:05.543524 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003292617s
I20251211 09:10:05.543613 6836 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45300
I20251211 09:10:05.543913 479 test_util.cc:276] Using random seed: -2101476887
I20251211 09:10:05.548199 6836 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45316:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:10:05.548316 6836 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:10:05.554436 6929 tablet_service.cc:1505] Processing CreateTablet for tablet 83914e7dab4b4a8b8e6324db54079dc0 (DEFAULT_TABLE table=test-workload [id=678fe330c0ed401092ed207a6ce14bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:05.554603 6929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83914e7dab4b4a8b8e6324db54079dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:05.555713 7005 tablet_service.cc:1505] Processing CreateTablet for tablet 83914e7dab4b4a8b8e6324db54079dc0 (DEFAULT_TABLE table=test-workload [id=678fe330c0ed401092ed207a6ce14bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:05.555824 7005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83914e7dab4b4a8b8e6324db54079dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:05.555996 7080 tablet_service.cc:1505] Processing CreateTablet for tablet 83914e7dab4b4a8b8e6324db54079dc0 (DEFAULT_TABLE table=test-workload [id=678fe330c0ed401092ed207a6ce14bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:05.556092 7080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83914e7dab4b4a8b8e6324db54079dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:05.556247 7131 tablet_bootstrap.cc:492] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475: Bootstrap starting.
I20251211 09:10:05.556681 7131 tablet_bootstrap.cc:654] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:05.557420 7131 tablet_bootstrap.cc:492] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475: No bootstrap required, opened a new log
I20251211 09:10:05.557564 7131 ts_tablet_manager.cc:1403] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:05.557469 7134 tablet_bootstrap.cc:492] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2: Bootstrap starting.
I20251211 09:10:05.557765 7131 raft_consensus.cc:359] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.557847 7131 raft_consensus.cc:385] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:05.557878 7131 raft_consensus.cc:740] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b722c92666ec451ea311dd3918e82475, State: Initialized, Role: FOLLOWER
I20251211 09:10:05.557924 7131 consensus_queue.cc:260] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.558075 7131 ts_tablet_manager.cc:1434] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.558163 6965 heartbeater.cc:499] Master 127.0.119.254:42703 was elected leader, sending a full tablet report...
I20251211 09:10:05.558184 7133 tablet_bootstrap.cc:492] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a: Bootstrap starting.
I20251211 09:10:05.558534 7134 tablet_bootstrap.cc:654] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:05.558709 7133 tablet_bootstrap.cc:654] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:05.559103 7134 tablet_bootstrap.cc:492] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2: No bootstrap required, opened a new log
I20251211 09:10:05.559197 7134 ts_tablet_manager.cc:1403] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:10:05.559340 7133 tablet_bootstrap.cc:492] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a: No bootstrap required, opened a new log
I20251211 09:10:05.559346 7134 raft_consensus.cc:359] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.559391 7133 ts_tablet_manager.cc:1403] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:05.559409 7134 raft_consensus.cc:385] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:05.559451 7134 raft_consensus.cc:740] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb9d3dd3ff74f38a53efa3636bc07c2, State: Initialized, Role: FOLLOWER
I20251211 09:10:05.559512 7134 consensus_queue.cc:260] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.559530 7133 raft_consensus.cc:359] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.559588 7133 raft_consensus.cc:385] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:05.559618 7133 raft_consensus.cc:740] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0f17a380a248cfbae69c6c05f11f7a, State: Initialized, Role: FOLLOWER
I20251211 09:10:05.559660 7134 ts_tablet_manager.cc:1434] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:05.559690 7041 heartbeater.cc:499] Master 127.0.119.254:42703 was elected leader, sending a full tablet report...
I20251211 09:10:05.559717 7133 consensus_queue.cc:260] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.559891 7133 ts_tablet_manager.cc:1434] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:10:05.559909 7116 heartbeater.cc:499] Master 127.0.119.254:42703 was elected leader, sending a full tablet report...
W20251211 09:10:05.742852 6966 tablet.cc:2378] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 09:10:05.747490 7135 raft_consensus.cc:493] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:10:05.747581 7135 raft_consensus.cc:515] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.747781 7135 leader_election.cc:290] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0f17a380a248cfbae69c6c05f11f7a (127.0.119.195:39153), 2fb9d3dd3ff74f38a53efa3636bc07c2 (127.0.119.194:40779)
I20251211 09:10:05.750711 7090 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "83914e7dab4b4a8b8e6324db54079dc0" candidate_uuid: "b722c92666ec451ea311dd3918e82475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" is_pre_election: true
I20251211 09:10:05.750790 7090 raft_consensus.cc:2468] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b722c92666ec451ea311dd3918e82475 in term 0.
I20251211 09:10:05.750938 6902 leader_election.cc:304] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0f17a380a248cfbae69c6c05f11f7a, b722c92666ec451ea311dd3918e82475; no voters:
I20251211 09:10:05.751019 7135 raft_consensus.cc:2804] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:10:05.751084 7015 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "83914e7dab4b4a8b8e6324db54079dc0" candidate_uuid: "b722c92666ec451ea311dd3918e82475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" is_pre_election: true
I20251211 09:10:05.751139 7135 raft_consensus.cc:493] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:10:05.751166 7135 raft_consensus.cc:3060] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:05.751168 7015 raft_consensus.cc:2468] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b722c92666ec451ea311dd3918e82475 in term 0.
I20251211 09:10:05.751866 7135 raft_consensus.cc:515] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.752089 7135 leader_election.cc:290] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0f17a380a248cfbae69c6c05f11f7a (127.0.119.195:39153), 2fb9d3dd3ff74f38a53efa3636bc07c2 (127.0.119.194:40779)
I20251211 09:10:05.752151 7090 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "83914e7dab4b4a8b8e6324db54079dc0" candidate_uuid: "b722c92666ec451ea311dd3918e82475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0f17a380a248cfbae69c6c05f11f7a"
I20251211 09:10:05.752221 7015 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "83914e7dab4b4a8b8e6324db54079dc0" candidate_uuid: "b722c92666ec451ea311dd3918e82475" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2"
I20251211 09:10:05.752250 7090 raft_consensus.cc:3060] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:05.752295 7015 raft_consensus.cc:3060] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:05.752908 7015 raft_consensus.cc:2468] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b722c92666ec451ea311dd3918e82475 in term 1.
I20251211 09:10:05.753070 6904 leader_election.cc:304] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb9d3dd3ff74f38a53efa3636bc07c2, b722c92666ec451ea311dd3918e82475; no voters:
I20251211 09:10:05.753146 7135 raft_consensus.cc:2804] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:05.753194 7090 raft_consensus.cc:2468] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b722c92666ec451ea311dd3918e82475 in term 1.
I20251211 09:10:05.753300 7135 raft_consensus.cc:697] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 1 LEADER]: Becoming Leader. State: Replica: b722c92666ec451ea311dd3918e82475, State: Running, Role: LEADER
I20251211 09:10:05.753417 7135 consensus_queue.cc:237] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } }
I20251211 09:10:05.754014 6835 catalog_manager.cc:5654] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 reported cstate change: term changed from 0 to 1, leader changed from <none> to b722c92666ec451ea311dd3918e82475 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "b722c92666ec451ea311dd3918e82475" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b722c92666ec451ea311dd3918e82475" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 } health_report { overall_health: UNKNOWN } } }
I20251211 09:10:05.787427 7090 raft_consensus.cc:1275] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 1 FOLLOWER]: Refusing update from remote peer b722c92666ec451ea311dd3918e82475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:05.787421 7015 raft_consensus.cc:1275] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 1 FOLLOWER]: Refusing update from remote peer b722c92666ec451ea311dd3918e82475: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:05.787674 7141 consensus_queue.cc:1048] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0f17a380a248cfbae69c6c05f11f7a" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:10:05.787774 7135 consensus_queue.cc:1048] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb9d3dd3ff74f38a53efa3636bc07c2" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 09:10:15.792481 7148 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37048: Illegal state: Transaction hasn't been successfully started
W20251211 09:10:15.792876 7148 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37048: Illegal state: Transaction metadata for transaction 1 does not exist
I20251211 09:10:15.795361 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:10:15.798194 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:15.798301 479 tablet_replica.cc:333] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475: stopping tablet replica
I20251211 09:10:15.798345 479 raft_consensus.cc:2243] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:15.798398 479 raft_consensus.cc:2272] T 83914e7dab4b4a8b8e6324db54079dc0 P b722c92666ec451ea311dd3918e82475 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:15.813959 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:10:15.814755 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:10:15.817265 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:15.817375 479 tablet_replica.cc:333] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2: stopping tablet replica
I20251211 09:10:15.817425 479 raft_consensus.cc:2243] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:15.817469 479 raft_consensus.cc:2272] T 83914e7dab4b4a8b8e6324db54079dc0 P 2fb9d3dd3ff74f38a53efa3636bc07c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:15.830713 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:10:15.831547 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:10:15.834519 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:15.834640 479 tablet_replica.cc:333] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a: stopping tablet replica
I20251211 09:10:15.834707 479 raft_consensus.cc:2243] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:15.834754 479 raft_consensus.cc:2272] T 83914e7dab4b4a8b8e6324db54079dc0 P 0a0f17a380a248cfbae69c6c05f11f7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:15.857949 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:10:15.858770 479 master.cc:561] Master@127.0.119.254:42703 shutting down...
I20251211 09:10:15.861191 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:15.861287 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:15.861325 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P a487eb7e43834463aa372c035374705a: stopping tablet replica
I20251211 09:10:15.872814 479 master.cc:583] Master@127.0.119.254:42703 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun (10495 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientRepeatCalls
I20251211 09:10:15.892535 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:41739
I20251211 09:10:15.892704 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:15.893867 7193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:15.894016 479 server_base.cc:1047] running on GCE node
W20251211 09:10:15.893921 7194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:15.894122 7196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:15.894217 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:15.894251 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:15.894265 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444215894266 us; error 0 us; skew 500 ppm
I20251211 09:10:15.894805 479 webserver.cc:492] Webserver started at http://127.0.119.254:45637/ using document root <none> and password file <none>
I20251211 09:10:15.894874 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:15.894906 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:15.894942 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:15.895190 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "0a98c4f015f74274a563009fe0534e6b"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.896014 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:15.896411 7201 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.896528 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.896570 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "0a98c4f015f74274a563009fe0534e6b"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.896616 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:15.910097 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:15.910302 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:15.912734 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:41739
I20251211 09:10:15.919050 7253 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:41739 every 8 connection(s)
I20251211 09:10:15.919176 7254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:15.920194 7254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b: Bootstrap starting.
I20251211 09:10:15.920502 7254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:15.920946 7254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b: No bootstrap required, opened a new log
I20251211 09:10:15.921061 7254 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a98c4f015f74274a563009fe0534e6b" member_type: VOTER }
I20251211 09:10:15.921111 7254 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:15.921133 7254 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a98c4f015f74274a563009fe0534e6b, State: Initialized, Role: FOLLOWER
I20251211 09:10:15.921190 7254 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a98c4f015f74274a563009fe0534e6b" member_type: VOTER }
I20251211 09:10:15.921221 7254 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:10:15.921285 7254 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:10:15.921317 7254 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:15.921787 7254 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a98c4f015f74274a563009fe0534e6b" member_type: VOTER }
I20251211 09:10:15.921841 7254 leader_election.cc:304] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a98c4f015f74274a563009fe0534e6b; no voters:
I20251211 09:10:15.921941 7254 leader_election.cc:290] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:10:15.922000 7257 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:15.922076 7254 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:10:15.922140 7257 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 1 LEADER]: Becoming Leader. State: Replica: 0a98c4f015f74274a563009fe0534e6b, State: Running, Role: LEADER
I20251211 09:10:15.922197 7257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a98c4f015f74274a563009fe0534e6b" member_type: VOTER }
I20251211 09:10:15.922417 7258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a98c4f015f74274a563009fe0534e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a98c4f015f74274a563009fe0534e6b" member_type: VOTER } }
I20251211 09:10:15.922500 7258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:15.922755 7262 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:10:15.922919 7262 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:10:15.923089 7259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a98c4f015f74274a563009fe0534e6b. Latest consensus state: current_term: 1 leader_uuid: "0a98c4f015f74274a563009fe0534e6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a98c4f015f74274a563009fe0534e6b" member_type: VOTER } }
I20251211 09:10:15.923154 7259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:15.923465 7262 catalog_manager.cc:1357] Generated new cluster ID: db04555b262547b1ad422daf323a20a0
I20251211 09:10:15.923486 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:10:15.923514 7262 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:10:15.935706 7262 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:10:15.936115 7262 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:10:15.941603 7262 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b: Generated new TSK 0
I20251211 09:10:15.941677 7262 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:10:15.955366 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:15.956729 7275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:15.956763 7278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:15.956840 479 server_base.cc:1047] running on GCE node
W20251211 09:10:15.956854 7276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:15.957094 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:15.957129 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:15.957142 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444215957142 us; error 0 us; skew 500 ppm
I20251211 09:10:15.957713 479 webserver.cc:492] Webserver started at http://127.0.119.193:46715/ using document root <none> and password file <none>
I20251211 09:10:15.957780 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:15.957813 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:15.957849 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:15.958093 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "6bc36fb6a15e4b2593b0ae61ece119d5"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.958920 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:15.959316 7283 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.959429 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.959472 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "6bc36fb6a15e4b2593b0ae61ece119d5"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.959527 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:15.975533 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:15.975729 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:15.975858 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:15.976030 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:15.976053 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.976079 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:15.976095 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.978807 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:33001
I20251211 09:10:15.979321 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:10:15.979439 7346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:33001 every 8 connection(s)
W20251211 09:10:15.980551 7349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:15.980592 7350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:15.980846 7354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:15.980854 479 server_base.cc:1047] running on GCE node
I20251211 09:10:15.981030 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:15.981057 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:15.981074 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444215981075 us; error 0 us; skew 500 ppm
I20251211 09:10:15.981796 479 webserver.cc:492] Webserver started at http://127.0.119.194:41981/ using document root <none> and password file <none>
I20251211 09:10:15.981880 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:15.981931 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:15.981989 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:15.982245 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "80ed555937a44fd1adb13e30f5b24b47"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.983074 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:15.983419 7347 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41739
I20251211 09:10:15.983472 7347 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:15.983588 7347 heartbeater.cc:507] Master 127.0.119.254:41739 requested a full tablet report, sending...
I20251211 09:10:15.983616 7359 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.983737 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.983781 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "80ed555937a44fd1adb13e30f5b24b47"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.983817 7218 ts_manager.cc:194] Registered new tserver with Master: 6bc36fb6a15e4b2593b0ae61ece119d5 (127.0.119.193:33001)
I20251211 09:10:15.983826 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:15.984457 7218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47584
I20251211 09:10:15.988843 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:15.989004 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:15.989131 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:15.989336 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:15.989365 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.989395 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:15.989426 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.992395 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:46843
I20251211 09:10:15.992456 7422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:46843 every 8 connection(s)
I20251211 09:10:15.992762 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:15.993863 7426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:15.993914 7427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:15.994143 479 server_base.cc:1047] running on GCE node
W20251211 09:10:15.994478 7429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:15.994668 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:15.994709 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:15.994729 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444215994729 us; error 0 us; skew 500 ppm
I20251211 09:10:15.995376 479 webserver.cc:492] Webserver started at http://127.0.119.195:38551/ using document root <none> and password file <none>
I20251211 09:10:15.995466 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:15.995514 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:15.995563 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:15.995800 7423 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41739
I20251211 09:10:15.995824 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "36a34cf5c69b4764a46a46456f0ab6b4"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.995869 7423 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:15.996037 7423 heartbeater.cc:507] Master 127.0.119.254:41739 requested a full tablet report, sending...
I20251211 09:10:15.996236 7218 ts_manager.cc:194] Registered new tserver with Master: 80ed555937a44fd1adb13e30f5b24b47 (127.0.119.194:46843)
I20251211 09:10:15.996542 7218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47594
I20251211 09:10:15.996804 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:15.997295 7434 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.997419 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:15.997462 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "36a34cf5c69b4764a46a46456f0ab6b4"
format_stamp: "Formatted at 2025-12-11 09:10:15 on dist-test-slave-hb70"
I20251211 09:10:15.997507 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:16.010735 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:16.010962 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:16.011134 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:16.011322 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:16.011350 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:16.011384 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:16.011413 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:16.014597 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:33513
I20251211 09:10:16.014650 7497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:33513 every 8 connection(s)
I20251211 09:10:16.017419 7498 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41739
I20251211 09:10:16.017474 7498 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:16.017566 7498 heartbeater.cc:507] Master 127.0.119.254:41739 requested a full tablet report, sending...
I20251211 09:10:16.017771 7218 ts_manager.cc:194] Registered new tserver with Master: 36a34cf5c69b4764a46a46456f0ab6b4 (127.0.119.195:33513)
I20251211 09:10:16.018087 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003310845s
I20251211 09:10:16.018132 7218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47604
I20251211 09:10:16.018411 479 test_util.cc:276] Using random seed: -2091002389
I20251211 09:10:16.022430 7218 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47614:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:10:16.022560 7218 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:10:16.026794 7387 tablet_service.cc:1505] Processing CreateTablet for tablet a0d2e36c758342738abaf7c9a14f8cc0 (DEFAULT_TABLE table=test-workload [id=0038344b3892460abe47146a3c168897]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:16.026930 7387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d2e36c758342738abaf7c9a14f8cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:16.027343 7311 tablet_service.cc:1505] Processing CreateTablet for tablet a0d2e36c758342738abaf7c9a14f8cc0 (DEFAULT_TABLE table=test-workload [id=0038344b3892460abe47146a3c168897]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:16.027443 7311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d2e36c758342738abaf7c9a14f8cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:16.028424 7513 tablet_bootstrap.cc:492] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47: Bootstrap starting.
I20251211 09:10:16.028785 7513 tablet_bootstrap.cc:654] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:16.029098 7462 tablet_service.cc:1505] Processing CreateTablet for tablet a0d2e36c758342738abaf7c9a14f8cc0 (DEFAULT_TABLE table=test-workload [id=0038344b3892460abe47146a3c168897]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:16.028798 7514 tablet_bootstrap.cc:492] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5: Bootstrap starting.
I20251211 09:10:16.029217 7462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d2e36c758342738abaf7c9a14f8cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:16.029536 7513 tablet_bootstrap.cc:492] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47: No bootstrap required, opened a new log
I20251211 09:10:16.029610 7513 ts_tablet_manager.cc:1403] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:16.029706 7514 tablet_bootstrap.cc:654] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:16.029827 7513 raft_consensus.cc:359] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.029932 7513 raft_consensus.cc:385] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:16.029989 7513 raft_consensus.cc:740] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80ed555937a44fd1adb13e30f5b24b47, State: Initialized, Role: FOLLOWER
I20251211 09:10:16.030077 7513 consensus_queue.cc:260] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.030269 7513 ts_tablet_manager.cc:1434] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:10:16.030305 7423 heartbeater.cc:499] Master 127.0.119.254:41739 was elected leader, sending a full tablet report...
I20251211 09:10:16.030246 7514 tablet_bootstrap.cc:492] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5: No bootstrap required, opened a new log
I20251211 09:10:16.030434 7514 ts_tablet_manager.cc:1403] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:10:16.030588 7514 raft_consensus.cc:359] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.030637 7518 tablet_bootstrap.cc:492] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4: Bootstrap starting.
I20251211 09:10:16.030658 7514 raft_consensus.cc:385] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:16.030706 7514 raft_consensus.cc:740] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bc36fb6a15e4b2593b0ae61ece119d5, State: Initialized, Role: FOLLOWER
I20251211 09:10:16.030752 7514 consensus_queue.cc:260] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.030925 7514 ts_tablet_manager.cc:1434] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:16.031018 7347 heartbeater.cc:499] Master 127.0.119.254:41739 was elected leader, sending a full tablet report...
I20251211 09:10:16.031101 7518 tablet_bootstrap.cc:654] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:16.031621 7518 tablet_bootstrap.cc:492] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4: No bootstrap required, opened a new log
I20251211 09:10:16.031673 7518 ts_tablet_manager.cc:1403] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:16.031812 7518 raft_consensus.cc:359] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.031857 7518 raft_consensus.cc:385] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:16.031880 7518 raft_consensus.cc:740] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a34cf5c69b4764a46a46456f0ab6b4, State: Initialized, Role: FOLLOWER
I20251211 09:10:16.031945 7518 consensus_queue.cc:260] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.032086 7518 ts_tablet_manager.cc:1434] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:10:16.032126 7498 heartbeater.cc:499] Master 127.0.119.254:41739 was elected leader, sending a full tablet report...
I20251211 09:10:16.123255 7519 raft_consensus.cc:493] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:10:16.123356 7519 raft_consensus.cc:515] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.123550 7519 leader_election.cc:290] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80ed555937a44fd1adb13e30f5b24b47 (127.0.119.194:46843), 36a34cf5c69b4764a46a46456f0ab6b4 (127.0.119.195:33513)
I20251211 09:10:16.126945 7472 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0d2e36c758342738abaf7c9a14f8cc0" candidate_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" is_pre_election: true
I20251211 09:10:16.126947 7397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0d2e36c758342738abaf7c9a14f8cc0" candidate_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80ed555937a44fd1adb13e30f5b24b47" is_pre_election: true
I20251211 09:10:16.127065 7472 raft_consensus.cc:2468] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bc36fb6a15e4b2593b0ae61ece119d5 in term 0.
I20251211 09:10:16.127084 7397 raft_consensus.cc:2468] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bc36fb6a15e4b2593b0ae61ece119d5 in term 0.
I20251211 09:10:16.127213 7285 leader_election.cc:304] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a34cf5c69b4764a46a46456f0ab6b4, 6bc36fb6a15e4b2593b0ae61ece119d5; no voters:
I20251211 09:10:16.127317 7519 raft_consensus.cc:2804] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:10:16.127365 7519 raft_consensus.cc:493] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:10:16.127398 7519 raft_consensus.cc:3060] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:16.128039 7519 raft_consensus.cc:515] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.128175 7519 leader_election.cc:290] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [CANDIDATE]: Term 1 election: Requested vote from peers 80ed555937a44fd1adb13e30f5b24b47 (127.0.119.194:46843), 36a34cf5c69b4764a46a46456f0ab6b4 (127.0.119.195:33513)
I20251211 09:10:16.128304 7472 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0d2e36c758342738abaf7c9a14f8cc0" candidate_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a34cf5c69b4764a46a46456f0ab6b4"
I20251211 09:10:16.128304 7397 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0d2e36c758342738abaf7c9a14f8cc0" candidate_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80ed555937a44fd1adb13e30f5b24b47"
I20251211 09:10:16.128365 7472 raft_consensus.cc:3060] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:16.128381 7397 raft_consensus.cc:3060] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:16.128918 7472 raft_consensus.cc:2468] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc36fb6a15e4b2593b0ae61ece119d5 in term 1.
I20251211 09:10:16.129001 7397 raft_consensus.cc:2468] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bc36fb6a15e4b2593b0ae61ece119d5 in term 1.
I20251211 09:10:16.129077 7285 leader_election.cc:304] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a34cf5c69b4764a46a46456f0ab6b4, 6bc36fb6a15e4b2593b0ae61ece119d5; no voters:
I20251211 09:10:16.129156 7519 raft_consensus.cc:2804] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:16.129341 7519 raft_consensus.cc:697] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 1 LEADER]: Becoming Leader. State: Replica: 6bc36fb6a15e4b2593b0ae61ece119d5, State: Running, Role: LEADER
I20251211 09:10:16.129396 7519 consensus_queue.cc:237] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } }
I20251211 09:10:16.129931 7217 catalog_manager.cc:5654] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6bc36fb6a15e4b2593b0ae61ece119d5 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bc36fb6a15e4b2593b0ae61ece119d5" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 } health_report { overall_health: UNKNOWN } } }
I20251211 09:10:16.152828 7472 raft_consensus.cc:1275] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 1 FOLLOWER]: Refusing update from remote peer 6bc36fb6a15e4b2593b0ae61ece119d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:16.152997 7397 raft_consensus.cc:1275] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 1 FOLLOWER]: Refusing update from remote peer 6bc36fb6a15e4b2593b0ae61ece119d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:16.153085 7523 consensus_queue.cc:1048] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a34cf5c69b4764a46a46456f0ab6b4" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:10:16.153187 7519 consensus_queue.cc:1048] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80ed555937a44fd1adb13e30f5b24b47" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 46843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251211 09:10:26.161352 7530 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35646: Illegal state: Transaction 1 already open
W20251211 09:10:26.162789 7530 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35646: Illegal state: Transaction 1 commit already in progress
W20251211 09:10:26.164170 7530 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35646: Illegal state: Transaction metadata for transaction 1 already set
W20251211 09:10:26.165472 7530 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35646: Illegal state: Transaction 2 already open
W20251211 09:10:26.166841 7530 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35646: Illegal state: Transaction 2 commit already in progress
W20251211 09:10:26.168219 7530 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35646: Illegal state: Transaction metadata for transaction 2 already set
I20251211 09:10:26.168615 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:10:26.171276 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:26.171377 479 tablet_replica.cc:333] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5: stopping tablet replica
I20251211 09:10:26.171420 479 raft_consensus.cc:2243] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:26.171481 479 raft_consensus.cc:2272] T a0d2e36c758342738abaf7c9a14f8cc0 P 6bc36fb6a15e4b2593b0ae61ece119d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:26.178567 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:10:26.179458 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:10:26.182046 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:26.182183 479 tablet_replica.cc:333] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47: stopping tablet replica
I20251211 09:10:26.182252 479 raft_consensus.cc:2243] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:26.182307 479 raft_consensus.cc:2272] T a0d2e36c758342738abaf7c9a14f8cc0 P 80ed555937a44fd1adb13e30f5b24b47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:26.195870 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:10:26.197021 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:10:26.199827 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:26.199973 479 tablet_replica.cc:333] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4: stopping tablet replica
I20251211 09:10:26.200057 479 raft_consensus.cc:2243] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:26.200101 479 raft_consensus.cc:2272] T a0d2e36c758342738abaf7c9a14f8cc0 P 36a34cf5c69b4764a46a46456f0ab6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:26.213913 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:10:26.214901 479 master.cc:561] Master@127.0.119.254:41739 shutting down...
I20251211 09:10:26.216996 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:26.217074 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:26.217113 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0a98c4f015f74274a563009fe0534e6b: stopping tablet replica
I20251211 09:10:26.229076 479 master.cc:583] Master@127.0.119.254:41739 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientRepeatCalls (10357 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority
I20251211 09:10:26.249689 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:45661
I20251211 09:10:26.249866 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:26.251220 7573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:26.251194 7572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:26.251332 7575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:26.251319 479 server_base.cc:1047] running on GCE node
I20251211 09:10:26.251652 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:26.251688 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:26.251710 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444226251710 us; error 0 us; skew 500 ppm
I20251211 09:10:26.252378 479 webserver.cc:492] Webserver started at http://127.0.119.254:45397/ using document root <none> and password file <none>
I20251211 09:10:26.252470 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:26.252516 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:26.252573 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:26.252846 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "d324de1d58a84a7f807822e92a7abf58"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.253849 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:10:26.254369 7580 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.254515 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251211 09:10:26.254582 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "d324de1d58a84a7f807822e92a7abf58"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.254640 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:26.262388 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:26.262605 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:26.265170 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:45661
I20251211 09:10:26.268587 7633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:26.270084 7632 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:45661 every 8 connection(s)
I20251211 09:10:26.270773 7633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58: Bootstrap starting.
I20251211 09:10:26.271071 7633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:26.271581 7633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58: No bootstrap required, opened a new log
I20251211 09:10:26.271705 7633 raft_consensus.cc:359] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d324de1d58a84a7f807822e92a7abf58" member_type: VOTER }
I20251211 09:10:26.271755 7633 raft_consensus.cc:385] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:26.271770 7633 raft_consensus.cc:740] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d324de1d58a84a7f807822e92a7abf58, State: Initialized, Role: FOLLOWER
I20251211 09:10:26.271832 7633 consensus_queue.cc:260] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d324de1d58a84a7f807822e92a7abf58" member_type: VOTER }
I20251211 09:10:26.271874 7633 raft_consensus.cc:399] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:10:26.271890 7633 raft_consensus.cc:493] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:10:26.271920 7633 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:26.272392 7633 raft_consensus.cc:515] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d324de1d58a84a7f807822e92a7abf58" member_type: VOTER }
I20251211 09:10:26.272446 7633 leader_election.cc:304] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d324de1d58a84a7f807822e92a7abf58; no voters:
I20251211 09:10:26.272562 7633 leader_election.cc:290] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:10:26.272616 7636 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:26.272707 7633 sys_catalog.cc:565] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:10:26.272794 7636 raft_consensus.cc:697] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 1 LEADER]: Becoming Leader. State: Replica: d324de1d58a84a7f807822e92a7abf58, State: Running, Role: LEADER
I20251211 09:10:26.272854 7636 consensus_queue.cc:237] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d324de1d58a84a7f807822e92a7abf58" member_type: VOTER }
I20251211 09:10:26.273049 7637 sys_catalog.cc:455] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d324de1d58a84a7f807822e92a7abf58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d324de1d58a84a7f807822e92a7abf58" member_type: VOTER } }
I20251211 09:10:26.273061 7638 sys_catalog.cc:455] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d324de1d58a84a7f807822e92a7abf58. Latest consensus state: current_term: 1 leader_uuid: "d324de1d58a84a7f807822e92a7abf58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d324de1d58a84a7f807822e92a7abf58" member_type: VOTER } }
I20251211 09:10:26.273129 7637 sys_catalog.cc:458] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:26.273137 7638 sys_catalog.cc:458] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:26.273554 7641 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:10:26.273689 7641 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:10:26.274232 7641 catalog_manager.cc:1357] Generated new cluster ID: 9af35fe31fa04e7e9809d02a4279ba51
I20251211 09:10:26.274242 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:10:26.274291 7641 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:10:26.291684 7641 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:10:26.292133 7641 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:10:26.299952 7641 catalog_manager.cc:6027] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58: Generated new TSK 0
I20251211 09:10:26.300050 7641 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:10:26.306217 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:26.307601 7654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:26.307610 479 server_base.cc:1047] running on GCE node
W20251211 09:10:26.307708 7657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:26.307754 7655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:26.307899 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:26.307971 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:26.307983 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444226307984 us; error 0 us; skew 500 ppm
I20251211 09:10:26.308566 479 webserver.cc:492] Webserver started at http://127.0.119.193:41941/ using document root <none> and password file <none>
I20251211 09:10:26.308646 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:26.308693 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:26.308745 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:26.309190 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "cf3883d1bea64b1b923d4c93fcbbf114"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.310231 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:10:26.310674 7662 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.310807 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.310845 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "cf3883d1bea64b1b923d4c93fcbbf114"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.310880 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:26.316218 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:26.316399 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:26.316517 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:26.316664 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:26.316686 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.316712 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:26.316730 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.319474 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:41499
I20251211 09:10:26.320185 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:10:26.320482 7725 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:41499 every 8 connection(s)
W20251211 09:10:26.321513 7731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:26.321597 7729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:26.321695 479 server_base.cc:1047] running on GCE node
W20251211 09:10:26.321785 7728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:26.321950 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:26.321995 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:26.322007 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444226322008 us; error 0 us; skew 500 ppm
I20251211 09:10:26.322711 479 webserver.cc:492] Webserver started at http://127.0.119.194:46319/ using document root <none> and password file <none>
I20251211 09:10:26.322796 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:26.322839 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:26.322885 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:26.323235 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "91da88c58f3040a888401bef2bb0db59"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.324415 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:10:26.324750 7726 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45661
I20251211 09:10:26.324812 7726 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:26.324925 7738 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.324928 7726 heartbeater.cc:507] Master 127.0.119.254:45661 requested a full tablet report, sending...
I20251211 09:10:26.325055 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.325099 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "91da88c58f3040a888401bef2bb0db59"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.325136 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:26.325268 7597 ts_manager.cc:194] Registered new tserver with Master: cf3883d1bea64b1b923d4c93fcbbf114 (127.0.119.193:41499)
I20251211 09:10:26.325898 7597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50316
I20251211 09:10:26.336318 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:26.336535 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:26.336688 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:26.336876 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:26.336907 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.336953 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:26.336980 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.340232 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:38625
I20251211 09:10:26.340298 7801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:38625 every 8 connection(s)
I20251211 09:10:26.340638 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:26.342015 7808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:26.342015 7805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:26.342108 7806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:26.342263 479 server_base.cc:1047] running on GCE node
I20251211 09:10:26.342387 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:26.342406 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:26.342417 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444226342418 us; error 0 us; skew 500 ppm
I20251211 09:10:26.343039 479 webserver.cc:492] Webserver started at http://127.0.119.195:37621/ using document root <none> and password file <none>
I20251211 09:10:26.343116 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:26.343144 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:26.343174 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:26.343405 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "9f36822803a94fe3a8a23fdd1f7879bf"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.344177 7802 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45661
I20251211 09:10:26.344249 7802 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:26.344314 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:26.344350 7802 heartbeater.cc:507] Master 127.0.119.254:45661 requested a full tablet report, sending...
I20251211 09:10:26.344597 7597 ts_manager.cc:194] Registered new tserver with Master: 91da88c58f3040a888401bef2bb0db59 (127.0.119.194:38625)
I20251211 09:10:26.344867 7813 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.345012 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.345021 7597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50328
I20251211 09:10:26.345075 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "9f36822803a94fe3a8a23fdd1f7879bf"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:26.345129 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:26.351903 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:26.352103 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:26.352234 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:26.352407 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:26.352432 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.352453 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:26.352481 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:26.355826 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:45595
I20251211 09:10:26.355880 7876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:45595 every 8 connection(s)
I20251211 09:10:26.358929 7877 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45661
I20251211 09:10:26.358989 7877 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:26.359093 7877 heartbeater.cc:507] Master 127.0.119.254:45661 requested a full tablet report, sending...
I20251211 09:10:26.359337 7597 ts_manager.cc:194] Registered new tserver with Master: 9f36822803a94fe3a8a23fdd1f7879bf (127.0.119.195:45595)
I20251211 09:10:26.359352 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003358268s
I20251211 09:10:26.359676 7597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50336
I20251211 09:10:26.359735 479 test_util.cc:276] Using random seed: -2080661066
I20251211 09:10:26.364163 7597 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50344:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:10:26.364308 7597 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:10:26.368706 7690 tablet_service.cc:1505] Processing CreateTablet for tablet 1a5e995478be4ad4a505e7867a4b0ed2 (DEFAULT_TABLE table=test-workload [id=94044f6053df45a195cd770a9bbeb530]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:26.368857 7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5e995478be4ad4a505e7867a4b0ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:26.369414 7841 tablet_service.cc:1505] Processing CreateTablet for tablet 1a5e995478be4ad4a505e7867a4b0ed2 (DEFAULT_TABLE table=test-workload [id=94044f6053df45a195cd770a9bbeb530]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:26.369524 7841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5e995478be4ad4a505e7867a4b0ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:26.369905 7766 tablet_service.cc:1505] Processing CreateTablet for tablet 1a5e995478be4ad4a505e7867a4b0ed2 (DEFAULT_TABLE table=test-workload [id=94044f6053df45a195cd770a9bbeb530]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:26.370035 7766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5e995478be4ad4a505e7867a4b0ed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:26.370548 7892 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114: Bootstrap starting.
I20251211 09:10:26.370924 7893 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Bootstrap starting.
I20251211 09:10:26.371085 7892 tablet_bootstrap.cc:654] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:26.371356 7893 tablet_bootstrap.cc:654] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:26.371381 7894 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Bootstrap starting.
I20251211 09:10:26.371872 7894 tablet_bootstrap.cc:654] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:26.371954 7893 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: No bootstrap required, opened a new log
I20251211 09:10:26.372010 7893 ts_tablet_manager.cc:1403] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:26.372186 7893 raft_consensus.cc:359] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.372242 7893 raft_consensus.cc:385] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:26.372267 7893 raft_consensus.cc:740] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f36822803a94fe3a8a23fdd1f7879bf, State: Initialized, Role: FOLLOWER
I20251211 09:10:26.372316 7893 consensus_queue.cc:260] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.372431 7894 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: No bootstrap required, opened a new log
I20251211 09:10:26.372447 7893 ts_tablet_manager.cc:1434] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:10:26.372498 7894 ts_tablet_manager.cc:1403] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:26.372538 7877 heartbeater.cc:499] Master 127.0.119.254:45661 was elected leader, sending a full tablet report...
I20251211 09:10:26.372629 7892 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114: No bootstrap required, opened a new log
I20251211 09:10:26.372674 7892 ts_tablet_manager.cc:1403] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:10:26.372653 7894 raft_consensus.cc:359] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.372718 7894 raft_consensus.cc:385] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:26.372749 7894 raft_consensus.cc:740] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91da88c58f3040a888401bef2bb0db59, State: Initialized, Role: FOLLOWER
I20251211 09:10:26.372817 7894 consensus_queue.cc:260] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.372834 7892 raft_consensus.cc:359] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.372956 7892 raft_consensus.cc:385] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:26.372983 7894 ts_tablet_manager.cc:1434] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:10:26.373001 7892 raft_consensus.cc:740] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3883d1bea64b1b923d4c93fcbbf114, State: Initialized, Role: FOLLOWER
I20251211 09:10:26.373052 7802 heartbeater.cc:499] Master 127.0.119.254:45661 was elected leader, sending a full tablet report...
I20251211 09:10:26.373054 7892 consensus_queue.cc:260] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.373376 7892 ts_tablet_manager.cc:1434] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:26.373466 7726 heartbeater.cc:499] Master 127.0.119.254:45661 was elected leader, sending a full tablet report...
I20251211 09:10:26.379210 7900 raft_consensus.cc:493] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:10:26.379287 7900 raft_consensus.cc:515] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.379487 7900 leader_election.cc:290] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91da88c58f3040a888401bef2bb0db59 (127.0.119.194:38625), 9f36822803a94fe3a8a23fdd1f7879bf (127.0.119.195:45595)
I20251211 09:10:26.382129 7851 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a5e995478be4ad4a505e7867a4b0ed2" candidate_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" is_pre_election: true
I20251211 09:10:26.382136 7776 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a5e995478be4ad4a505e7867a4b0ed2" candidate_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91da88c58f3040a888401bef2bb0db59" is_pre_election: true
I20251211 09:10:26.382226 7851 raft_consensus.cc:2468] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3883d1bea64b1b923d4c93fcbbf114 in term 0.
I20251211 09:10:26.382242 7776 raft_consensus.cc:2468] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3883d1bea64b1b923d4c93fcbbf114 in term 0.
I20251211 09:10:26.382385 7663 leader_election.cc:304] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f36822803a94fe3a8a23fdd1f7879bf, cf3883d1bea64b1b923d4c93fcbbf114; no voters:
I20251211 09:10:26.382477 7900 raft_consensus.cc:2804] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:10:26.382524 7900 raft_consensus.cc:493] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:10:26.382539 7900 raft_consensus.cc:3060] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:26.383167 7900 raft_consensus.cc:515] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.383270 7900 leader_election.cc:290] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [CANDIDATE]: Term 1 election: Requested vote from peers 91da88c58f3040a888401bef2bb0db59 (127.0.119.194:38625), 9f36822803a94fe3a8a23fdd1f7879bf (127.0.119.195:45595)
I20251211 09:10:26.383440 7776 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a5e995478be4ad4a505e7867a4b0ed2" candidate_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91da88c58f3040a888401bef2bb0db59"
I20251211 09:10:26.383471 7851 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a5e995478be4ad4a505e7867a4b0ed2" candidate_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f36822803a94fe3a8a23fdd1f7879bf"
I20251211 09:10:26.383499 7776 raft_consensus.cc:3060] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:26.383517 7851 raft_consensus.cc:3060] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:26.384250 7776 raft_consensus.cc:2468] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3883d1bea64b1b923d4c93fcbbf114 in term 1.
I20251211 09:10:26.384294 7851 raft_consensus.cc:2468] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3883d1bea64b1b923d4c93fcbbf114 in term 1.
I20251211 09:10:26.384431 7663 leader_election.cc:304] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f36822803a94fe3a8a23fdd1f7879bf, cf3883d1bea64b1b923d4c93fcbbf114; no voters:
I20251211 09:10:26.384507 7900 raft_consensus.cc:2804] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:26.384639 7900 raft_consensus.cc:697] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 1 LEADER]: Becoming Leader. State: Replica: cf3883d1bea64b1b923d4c93fcbbf114, State: Running, Role: LEADER
I20251211 09:10:26.384682 7900 consensus_queue.cc:237] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:26.385229 7596 catalog_manager.cc:5654] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf3883d1bea64b1b923d4c93fcbbf114 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20251211 09:10:26.399529 7851 raft_consensus.cc:1275] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Refusing update from remote peer cf3883d1bea64b1b923d4c93fcbbf114: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:26.399756 7902 consensus_queue.cc:1048] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:10:26.399801 7776 raft_consensus.cc:1275] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Refusing update from remote peer cf3883d1bea64b1b923d4c93fcbbf114: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:26.400009 7902 consensus_queue.cc:1048] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:10:26.401787 7910 mvcc.cc:204] Tried to move back new op lower bound from 7231259551333179392 to 7231259551272157184. Current Snapshot: MvccSnapshot[applied={T|T < 7231259551331205120}]
I20251211 09:10:36.395277 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:10:36.397703 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:36.397845 479 tablet_replica.cc:333] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: stopping tablet replica
I20251211 09:10:36.397909 479 raft_consensus.cc:2243] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:36.397967 479 raft_consensus.cc:2272] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:36.411214 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:10:36.412117 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:10:36.415112 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:36.415258 479 tablet_replica.cc:333] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: stopping tablet replica
I20251211 09:10:36.415349 479 raft_consensus.cc:2243] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:36.415395 479 raft_consensus.cc:2272] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:36.434594 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
W20251211 09:10:36.442516 7663 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.119.195:45595: connect: Connection refused (error 111)
W20251211 09:10:36.442916 7663 consensus_peers.cc:597] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 -> Peer 9f36822803a94fe3a8a23fdd1f7879bf (127.0.119.195:45595): Couldn't send request to peer 9f36822803a94fe3a8a23fdd1f7879bf. Status: Network error: Client connection negotiation failed: client connection to 127.0.119.195:45595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251211 09:10:36.442975 7663 consensus_peers.cc:597] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 -> Peer 91da88c58f3040a888401bef2bb0db59 (127.0.119.194:38625): Couldn't send request to peer 91da88c58f3040a888401bef2bb0db59. Status: Network error: Client connection negotiation failed: client connection to 127.0.119.194:38625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251211 09:10:37.441395 7941 meta_cache.cc:302] tablet 1a5e995478be4ad4a505e7867a4b0ed2: replica cf3883d1bea64b1b923d4c93fcbbf114 (127.0.119.193:41499) has failed: Timed out: ParticipateInTransaction RPC to 127.0.119.193:41499 timed out after 1.000s (SENT)
I20251211 09:10:37.441762 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:37.443360 7957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:37.443496 479 server_base.cc:1047] running on GCE node
W20251211 09:10:37.443387 7954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:37.443524 7955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:37.443753 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:37.443786 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:37.443807 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444237443808 us; error 0 us; skew 500 ppm
I20251211 09:10:37.444532 479 webserver.cc:492] Webserver started at http://127.0.119.194:46319/ using document root <none> and password file <none>
I20251211 09:10:37.444622 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:37.444662 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:10:37.445228 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:37.445729 7962 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:37.445875 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:37.445914 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "91da88c58f3040a888401bef2bb0db59"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:37.445967 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:37.456303 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:37.456490 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:37.456630 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:37.456919 7969 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251211 09:10:37.457561 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:10:37.457618 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:10:37.457656 479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251211 09:10:37.458053 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:10:37.458086 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:37.458104 7969 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Bootstrap starting.
I20251211 09:10:37.461812 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:38625
I20251211 09:10:37.468421 8027 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:38625 every 8 connection(s)
I20251211 09:10:37.471915 8028 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45661
I20251211 09:10:37.471997 8028 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:37.472107 8028 heartbeater.cc:507] Master 127.0.119.254:45661 requested a full tablet report, sending...
I20251211 09:10:37.472393 7594 ts_manager.cc:194] Re-registered known tserver with Master: 91da88c58f3040a888401bef2bb0db59 (127.0.119.194:38625)
I20251211 09:10:37.472919 7594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55098
I20251211 09:10:38.233675 7969 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Bootstrap replayed 1/3 log segments. Stats: ops{read=4991 overwritten=0 applied=4988 ignored=0} inserts{seen=249350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20251211 09:10:38.473565 8028 heartbeater.cc:499] Master 127.0.119.254:45661 was elected leader, sending a full tablet report...
W20251211 09:10:38.956662 7663 consensus_peers.cc:597] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 -> Peer 9f36822803a94fe3a8a23fdd1f7879bf (127.0.119.195:45595): Couldn't send request to peer 9f36822803a94fe3a8a23fdd1f7879bf. Status: Network error: Client connection negotiation failed: client connection to 127.0.119.195:45595: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20251211 09:10:39.063659 7969 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Bootstrap replayed 2/3 log segments. Stats: ops{read=10001 overwritten=0 applied=9999 ignored=0} inserts{seen=499900 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
W20251211 09:10:39.101037 7663 consensus_peers.cc:597] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 -> Peer 91da88c58f3040a888401bef2bb0db59 (127.0.119.194:38625): Couldn't send request to peer 91da88c58f3040a888401bef2bb0db59. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20251211 09:10:39.620234 7969 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Bootstrap replayed 3/3 log segments. Stats: ops{read=13174 overwritten=0 applied=13174 ignored=0} inserts{seen=658650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:10:39.620654 7969 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Bootstrap complete.
I20251211 09:10:39.625056 7969 ts_tablet_manager.cc:1403] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Time spent bootstrapping tablet: real 2.167s user 1.888s sys 0.272s
I20251211 09:10:39.625223 7969 raft_consensus.cc:359] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:39.625329 7969 raft_consensus.cc:740] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91da88c58f3040a888401bef2bb0db59, State: Initialized, Role: FOLLOWER
I20251211 09:10:39.625385 7969 consensus_queue.cc:260] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13174, Last appended: 1.13174, Last appended by leader: 13174, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:39.625561 7969 ts_tablet_manager.cc:1434] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59: Time spent starting tablet: real 0.000s user 0.004s sys 0.000s
I20251211 09:10:39.625770 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:39.627017 8037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:39.627091 8040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:39.627163 479 server_base.cc:1047] running on GCE node
W20251211 09:10:39.627147 8038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:39.627408 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:39.627444 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:39.627466 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444239627466 us; error 0 us; skew 500 ppm
I20251211 09:10:39.628193 479 webserver.cc:492] Webserver started at http://127.0.119.195:37621/ using document root <none> and password file <none>
I20251211 09:10:39.628291 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:39.628327 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:10:39.628890 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20251211 09:10:39.629416 8045 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:39.629601 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:39.629654 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "9f36822803a94fe3a8a23fdd1f7879bf"
format_stamp: "Formatted at 2025-12-11 09:10:26 on dist-test-slave-hb70"
I20251211 09:10:39.629711 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:39.636632 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:39.636853 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:39.637012 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:39.637322 8052 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251211 09:10:39.637918 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:10:39.638031 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:10:39.638077 479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251211 09:10:39.638486 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:10:39.638515 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:39.638532 8052 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Bootstrap starting.
I20251211 09:10:39.642179 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:45595
I20251211 09:10:39.642230 8110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:45595 every 8 connection(s)
I20251211 09:10:39.651187 8111 heartbeater.cc:344] Connected to a master server at 127.0.119.254:45661
I20251211 09:10:39.651275 8111 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:39.651400 8111 heartbeater.cc:507] Master 127.0.119.254:45661 requested a full tablet report, sending...
I20251211 09:10:39.651736 7594 ts_manager.cc:194] Re-registered known tserver with Master: 9f36822803a94fe3a8a23fdd1f7879bf (127.0.119.195:45595)
I20251211 09:10:39.652247 7594 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55106
W20251211 09:10:39.695214 8118 rpcz_store.cc:267] Call kudu.tserver.TabletServerAdminService.ParticipateInTransaction from 127.0.0.1:33962 (ReqId={client: e29f6b9725bc47aa975ff7a14ff7b744, seq_no=0, attempt_no=0}) took 3253 ms (client timeout 999 ms). Trace:
W20251211 09:10:39.695333 8118 rpcz_store.cc:269] 1211 09:10:36.441930 (+ 0us) service_pool.cc:168] Inserting onto call queue
1211 09:10:36.441961 (+ 31us) service_pool.cc:225] Handling call
1211 09:10:39.695124 (+3253163us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1211 09:10:36.442041 (+ 0us) participant_op.cc:163] PREPARE: starting
1211 09:10:36.442046 (+ 5us) participant_op.cc:199] PREPARE: finished
1211 09:10:36.442054 (+ 8us) participant_op.cc:212] START. Timestamp: 1765444236442051
1211 09:10:36.442054 (+ 0us) op_driver.cc:348] REPLICATION: starting
1211 09:10:36.442082 (+ 28us) log.cc:844] Serialized 66 byte log entry
1211 09:10:39.694829 (+3252747us) op_driver.cc:464] REPLICATION: finished
1211 09:10:39.694985 (+ 156us) participant_op.cc:265] APPLY: starting
1211 09:10:39.695037 (+ 52us) participant_op.cc:270] APPLY: finished
1211 09:10:39.695049 (+ 12us) log.cc:844] Serialized 15 byte log entry
1211 09:10:39.695118 (+ 69us) participant_op.cc:94] Released txn lock
1211 09:10:39.695119 (+ 1us) participant_op.cc:291] FINISH: Op applied
Metrics: {"child_traces":[["op",{"apply.queue_time_us":147,"prepare.queue_time_us":26,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":81,"raft.queue_time_us":62,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"replication_time_us":3252770,"thread_start_us":123,"threads_started":2,"wal-append.queue_time_us":331}]]}
I20251211 09:10:40.368966 8052 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Bootstrap replayed 1/3 log segments. Stats: ops{read=4980 overwritten=0 applied=4977 ignored=0} inserts{seen=248800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20251211 09:10:40.652838 8111 heartbeater.cc:499] Master 127.0.119.254:45661 was elected leader, sending a full tablet report...
I20251211 09:10:41.194770 8052 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Bootstrap replayed 2/3 log segments. Stats: ops{read=9988 overwritten=0 applied=9985 ignored=0} inserts{seen=499200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
W20251211 09:10:41.634573 7663 consensus_peers.cc:597] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 -> Peer 9f36822803a94fe3a8a23fdd1f7879bf (127.0.119.195:45595): Couldn't send request to peer 9f36822803a94fe3a8a23fdd1f7879bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20251211 09:10:41.719863 8052 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Bootstrap replayed 3/3 log segments. Stats: ops{read=13174 overwritten=0 applied=13174 ignored=0} inserts{seen=658650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:10:41.720326 8052 tablet_bootstrap.cc:492] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Bootstrap complete.
I20251211 09:10:41.724772 8052 ts_tablet_manager.cc:1403] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Time spent bootstrapping tablet: real 2.086s user 1.810s sys 0.272s
I20251211 09:10:41.724951 8052 raft_consensus.cc:359] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:41.725023 8052 raft_consensus.cc:740] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f36822803a94fe3a8a23fdd1f7879bf, State: Initialized, Role: FOLLOWER
I20251211 09:10:41.725085 8052 consensus_queue.cc:260] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13174, Last appended: 1.13174, Last appended by leader: 13174, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf3883d1bea64b1b923d4c93fcbbf114" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 41499 } } peers { permanent_uuid: "91da88c58f3040a888401bef2bb0db59" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 38625 } } peers { permanent_uuid: "9f36822803a94fe3a8a23fdd1f7879bf" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 45595 } }
I20251211 09:10:41.725275 8052 ts_tablet_manager.cc:1434] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf: Time spent starting tablet: real 0.000s user 0.003s sys 0.001s
I20251211 09:10:42.238199 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:10:42.240816 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:42.240980 479 tablet_replica.cc:333] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114: stopping tablet replica
I20251211 09:10:42.241056 479 raft_consensus.cc:2243] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:42.241144 479 raft_consensus.cc:2272] T 1a5e995478be4ad4a505e7867a4b0ed2 P cf3883d1bea64b1b923d4c93fcbbf114 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:42.254347 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:10:42.255151 479 tablet_server.cc:178] TabletServer@127.0.119.194:38625 shutting down...
I20251211 09:10:42.257547 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:42.257652 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:10:42.257709 479 raft_consensus.cc:2243] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:42.257758 479 raft_consensus.cc:2272] T 1a5e995478be4ad4a505e7867a4b0ed2 P 91da88c58f3040a888401bef2bb0db59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:42.275193 479 tablet_server.cc:195] TabletServer@127.0.119.194:38625 shutdown complete.
I20251211 09:10:42.276031 479 tablet_server.cc:178] TabletServer@127.0.119.195:45595 shutting down...
I20251211 09:10:42.278271 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:42.278403 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:10:42.278460 479 raft_consensus.cc:2243] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:10:42.278520 479 raft_consensus.cc:2272] T 1a5e995478be4ad4a505e7867a4b0ed2 P 9f36822803a94fe3a8a23fdd1f7879bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:42.281162 479 tablet_server.cc:195] TabletServer@127.0.119.195:45595 shutdown complete.
I20251211 09:10:42.281855 479 master.cc:561] Master@127.0.119.254:45661 shutting down...
I20251211 09:10:42.283758 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:10:42.283823 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:42.283843 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P d324de1d58a84a7f807822e92a7abf58: stopping tablet replica
I20251211 09:10:42.295382 479 master.cc:583] Master@127.0.119.254:45661 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority (16063 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap
I20251211 09:10:42.313278 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:41443
I20251211 09:10:42.313445 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:42.314553 8130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.314639 8132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.314635 8129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:42.314795 479 server_base.cc:1047] running on GCE node
I20251211 09:10:42.314900 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:42.314926 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:42.314939 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444242314939 us; error 0 us; skew 500 ppm
I20251211 09:10:42.315505 479 webserver.cc:492] Webserver started at http://127.0.119.254:40125/ using document root <none> and password file <none>
I20251211 09:10:42.315580 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:42.315631 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:42.315685 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:42.315934 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.316758 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:42.317158 8137 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.317329 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.317378 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.317414 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:42.327894 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:42.328032 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:42.330468 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:41443
I20251211 09:10:42.333503 8190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:42.342525 8189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:41443 every 8 connection(s)
I20251211 09:10:42.343115 8190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4: Bootstrap starting.
I20251211 09:10:42.343397 8190 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:42.343855 8190 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4: No bootstrap required, opened a new log
I20251211 09:10:42.343964 8190 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" member_type: VOTER }
I20251211 09:10:42.344026 8190 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:42.344040 8190 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f25d28dff434cfcbd3cd8afcd6c7dd4, State: Initialized, Role: FOLLOWER
I20251211 09:10:42.344079 8190 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" member_type: VOTER }
I20251211 09:10:42.344110 8190 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:10:42.344133 8190 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:10:42.344153 8190 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:42.344595 8190 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" member_type: VOTER }
I20251211 09:10:42.344648 8190 leader_election.cc:304] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f25d28dff434cfcbd3cd8afcd6c7dd4; no voters:
I20251211 09:10:42.344748 8190 leader_election.cc:290] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:10:42.344798 8193 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:42.344903 8190 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:10:42.344909 8193 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 1 LEADER]: Becoming Leader. State: Replica: 8f25d28dff434cfcbd3cd8afcd6c7dd4, State: Running, Role: LEADER
I20251211 09:10:42.345063 8193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" member_type: VOTER }
I20251211 09:10:42.345321 8194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" member_type: VOTER } }
I20251211 09:10:42.345350 8195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f25d28dff434cfcbd3cd8afcd6c7dd4. Latest consensus state: current_term: 1 leader_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f25d28dff434cfcbd3cd8afcd6c7dd4" member_type: VOTER } }
I20251211 09:10:42.345446 8195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:42.345664 8194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [sys.catalog]: This master's current role is: LEADER
I20251211 09:10:42.345765 8199 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:10:42.345890 8199 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:10:42.346380 8199 catalog_manager.cc:1357] Generated new cluster ID: 8b8407aa269a42cc8f8d3063594c9ee3
I20251211 09:10:42.346381 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:10:42.346442 8199 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:10:42.356796 8199 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:10:42.357200 8199 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:10:42.361441 8199 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4: Generated new TSK 0
I20251211 09:10:42.361513 8199 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:10:42.361969 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:42.363204 8214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.363220 8211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.363446 8212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:42.363903 479 server_base.cc:1047] running on GCE node
I20251211 09:10:42.364005 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:42.364032 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:42.364056 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444242364056 us; error 0 us; skew 500 ppm
I20251211 09:10:42.364607 479 webserver.cc:492] Webserver started at http://127.0.119.193:37033/ using document root <none> and password file <none>
I20251211 09:10:42.364678 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:42.364712 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:42.364751 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:42.364965 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "dca4323c03cd4bacad26447a04078855"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.365824 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:10:42.366279 8219 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.366423 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.366479 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "dca4323c03cd4bacad26447a04078855"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.366513 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:42.373909 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:42.374074 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:42.374176 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:42.374332 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:42.374357 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.374388 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:42.374413 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.376977 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:45893
I20251211 09:10:42.377007 8282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:45893 every 8 connection(s)
I20251211 09:10:42.377326 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:42.378330 8287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.378374 8290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.378456 8288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:42.378656 479 server_base.cc:1047] running on GCE node
I20251211 09:10:42.378775 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:42.378809 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:42.378822 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444242378822 us; error 0 us; skew 500 ppm
I20251211 09:10:42.379427 479 webserver.cc:492] Webserver started at http://127.0.119.194:40463/ using document root <none> and password file <none>
I20251211 09:10:42.379505 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:42.379549 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:42.379590 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:42.379858 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "0bdbd544b1ef49eca965457b0ae5b59d"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.380954 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:10:42.380985 8283 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41443
I20251211 09:10:42.381023 8283 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:42.381124 8283 heartbeater.cc:507] Master 127.0.119.254:41443 requested a full tablet report, sending...
I20251211 09:10:42.381385 8154 ts_manager.cc:194] Registered new tserver with Master: dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893)
I20251211 09:10:42.381543 8295 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.381640 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.381678 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "0bdbd544b1ef49eca965457b0ae5b59d"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.381708 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:42.382180 8154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49604
I20251211 09:10:42.400911 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:42.401100 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:42.401355 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:42.401546 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:42.401575 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.401607 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:42.401638 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.404211 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:41419
I20251211 09:10:42.404271 8358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:41419 every 8 connection(s)
I20251211 09:10:42.404573 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:42.405802 8362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.405834 8363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:42.406006 8365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:42.406229 479 server_base.cc:1047] running on GCE node
I20251211 09:10:42.406358 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:42.406397 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:42.406415 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444242406415 us; error 0 us; skew 500 ppm
I20251211 09:10:42.406986 479 webserver.cc:492] Webserver started at http://127.0.119.195:36571/ using document root <none> and password file <none>
I20251211 09:10:42.407086 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:42.407135 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:10:42.407186 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:10:42.407534 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "41600391e92045678b6bcec8c20c0d78"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.408026 8359 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41443
I20251211 09:10:42.408084 8359 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:42.408196 8359 heartbeater.cc:507] Master 127.0.119.254:41443 requested a full tablet report, sending...
I20251211 09:10:42.408445 8154 ts_manager.cc:194] Registered new tserver with Master: 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419)
I20251211 09:10:42.408635 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:10:42.408910 8154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49618
I20251211 09:10:42.409183 8370 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.409355 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.409399 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "41600391e92045678b6bcec8c20c0d78"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:42.409441 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:10:42.417384 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:42.417568 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:42.417706 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:42.417884 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:10:42.417910 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.417943 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:10:42.417974 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:42.421051 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:34277
I20251211 09:10:42.421103 8433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:34277 every 8 connection(s)
I20251211 09:10:42.423936 8434 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41443
I20251211 09:10:42.423998 8434 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:42.424094 8434 heartbeater.cc:507] Master 127.0.119.254:41443 requested a full tablet report, sending...
I20251211 09:10:42.424314 8154 ts_manager.cc:194] Registered new tserver with Master: 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:42.424577 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003307345s
I20251211 09:10:42.424616 8154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49620
I20251211 09:10:42.424947 479 test_util.cc:276] Using random seed: -2064595854
I20251211 09:10:42.429311 8154 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49634:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:10:42.429445 8154 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:10:42.434042 8323 tablet_service.cc:1505] Processing CreateTablet for tablet 75cc6d9583e242f594d578582601a8b0 (DEFAULT_TABLE table=test-workload [id=5224561e13ba422cb146756387cdfb9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:42.434167 8323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75cc6d9583e242f594d578582601a8b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:42.434433 8247 tablet_service.cc:1505] Processing CreateTablet for tablet 75cc6d9583e242f594d578582601a8b0 (DEFAULT_TABLE table=test-workload [id=5224561e13ba422cb146756387cdfb9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:42.434509 8398 tablet_service.cc:1505] Processing CreateTablet for tablet 75cc6d9583e242f594d578582601a8b0 (DEFAULT_TABLE table=test-workload [id=5224561e13ba422cb146756387cdfb9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:10:42.434552 8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75cc6d9583e242f594d578582601a8b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:42.434599 8398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75cc6d9583e242f594d578582601a8b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:10:42.435387 8449 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Bootstrap starting.
I20251211 09:10:42.435827 8449 tablet_bootstrap.cc:654] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:42.436288 8451 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Bootstrap starting.
I20251211 09:10:42.436520 8449 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: No bootstrap required, opened a new log
I20251211 09:10:42.436563 8449 ts_tablet_manager.cc:1403] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:10:42.436666 8451 tablet_bootstrap.cc:654] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:42.436705 8449 raft_consensus.cc:359] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.436769 8449 raft_consensus.cc:385] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:42.436798 8449 raft_consensus.cc:740] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdbd544b1ef49eca965457b0ae5b59d, State: Initialized, Role: FOLLOWER
I20251211 09:10:42.436853 8449 consensus_queue.cc:260] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.436923 8450 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Bootstrap starting.
I20251211 09:10:42.437018 8449 ts_tablet_manager.cc:1434] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:10:42.437047 8359 heartbeater.cc:499] Master 127.0.119.254:41443 was elected leader, sending a full tablet report...
I20251211 09:10:42.437346 8450 tablet_bootstrap.cc:654] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Neither blocks nor log segments found. Creating new log.
I20251211 09:10:42.437896 8450 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: No bootstrap required, opened a new log
I20251211 09:10:42.437952 8450 ts_tablet_manager.cc:1403] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251211 09:10:42.437966 8451 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: No bootstrap required, opened a new log
I20251211 09:10:42.438017 8451 ts_tablet_manager.cc:1403] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:10:42.438097 8450 raft_consensus.cc:359] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.438159 8450 raft_consensus.cc:385] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:42.438136 8451 raft_consensus.cc:359] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.438194 8450 raft_consensus.cc:740] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca4323c03cd4bacad26447a04078855, State: Initialized, Role: FOLLOWER
I20251211 09:10:42.438213 8451 raft_consensus.cc:385] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:10:42.438246 8451 raft_consensus.cc:740] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41600391e92045678b6bcec8c20c0d78, State: Initialized, Role: FOLLOWER
I20251211 09:10:42.438292 8451 consensus_queue.cc:260] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.438293 8450 consensus_queue.cc:260] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.438464 8451 ts_tablet_manager.cc:1434] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:10:42.438498 8283 heartbeater.cc:499] Master 127.0.119.254:41443 was elected leader, sending a full tablet report...
I20251211 09:10:42.438522 8434 heartbeater.cc:499] Master 127.0.119.254:41443 was elected leader, sending a full tablet report...
I20251211 09:10:42.438462 8450 ts_tablet_manager.cc:1434] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251211 09:10:42.555302 8453 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:10:42.555421 8453 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.555642 8453 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:42.558794 8408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78" is_pre_election: true
I20251211 09:10:42.558794 8257 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca4323c03cd4bacad26447a04078855" is_pre_election: true
I20251211 09:10:42.558915 8408 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdbd544b1ef49eca965457b0ae5b59d in term 0.
I20251211 09:10:42.558917 8257 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdbd544b1ef49eca965457b0ae5b59d in term 0.
I20251211 09:10:42.559091 8296 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdbd544b1ef49eca965457b0ae5b59d, 41600391e92045678b6bcec8c20c0d78; no voters:
I20251211 09:10:42.559201 8453 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:10:42.559254 8453 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:10:42.559281 8453 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:42.559931 8453 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.560062 8453 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 1 election: Requested vote from peers dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:42.560204 8408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78"
I20251211 09:10:42.560204 8257 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dca4323c03cd4bacad26447a04078855"
I20251211 09:10:42.560314 8408 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:42.560316 8257 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:10:42.561028 8257 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdbd544b1ef49eca965457b0ae5b59d in term 1.
I20251211 09:10:42.561028 8408 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdbd544b1ef49eca965457b0ae5b59d in term 1.
I20251211 09:10:42.561225 8296 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdbd544b1ef49eca965457b0ae5b59d, 41600391e92045678b6bcec8c20c0d78; no voters:
I20251211 09:10:42.561365 8453 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:10:42.561504 8453 raft_consensus.cc:697] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 1 LEADER]: Becoming Leader. State: Replica: 0bdbd544b1ef49eca965457b0ae5b59d, State: Running, Role: LEADER
I20251211 09:10:42.561558 8453 consensus_queue.cc:237] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:42.562091 8154 catalog_manager.cc:5654] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194). New cstate: current_term: 1 leader_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } health_report { overall_health: UNKNOWN } } }
I20251211 09:10:42.586027 8408 raft_consensus.cc:1275] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 1 FOLLOWER]: Refusing update from remote peer 0bdbd544b1ef49eca965457b0ae5b59d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:42.586047 8257 raft_consensus.cc:1275] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 1 FOLLOWER]: Refusing update from remote peer 0bdbd544b1ef49eca965457b0ae5b59d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:10:42.586297 8459 consensus_queue.cc:1048] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [LEADER]: Connected to new peer: Peer: permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:10:42.586419 8453 consensus_queue.cc:1048] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:10:53.144367 8494 raft_consensus.cc:993] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: : Instructing follower dca4323c03cd4bacad26447a04078855 to start an election
I20251211 09:10:53.144455 8494 raft_consensus.cc:1081] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 1 LEADER]: Signalling peer dca4323c03cd4bacad26447a04078855 to start an election
I20251211 09:10:53.144665 8256 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0"
dest_uuid: "dca4323c03cd4bacad26447a04078855"
from {username='slave'} at 127.0.0.1:50424
I20251211 09:10:53.144728 8256 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:10:53.144748 8256 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:10:53.145466 8256 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:53.145625 8256 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 2 election: Requested vote from peers 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:53.149111 8333 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 2 candidate_status { last_received { term: 1 index: 13983 } } ignore_live_leader: true dest_uuid: "0bdbd544b1ef49eca965457b0ae5b59d"
I20251211 09:10:53.149111 8408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 2 candidate_status { last_received { term: 1 index: 13983 } } ignore_live_leader: true dest_uuid: "41600391e92045678b6bcec8c20c0d78"
I20251211 09:10:53.149235 8333 raft_consensus.cc:3055] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:10:53.149276 8408 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:10:53.149294 8333 raft_consensus.cc:740] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bdbd544b1ef49eca965457b0ae5b59d, State: Running, Role: LEADER
I20251211 09:10:53.149394 8333 consensus_queue.cc:260] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13983, Committed index: 13983, Last appended: 1.13983, Last appended by leader: 13983, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:53.149482 8333 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:10:53.149995 8408 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dca4323c03cd4bacad26447a04078855 in term 2.
I20251211 09:10:53.150099 8333 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dca4323c03cd4bacad26447a04078855 in term 2.
I20251211 09:10:53.150195 8220 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41600391e92045678b6bcec8c20c0d78, dca4323c03cd4bacad26447a04078855; no voters:
I20251211 09:10:53.150388 8510 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:10:53.150548 8510 raft_consensus.cc:697] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 LEADER]: Becoming Leader. State: Replica: dca4323c03cd4bacad26447a04078855, State: Running, Role: LEADER
I20251211 09:10:53.150596 8510 consensus_queue.cc:237] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13983, Committed index: 13983, Last appended: 1.13983, Last appended by leader: 13983, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:53.151026 8154 catalog_manager.cc:5654] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 reported cstate change: term changed from 1 to 2, leader changed from 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194) to dca4323c03cd4bacad26447a04078855 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "dca4323c03cd4bacad26447a04078855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } health_report { overall_health: UNKNOWN } } }
I20251211 09:10:53.161763 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:10:53.164697 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:53.164863 479 tablet_replica.cc:333] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: stopping tablet replica
I20251211 09:10:53.164913 479 raft_consensus.cc:2243] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:10:53.164986 479 pending_rounds.cc:70] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Trying to abort 1 pending ops.
I20251211 09:10:53.165014 479 pending_rounds.cc:77] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Aborting op as it isn't in flight: id { term: 2 index: 13984 } timestamp: 7231259660905361408 op_type: NO_OP noop_request { }
I20251211 09:10:53.165071 479 raft_consensus.cc:2889] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 09:10:53.165102 479 raft_consensus.cc:2272] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 FOLLOWER]: Raft consensus is shut down!
W20251211 09:10:53.172719 8518 meta_cache.cc:302] tablet 75cc6d9583e242f594d578582601a8b0: replica dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893) has failed: Network error: Client connection negotiation failed: client connection to 127.0.119.193:45893: connect: Connection refused (error 111)
W20251211 09:10:53.179277 8323 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37232: Illegal state: replica 0bdbd544b1ef49eca965457b0ae5b59d is not leader of this config: current role FOLLOWER
I20251211 09:10:53.179555 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:10:53.180390 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:53.181656 8526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:53.181741 8528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:53.181838 479 server_base.cc:1047] running on GCE node
W20251211 09:10:53.181691 8525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:53.181998 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:53.182031 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:53.182044 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444253182044 us; error 0 us; skew 500 ppm
I20251211 09:10:53.182698 479 webserver.cc:492] Webserver started at http://127.0.119.193:37033/ using document root <none> and password file <none>
I20251211 09:10:53.182799 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:53.182840 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:10:53.183393 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:53.183836 8533 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:53.183957 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:53.184003 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "dca4323c03cd4bacad26447a04078855"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:53.184051 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20251211 09:10:53.187070 8398 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41228: Illegal state: replica 41600391e92045678b6bcec8c20c0d78 is not leader of this config: current role FOLLOWER
W20251211 09:10:53.199481 8323 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37232: Illegal state: replica 0bdbd544b1ef49eca965457b0ae5b59d is not leader of this config: current role FOLLOWER
I20251211 09:10:53.206050 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:53.206252 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:53.206429 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:53.206697 8540 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251211 09:10:53.207285 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:10:53.207322 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:10:53.207361 479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251211 09:10:53.207775 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:10:53.207805 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:53.207921 8540 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Bootstrap starting.
W20251211 09:10:53.208007 8398 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41228: Illegal state: replica 41600391e92045678b6bcec8c20c0d78 is not leader of this config: current role FOLLOWER
I20251211 09:10:53.211179 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:45893
I20251211 09:10:53.217049 8598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:45893 every 8 connection(s)
I20251211 09:10:53.221932 8599 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41443
I20251211 09:10:53.222002 8599 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:53.222098 8599 heartbeater.cc:507] Master 127.0.119.254:41443 requested a full tablet report, sending...
I20251211 09:10:53.222342 8154 ts_manager.cc:194] Re-registered known tserver with Master: dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893)
I20251211 09:10:53.222718 8154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58238
I20251211 09:10:53.965678 8540 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Bootstrap replayed 1/3 log segments. Stats: ops{read=4946 overwritten=0 applied=4945 ignored=0} inserts{seen=247200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:10:54.223548 8599 heartbeater.cc:499] Master 127.0.119.254:41443 was elected leader, sending a full tablet report...
I20251211 09:10:54.770361 8540 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Bootstrap replayed 2/3 log segments. Stats: ops{read=9894 overwritten=0 applied=9893 ignored=0} inserts{seen=494600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:10:55.020750 8605 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:10:55.020843 8605 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:55.020990 8605 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:55.021194 8408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 3 candidate_status { last_received { term: 1 index: 13983 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78" is_pre_election: true
I20251211 09:10:55.021296 8408 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdbd544b1ef49eca965457b0ae5b59d in term 2.
I20251211 09:10:55.021449 8296 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdbd544b1ef49eca965457b0ae5b59d, 41600391e92045678b6bcec8c20c0d78; no voters:
I20251211 09:10:55.021541 8605 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251211 09:10:55.021574 8605 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:10:55.021597 8605 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:10:55.022469 8605 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:55.022596 8605 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 3 election: Requested vote from peers dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:55.022774 8408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 3 candidate_status { last_received { term: 1 index: 13983 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78"
I20251211 09:10:55.022835 8408 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:10:55.023473 8408 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdbd544b1ef49eca965457b0ae5b59d in term 3.
I20251211 09:10:55.023626 8296 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdbd544b1ef49eca965457b0ae5b59d, 41600391e92045678b6bcec8c20c0d78; no voters:
I20251211 09:10:55.023751 8605 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 FOLLOWER]: Leader election won for term 3
I20251211 09:10:55.023881 8605 raft_consensus.cc:697] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 LEADER]: Becoming Leader. State: Replica: 0bdbd544b1ef49eca965457b0ae5b59d, State: Running, Role: LEADER
I20251211 09:10:55.023936 8605 consensus_queue.cc:237] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13983, Committed index: 13983, Last appended: 1.13983, Last appended by leader: 13983, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:55.024432 8573 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 3 candidate_status { last_received { term: 1 index: 13983 } } ignore_live_leader: false dest_uuid: "dca4323c03cd4bacad26447a04078855" is_pre_election: true
I20251211 09:10:55.024464 8572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 3 candidate_status { last_received { term: 1 index: 13983 } } ignore_live_leader: false dest_uuid: "dca4323c03cd4bacad26447a04078855"
I20251211 09:10:55.024477 8154 catalog_manager.cc:5654] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d reported cstate change: term changed from 2 to 3, leader changed from dca4323c03cd4bacad26447a04078855 (127.0.119.193) to 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194). New cstate: current_term: 3 leader_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } health_report { overall_health: UNKNOWN } } }
W20251211 09:10:55.024644 8298 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893): Illegal state: must be running to vote when last-logged opid is not known
W20251211 09:10:55.024709 8298 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893): Illegal state: must be running to vote when last-logged opid is not known
I20251211 09:10:55.400838 8408 raft_consensus.cc:1275] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 3 FOLLOWER]: Refusing update from remote peer 0bdbd544b1ef49eca965457b0ae5b59d: Log matching property violated. Preceding OpId in replica: term: 1 index: 13983. Preceding OpId from leader: term: 3 index: 13984. (index mismatch)
I20251211 09:10:55.401140 8605 consensus_queue.cc:1048] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [LEADER]: Connected to new peer: Peer: permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13984, Last known committed idx: 13983, Time since last communication: 0.000s
W20251211 09:10:55.402693 8298 consensus_peers.cc:597] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d -> Peer dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893): Couldn't send request to peer dca4323c03cd4bacad26447a04078855. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251211 09:10:55.469234 8540 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Bootstrap replayed 3/3 log segments. Stats: ops{read=13984 overwritten=0 applied=13983 ignored=0} inserts{seen=699100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:10:55.469667 8540 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Bootstrap complete.
I20251211 09:10:55.474311 8540 ts_tablet_manager.cc:1403] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Time spent bootstrapping tablet: real 2.266s user 2.007s sys 0.255s
I20251211 09:10:55.474499 8540 raft_consensus.cc:359] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:55.474606 8540 raft_consensus.cc:740] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca4323c03cd4bacad26447a04078855, State: Initialized, Role: FOLLOWER
I20251211 09:10:55.474654 8540 consensus_queue.cc:260] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13983, Last appended: 2.13984, Last appended by leader: 13984, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:55.474879 8540 ts_tablet_manager.cc:1434] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20251211 09:10:55.484519 8563 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41710: Illegal state: replica dca4323c03cd4bacad26447a04078855 is not leader of this config: current role FOLLOWER
I20251211 09:10:55.817389 8572 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:10:55.818465 8572 pending_rounds.cc:85] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Aborting all ops after (but not including) 13983
I20251211 09:10:55.818522 8572 pending_rounds.cc:107] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855: Aborting uncommitted NO_OP operation due to leader change: 2.13984
I20251211 09:10:55.818567 8572 raft_consensus.cc:2889] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251211 09:10:55.975271 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:10:55.977604 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:55.977713 479 tablet_replica.cc:333] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: stopping tablet replica
I20251211 09:10:55.977777 479 raft_consensus.cc:2243] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 LEADER]: Raft consensus shutting down.
I20251211 09:10:55.977845 479 pending_rounds.cc:70] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Trying to abort 1 pending ops.
I20251211 09:10:55.977864 479 pending_rounds.cc:77] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Aborting op as it isn't in flight: id { term: 3 index: 14416 } timestamp: 7231259672151080960 op_type: PARTICIPANT_OP participant_request { tablet_id: "75cc6d9583e242f594d578582601a8b0" op { type: FINALIZE_COMMIT txn_id: 143 finalized_commit_timestamp: 1337 } }
W20251211 09:10:55.977929 479 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37232: Aborted: Op aborted
I20251211 09:10:55.977999 479 raft_consensus.cc:2272] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 FOLLOWER]: Raft consensus is shut down!
W20251211 09:10:55.981705 479 mvcc.cc:118] aborting op with timestamp 7231259672147902464 in state 0; MVCC is closed
W20251211 09:10:55.983780 8563 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41710: Illegal state: replica dca4323c03cd4bacad26447a04078855 is not leader of this config: current role FOLLOWER
W20251211 09:10:55.986227 8398 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41228: Illegal state: replica 41600391e92045678b6bcec8c20c0d78 is not leader of this config: current role FOLLOWER
W20251211 09:10:55.990121 8519 meta_cache.cc:302] tablet 75cc6d9583e242f594d578582601a8b0: replica 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419) has failed: Network error: Client connection negotiation failed: client connection to 127.0.119.194:41419: connect: Connection refused (error 111)
I20251211 09:10:55.993767 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
W20251211 09:10:55.994536 8563 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41710: Illegal state: replica dca4323c03cd4bacad26447a04078855 is not leader of this config: current role FOLLOWER
I20251211 09:10:55.994925 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:55.995986 8633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:55.996093 8631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:55.996136 479 server_base.cc:1047] running on GCE node
W20251211 09:10:55.995996 8630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:55.996340 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:55.996376 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:55.996395 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444255996394 us; error 0 us; skew 500 ppm
I20251211 09:10:55.997002 479 webserver.cc:492] Webserver started at http://127.0.119.194:40463/ using document root <none> and password file <none>
I20251211 09:10:55.997077 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:55.997114 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:10:55.997691 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:55.998123 8638 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:55.998260 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:55.998301 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "0bdbd544b1ef49eca965457b0ae5b59d"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:55.998350 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20251211 09:10:56.003084 8398 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41228: Illegal state: replica 41600391e92045678b6bcec8c20c0d78 is not leader of this config: current role FOLLOWER
I20251211 09:10:56.016696 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:56.016862 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:56.017006 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:56.017329 8645 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251211 09:10:56.017971 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:10:56.018009 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:10:56.018043 479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251211 09:10:56.018411 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:10:56.018452 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:56.018471 8645 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Bootstrap starting.
I20251211 09:10:56.021700 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:41419
W20251211 09:10:56.023267 8563 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41710: Illegal state: replica dca4323c03cd4bacad26447a04078855 is not leader of this config: current role FOLLOWER
I20251211 09:10:56.023624 8703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:41419 every 8 connection(s)
W20251211 09:10:56.031792 8398 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41228: Illegal state: replica 41600391e92045678b6bcec8c20c0d78 is not leader of this config: current role FOLLOWER
I20251211 09:10:56.032162 8704 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41443
I20251211 09:10:56.032229 8704 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:56.032332 8704 heartbeater.cc:507] Master 127.0.119.254:41443 requested a full tablet report, sending...
I20251211 09:10:56.032599 8154 ts_manager.cc:194] Re-registered known tserver with Master: 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419)
I20251211 09:10:56.032946 8154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57976
I20251211 09:10:56.701308 8645 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Bootstrap replayed 1/4 log segments. Stats: ops{read=4621 overwritten=0 applied=4618 ignored=0} inserts{seen=230850 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20251211 09:10:57.033519 8704 heartbeater.cc:499] Master 127.0.119.254:41443 was elected leader, sending a full tablet report...
I20251211 09:10:57.396538 8710 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0bdbd544b1ef49eca965457b0ae5b59d)
I20251211 09:10:57.396631 8710 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:57.396829 8710 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893), 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419)
I20251211 09:10:57.397221 8711 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0bdbd544b1ef49eca965457b0ae5b59d)
I20251211 09:10:57.397379 8711 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:57.398099 8711 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:57.400274 8572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "41600391e92045678b6bcec8c20c0d78" candidate_term: 4 candidate_status { last_received { term: 3 index: 14415 } } ignore_live_leader: false dest_uuid: "dca4323c03cd4bacad26447a04078855" is_pre_election: true
I20251211 09:10:57.400342 8572 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41600391e92045678b6bcec8c20c0d78 in term 3.
I20251211 09:10:57.400470 8373 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41600391e92045678b6bcec8c20c0d78, dca4323c03cd4bacad26447a04078855; no voters:
I20251211 09:10:57.400579 8710 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251211 09:10:57.400617 8710 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0bdbd544b1ef49eca965457b0ae5b59d)
I20251211 09:10:57.400589 8678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "41600391e92045678b6bcec8c20c0d78" candidate_term: 4 candidate_status { last_received { term: 3 index: 14415 } } ignore_live_leader: false dest_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" is_pre_election: true
I20251211 09:10:57.400651 8710 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 3 FOLLOWER]: Advancing to term 4
W20251211 09:10:57.401055 8374 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419): Illegal state: must be running to vote when last-logged opid is not known
I20251211 09:10:57.401607 8678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 4 candidate_status { last_received { term: 3 index: 14415 } } ignore_live_leader: false dest_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" is_pre_election: true
I20251211 09:10:57.401669 8710 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:57.401788 8710 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [CANDIDATE]: Term 4 election: Requested vote from peers dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893), 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419)
W20251211 09:10:57.401818 8537 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419): Illegal state: must be running to vote when last-logged opid is not known
I20251211 09:10:57.401948 8678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "41600391e92045678b6bcec8c20c0d78" candidate_term: 4 candidate_status { last_received { term: 3 index: 14415 } } ignore_live_leader: false dest_uuid: "0bdbd544b1ef49eca965457b0ae5b59d"
I20251211 09:10:57.402031 8572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "41600391e92045678b6bcec8c20c0d78" candidate_term: 4 candidate_status { last_received { term: 3 index: 14415 } } ignore_live_leader: false dest_uuid: "dca4323c03cd4bacad26447a04078855"
I20251211 09:10:57.402091 8572 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:10:57.402642 8572 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41600391e92045678b6bcec8c20c0d78 in term 4.
W20251211 09:10:57.402733 8374 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [CANDIDATE]: Term 4 election: Tablet error from VoteRequest() call to peer 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419): Illegal state: must be running to vote when last-logged opid is not known
I20251211 09:10:57.402820 8373 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41600391e92045678b6bcec8c20c0d78, dca4323c03cd4bacad26447a04078855; no voters: 0bdbd544b1ef49eca965457b0ae5b59d
I20251211 09:10:57.402897 8710 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 FOLLOWER]: Leader election won for term 4
I20251211 09:10:57.403033 8710 raft_consensus.cc:697] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 LEADER]: Becoming Leader. State: Replica: 41600391e92045678b6bcec8c20c0d78, State: Running, Role: LEADER
I20251211 09:10:57.403087 8710 consensus_queue.cc:237] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14415, Committed index: 14415, Last appended: 3.14415, Last appended by leader: 14415, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:57.403609 8154 catalog_manager.cc:5654] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 reported cstate change: term changed from 3 to 4, leader changed from 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194) to 41600391e92045678b6bcec8c20c0d78 (127.0.119.195). New cstate: current_term: 4 leader_uuid: "41600391e92045678b6bcec8c20c0d78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } health_report { overall_health: HEALTHY } } }
I20251211 09:10:57.404851 8408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 4 candidate_status { last_received { term: 3 index: 14415 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78" is_pre_election: true
I20251211 09:10:57.405083 8534 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dca4323c03cd4bacad26447a04078855; no voters: 0bdbd544b1ef49eca965457b0ae5b59d, 41600391e92045678b6bcec8c20c0d78
I20251211 09:10:57.405185 8711 raft_consensus.cc:2749] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251211 09:10:57.468945 8645 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Bootstrap replayed 2/4 log segments. Stats: ops{read=9244 overwritten=0 applied=9241 ignored=0} inserts{seen=462000 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20251211 09:10:57.797756 8572 raft_consensus.cc:1275] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Refusing update from remote peer 41600391e92045678b6bcec8c20c0d78: Log matching property violated. Preceding OpId in replica: term: 3 index: 14415. Preceding OpId from leader: term: 4 index: 14416. (index mismatch)
I20251211 09:10:57.798048 8710 consensus_queue.cc:1048] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14416, Last known committed idx: 14415, Time since last communication: 0.000s
W20251211 09:10:57.799654 8374 consensus_peers.cc:597] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 -> Peer 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419): Couldn't send request to peer 0bdbd544b1ef49eca965457b0ae5b59d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251211 09:10:58.256383 8645 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Bootstrap replayed 3/4 log segments. Stats: ops{read=13865 overwritten=0 applied=13863 ignored=0} inserts{seen=693100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20251211 09:10:58.292800 8645 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Bootstrap replayed 4/4 log segments. Stats: ops{read=14416 overwritten=0 applied=14415 ignored=0} inserts{seen=699100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:10:58.293263 8645 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Bootstrap complete.
I20251211 09:10:58.298118 8645 ts_tablet_manager.cc:1403] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Time spent bootstrapping tablet: real 2.280s user 1.951s sys 0.327s
I20251211 09:10:58.298290 8645 raft_consensus.cc:359] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:58.298470 8645 raft_consensus.cc:740] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdbd544b1ef49eca965457b0ae5b59d, State: Initialized, Role: FOLLOWER
I20251211 09:10:58.298532 8645 consensus_queue.cc:260] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14415, Last appended: 3.14416, Last appended by leader: 14416, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:10:58.298667 8645 ts_tablet_manager.cc:1434] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20251211 09:10:58.354962 8668 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35084: Illegal state: replica 0bdbd544b1ef49eca965457b0ae5b59d is not leader of this config: current role FOLLOWER
W20251211 09:10:58.422755 8563 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41710: Illegal state: replica dca4323c03cd4bacad26447a04078855 is not leader of this config: current role FOLLOWER
I20251211 09:10:58.423223 8678 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:10:58.423969 8678 pending_rounds.cc:85] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Aborting all ops after (but not including) 14415
I20251211 09:10:58.424006 8678 pending_rounds.cc:107] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d: Aborting uncommitted PARTICIPANT_OP operation due to leader change: 3.14416
I20251211 09:10:58.799136 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:10:58.801914 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:10:58.802045 479 tablet_replica.cc:333] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: stopping tablet replica
I20251211 09:10:58.802115 479 raft_consensus.cc:2243] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 LEADER]: Raft consensus shutting down.
I20251211 09:10:58.802162 479 raft_consensus.cc:2272] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 09:10:58.806612 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:10:58.807616 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:10:58.808696 8744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:58.808830 8745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:10:58.808861 8747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:10:58.808931 479 server_base.cc:1047] running on GCE node
I20251211 09:10:58.809005 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:10:58.809036 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:10:58.809047 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444258809048 us; error 0 us; skew 500 ppm
W20251211 09:10:58.809551 8516 meta_cache.cc:302] tablet 75cc6d9583e242f594d578582601a8b0: replica 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277) has failed: Network error: Client connection negotiation failed: client connection to 127.0.119.195:34277: connect: Connection refused (error 111)
I20251211 09:10:58.809736 479 webserver.cc:492] Webserver started at http://127.0.119.195:36571/ using document root <none> and password file <none>
I20251211 09:10:58.809815 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:10:58.809851 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:10:58.810348 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:58.810801 8753 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:58.810917 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:58.810958 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "41600391e92045678b6bcec8c20c0d78"
format_stamp: "Formatted at 2025-12-11 09:10:42 on dist-test-slave-hb70"
I20251211 09:10:58.811012 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20251211 09:10:58.813943 8563 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41710: Illegal state: replica dca4323c03cd4bacad26447a04078855 is not leader of this config: current role FOLLOWER
W20251211 09:10:58.820495 8668 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35084: Illegal state: replica 0bdbd544b1ef49eca965457b0ae5b59d is not leader of this config: current role FOLLOWER
I20251211 09:10:58.827229 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:10:58.827383 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:10:58.827517 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:10:58.827818 8760 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251211 09:10:58.828400 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:10:58.828434 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:10:58.828457 479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251211 09:10:58.828848 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:10:58.828877 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:10:58.828955 8760 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Bootstrap starting.
I20251211 09:10:58.832309 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:34277
I20251211 09:10:58.838701 8818 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:34277 every 8 connection(s)
W20251211 09:10:58.838747 8563 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41710: Illegal state: replica dca4323c03cd4bacad26447a04078855 is not leader of this config: current role FOLLOWER
I20251211 09:10:58.842272 8819 heartbeater.cc:344] Connected to a master server at 127.0.119.254:41443
I20251211 09:10:58.842339 8819 heartbeater.cc:461] Registering TS with master...
I20251211 09:10:58.842437 8819 heartbeater.cc:507] Master 127.0.119.254:41443 requested a full tablet report, sending...
I20251211 09:10:58.842731 8154 ts_manager.cc:194] Re-registered known tserver with Master: 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:10:58.843084 8154 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57988
W20251211 09:10:58.848278 8668 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:35084: Illegal state: replica 0bdbd544b1ef49eca965457b0ae5b59d is not leader of this config: current role FOLLOWER
I20251211 09:10:59.589654 8760 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Bootstrap replayed 1/3 log segments. Stats: ops{read=4956 overwritten=0 applied=4955 ignored=0} inserts{seen=247700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:10:59.843633 8819 heartbeater.cc:499] Master 127.0.119.254:41443 was elected leader, sending a full tablet report...
I20251211 09:11:00.299795 8826 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 41600391e92045678b6bcec8c20c0d78)
I20251211 09:11:00.299886 8826 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:11:00.300027 8826 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:11:00.300215 8678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 5 candidate_status { last_received { term: 4 index: 14760 } } ignore_live_leader: false dest_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" is_pre_election: true
I20251211 09:11:00.300282 8678 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dca4323c03cd4bacad26447a04078855 in term 4.
I20251211 09:11:00.300422 8537 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdbd544b1ef49eca965457b0ae5b59d, dca4323c03cd4bacad26447a04078855; no voters:
I20251211 09:11:00.300354 8828 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 41600391e92045678b6bcec8c20c0d78)
I20251211 09:11:00.300504 8826 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251211 09:11:00.300586 8828 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:11:00.300663 8826 raft_consensus.cc:493] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 41600391e92045678b6bcec8c20c0d78)
I20251211 09:11:00.300820 8826 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 4 FOLLOWER]: Advancing to term 5
I20251211 09:11:00.301503 8828 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dca4323c03cd4bacad26447a04078855 (127.0.119.193:45893), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:11:00.301892 8826 raft_consensus.cc:515] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:11:00.302160 8678 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 5 candidate_status { last_received { term: 4 index: 14760 } } ignore_live_leader: false dest_uuid: "0bdbd544b1ef49eca965457b0ae5b59d"
I20251211 09:11:00.302213 8678 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 4 FOLLOWER]: Advancing to term 5
I20251211 09:11:00.302840 8678 raft_consensus.cc:2468] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dca4323c03cd4bacad26447a04078855 in term 5.
I20251211 09:11:00.303032 8537 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdbd544b1ef49eca965457b0ae5b59d, dca4323c03cd4bacad26447a04078855; no voters:
I20251211 09:11:00.303241 8826 leader_election.cc:290] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 5 election: Requested vote from peers 0bdbd544b1ef49eca965457b0ae5b59d (127.0.119.194:41419), 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277)
I20251211 09:11:00.303337 8826 raft_consensus.cc:2804] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 5 FOLLOWER]: Leader election won for term 5
I20251211 09:11:00.303401 8826 raft_consensus.cc:697] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 5 LEADER]: Becoming Leader. State: Replica: dca4323c03cd4bacad26447a04078855, State: Running, Role: LEADER
I20251211 09:11:00.303473 8826 consensus_queue.cc:237] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14760, Committed index: 14760, Last appended: 4.14760, Last appended by leader: 14760, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:11:00.303617 8793 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 5 candidate_status { last_received { term: 4 index: 14760 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78" is_pre_election: true
I20251211 09:11:00.303683 8792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "dca4323c03cd4bacad26447a04078855" candidate_term: 5 candidate_status { last_received { term: 4 index: 14760 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78"
W20251211 09:11:00.303916 8534 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277): Illegal state: must be running to vote when last-logged opid is not known
W20251211 09:11:00.303974 8534 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [CANDIDATE]: Term 5 election: Tablet error from VoteRequest() call to peer 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277): Illegal state: must be running to vote when last-logged opid is not known
I20251211 09:11:00.304512 8154 catalog_manager.cc:5654] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 reported cstate change: term changed from 4 to 5, leader changed from 41600391e92045678b6bcec8c20c0d78 (127.0.119.195) to dca4323c03cd4bacad26447a04078855 (127.0.119.193). New cstate: current_term: 5 leader_uuid: "dca4323c03cd4bacad26447a04078855" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:00.305699 8792 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 5 candidate_status { last_received { term: 4 index: 14760 } } ignore_live_leader: false dest_uuid: "41600391e92045678b6bcec8c20c0d78" is_pre_election: true
I20251211 09:11:00.305755 8572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75cc6d9583e242f594d578582601a8b0" candidate_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" candidate_term: 5 candidate_status { last_received { term: 4 index: 14760 } } ignore_live_leader: false dest_uuid: "dca4323c03cd4bacad26447a04078855" is_pre_election: true
W20251211 09:11:00.305867 8639 leader_election.cc:343] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 5 pre-election: Tablet error from VoteRequest() call to peer 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277): Illegal state: must be running to vote when last-logged opid is not known
I20251211 09:11:00.305944 8641 leader_election.cc:304] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bdbd544b1ef49eca965457b0ae5b59d; no voters: 41600391e92045678b6bcec8c20c0d78, dca4323c03cd4bacad26447a04078855
I20251211 09:11:00.306027 8828 raft_consensus.cc:2749] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251211 09:11:00.416060 8760 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Bootstrap replayed 2/3 log segments. Stats: ops{read=9918 overwritten=0 applied=9917 ignored=0} inserts{seen=495800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:11:00.723640 8678 raft_consensus.cc:1275] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 5 FOLLOWER]: Refusing update from remote peer dca4323c03cd4bacad26447a04078855: Log matching property violated. Preceding OpId in replica: term: 4 index: 14760. Preceding OpId from leader: term: 5 index: 14761. (index mismatch)
I20251211 09:11:00.723948 8834 consensus_queue.cc:1048] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14761, Last known committed idx: 14760, Time since last communication: 0.000s
W20251211 09:11:00.725551 8534 consensus_peers.cc:597] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 -> Peer 41600391e92045678b6bcec8c20c0d78 (127.0.119.195:34277): Couldn't send request to peer 41600391e92045678b6bcec8c20c0d78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251211 09:11:01.175642 8760 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Bootstrap replayed 3/3 log segments. Stats: ops{read=14760 overwritten=0 applied=14760 ignored=0} inserts{seen=699100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:11:01.176124 8760 tablet_bootstrap.cc:492] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Bootstrap complete.
I20251211 09:11:01.180683 8760 ts_tablet_manager.cc:1403] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Time spent bootstrapping tablet: real 2.352s user 2.073s sys 0.272s
I20251211 09:11:01.180894 8760 raft_consensus.cc:359] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:11:01.180992 8760 raft_consensus.cc:740] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41600391e92045678b6bcec8c20c0d78, State: Initialized, Role: FOLLOWER
I20251211 09:11:01.181051 8760 consensus_queue.cc:260] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14760, Last appended: 4.14760, Last appended by leader: 14760, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dca4323c03cd4bacad26447a04078855" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45893 } } peers { permanent_uuid: "0bdbd544b1ef49eca965457b0ae5b59d" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 41419 } } peers { permanent_uuid: "41600391e92045678b6bcec8c20c0d78" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 34277 } }
I20251211 09:11:01.181293 8760 ts_tablet_manager.cc:1434] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
W20251211 09:11:01.248739 8783 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43458: Illegal state: replica 41600391e92045678b6bcec8c20c0d78 is not leader of this config: current role FOLLOWER
I20251211 09:11:01.559056 8792 raft_consensus.cc:3060] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 4 FOLLOWER]: Advancing to term 5
I20251211 09:11:01.682282 479 tablet_server.cc:178] TabletServer@127.0.119.193:45893 shutting down...
I20251211 09:11:01.684903 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:01.685045 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:11:01.685096 479 raft_consensus.cc:2243] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 5 LEADER]: Raft consensus shutting down.
I20251211 09:11:01.685160 479 raft_consensus.cc:2272] T 75cc6d9583e242f594d578582601a8b0 P dca4323c03cd4bacad26447a04078855 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:01.699530 479 tablet_server.cc:195] TabletServer@127.0.119.193:45893 shutdown complete.
I20251211 09:11:01.701021 479 tablet_server.cc:178] TabletServer@127.0.119.194:41419 shutting down...
I20251211 09:11:01.703565 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:01.703673 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:11:01.703724 479 raft_consensus.cc:2243] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 5 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:01.703773 479 raft_consensus.cc:2272] T 75cc6d9583e242f594d578582601a8b0 P 0bdbd544b1ef49eca965457b0ae5b59d [term 5 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:01.727375 479 tablet_server.cc:195] TabletServer@127.0.119.194:41419 shutdown complete.
I20251211 09:11:01.728804 479 tablet_server.cc:178] TabletServer@127.0.119.195:34277 shutting down...
I20251211 09:11:01.731303 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:01.731434 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:11:01.731511 479 raft_consensus.cc:2243] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 5 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:01.731559 479 raft_consensus.cc:2272] T 75cc6d9583e242f594d578582601a8b0 P 41600391e92045678b6bcec8c20c0d78 [term 5 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:01.736209 479 tablet_server.cc:195] TabletServer@127.0.119.195:34277 shutdown complete.
I20251211 09:11:01.737375 479 master.cc:561] Master@127.0.119.254:41443 shutting down...
I20251211 09:11:01.739280 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:11:01.739349 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:01.739369 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8f25d28dff434cfcbd3cd8afcd6c7dd4: stopping tablet replica
I20251211 09:11:01.750885 479 master.cc:583] Master@127.0.119.254:41443 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap (19457 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound
I20251211 09:11:01.771317 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:46147
I20251211 09:11:01.771490 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:01.772797 8857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:01.772816 479 server_base.cc:1047] running on GCE node
W20251211 09:11:01.772879 8858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:01.772992 8860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:01.773106 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:01.773141 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:01.773172 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444261773173 us; error 0 us; skew 500 ppm
I20251211 09:11:01.773811 479 webserver.cc:492] Webserver started at http://127.0.119.254:41733/ using document root <none> and password file <none>
I20251211 09:11:01.773901 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:01.773964 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:01.774020 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:01.774312 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "0db52c092eff4e068347bdb30d2f28e0"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.775184 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:01.775635 8865 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.775770 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.775815 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "0db52c092eff4e068347bdb30d2f28e0"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.775863 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:01.786676 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:01.786876 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:01.789455 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:46147
I20251211 09:11:01.790083 8917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:46147 every 8 connection(s)
I20251211 09:11:01.790496 8918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:01.799212 8918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0: Bootstrap starting.
I20251211 09:11:01.799510 8918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:01.800009 8918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0: No bootstrap required, opened a new log
I20251211 09:11:01.800130 8918 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db52c092eff4e068347bdb30d2f28e0" member_type: VOTER }
I20251211 09:11:01.800180 8918 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:01.800202 8918 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db52c092eff4e068347bdb30d2f28e0, State: Initialized, Role: FOLLOWER
I20251211 09:11:01.800257 8918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db52c092eff4e068347bdb30d2f28e0" member_type: VOTER }
I20251211 09:11:01.800300 8918 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:11:01.800324 8918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:11:01.800359 8918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:01.800843 8918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db52c092eff4e068347bdb30d2f28e0" member_type: VOTER }
I20251211 09:11:01.800896 8918 leader_election.cc:304] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0db52c092eff4e068347bdb30d2f28e0; no voters:
I20251211 09:11:01.800992 8918 leader_election.cc:290] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:11:01.801066 8921 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:01.801126 8918 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:11:01.801200 8921 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 1 LEADER]: Becoming Leader. State: Replica: 0db52c092eff4e068347bdb30d2f28e0, State: Running, Role: LEADER
I20251211 09:11:01.801275 8921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db52c092eff4e068347bdb30d2f28e0" member_type: VOTER }
I20251211 09:11:01.801493 8922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0db52c092eff4e068347bdb30d2f28e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db52c092eff4e068347bdb30d2f28e0" member_type: VOTER } }
I20251211 09:11:01.801573 8922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:01.801787 8923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0db52c092eff4e068347bdb30d2f28e0. Latest consensus state: current_term: 1 leader_uuid: "0db52c092eff4e068347bdb30d2f28e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db52c092eff4e068347bdb30d2f28e0" member_type: VOTER } }
I20251211 09:11:01.801844 8923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:01.802330 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20251211 09:11:01.802428 8937 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251211 09:11:01.802466 8937 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251211 09:11:01.802523 8927 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:11:01.802618 8927 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:11:01.803086 8927 catalog_manager.cc:1357] Generated new cluster ID: f0e6c777238644d8993ce21789a7bd7a
I20251211 09:11:01.803124 8927 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:11:01.822541 8927 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:11:01.823035 8927 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:11:01.832052 8927 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0: Generated new TSK 0
I20251211 09:11:01.832137 8927 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:11:01.834089 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:01.835587 8940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:01.835667 479 server_base.cc:1047] running on GCE node
W20251211 09:11:01.835649 8939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:01.835599 8942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:01.835963 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:01.836002 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:01.836015 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444261836015 us; error 0 us; skew 500 ppm
I20251211 09:11:01.836601 479 webserver.cc:492] Webserver started at http://127.0.119.193:33239/ using document root <none> and password file <none>
I20251211 09:11:01.836691 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:01.836741 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:01.836797 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:01.837066 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "09ba5bd86fd54d53a467c217586dd1f6"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.837987 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:01.838434 8947 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.838563 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.838603 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "09ba5bd86fd54d53a467c217586dd1f6"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.838644 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:01.851241 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:01.851468 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:01.851622 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:01.851810 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:01.851837 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.851859 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:01.851887 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.854597 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:40607
I20251211 09:11:01.855165 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:11:01.855479 9010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:40607 every 8 connection(s)
W20251211 09:11:01.856385 9014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:01.856437 9013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:01.856588 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:01.856618 479 server_base.cc:1047] running on GCE node
I20251211 09:11:01.856787 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:01.856817 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:01.856848 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444261856847 us; error 0 us; skew 500 ppm
I20251211 09:11:01.857560 479 webserver.cc:492] Webserver started at http://127.0.119.194:38619/ using document root <none> and password file <none>
I20251211 09:11:01.857651 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:01.857697 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:01.857748 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:01.858047 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "a825a558e2374cd998915490ce2808b9"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.859135 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:01.859556 9023 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.859652 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.859697 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "a825a558e2374cd998915490ce2808b9"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.859741 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:01.864916 9011 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46147
I20251211 09:11:01.864988 9011 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:01.865120 9011 heartbeater.cc:507] Master 127.0.119.254:46147 requested a full tablet report, sending...
I20251211 09:11:01.865360 8882 ts_manager.cc:194] Registered new tserver with Master: 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193:40607)
I20251211 09:11:01.866176 8882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49662
I20251211 09:11:01.872392 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:01.872550 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:01.872681 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:01.872871 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:01.872898 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.872921 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:01.872949 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.875731 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:40773
I20251211 09:11:01.875778 9086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:40773 every 8 connection(s)
I20251211 09:11:01.876081 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:01.877471 9093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:01.877523 479 server_base.cc:1047] running on GCE node
W20251211 09:11:01.877557 9091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:01.877700 9090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:01.877872 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:01.877909 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:01.877926 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444261877927 us; error 0 us; skew 500 ppm
I20251211 09:11:01.878559 479 webserver.cc:492] Webserver started at http://127.0.119.195:41205/ using document root <none> and password file <none>
I20251211 09:11:01.878647 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:01.878690 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:01.878736 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:01.879001 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "383252b2ad184c97b701458377bd9a16"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.879456 9087 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46147
I20251211 09:11:01.879513 9087 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:01.879590 9087 heartbeater.cc:507] Master 127.0.119.254:46147 requested a full tablet report, sending...
I20251211 09:11:01.879781 8882 ts_manager.cc:194] Registered new tserver with Master: a825a558e2374cd998915490ce2808b9 (127.0.119.194:40773)
I20251211 09:11:01.880105 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:11:01.880218 8882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49670
I20251211 09:11:01.880617 9098 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.880728 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.880772 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "383252b2ad184c97b701458377bd9a16"
format_stamp: "Formatted at 2025-12-11 09:11:01 on dist-test-slave-hb70"
I20251211 09:11:01.880815 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:01.891279 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:01.891517 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:01.891695 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:01.891978 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:01.892017 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.892040 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:01.892055 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:01.895210 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:33689
I20251211 09:11:01.895270 9161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:33689 every 8 connection(s)
I20251211 09:11:01.898167 9162 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46147
I20251211 09:11:01.898232 9162 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:01.898336 9162 heartbeater.cc:507] Master 127.0.119.254:46147 requested a full tablet report, sending...
I20251211 09:11:01.898561 8882 ts_manager.cc:194] Registered new tserver with Master: 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:01.898716 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003318713s
I20251211 09:11:01.899044 8882 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49672
I20251211 09:11:01.899106 479 test_util.cc:276] Using random seed: -2045121696
I20251211 09:11:01.903527 8882 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49682:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:11:01.903661 8882 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:11:01.908215 9126 tablet_service.cc:1505] Processing CreateTablet for tablet 42eaf4c181c54a2aa04a3484f00e177d (DEFAULT_TABLE table=test-workload [id=63368c0ea1804843999ca08469fd5a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:01.908357 9126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42eaf4c181c54a2aa04a3484f00e177d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:01.908571 9051 tablet_service.cc:1505] Processing CreateTablet for tablet 42eaf4c181c54a2aa04a3484f00e177d (DEFAULT_TABLE table=test-workload [id=63368c0ea1804843999ca08469fd5a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:01.908670 9051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42eaf4c181c54a2aa04a3484f00e177d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:01.909437 8975 tablet_service.cc:1505] Processing CreateTablet for tablet 42eaf4c181c54a2aa04a3484f00e177d (DEFAULT_TABLE table=test-workload [id=63368c0ea1804843999ca08469fd5a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:01.909547 8975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42eaf4c181c54a2aa04a3484f00e177d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:01.910040 9177 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16: Bootstrap starting.
I20251211 09:11:01.910607 9177 tablet_bootstrap.cc:654] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:01.910876 9179 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Bootstrap starting.
I20251211 09:11:01.911049 9178 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: Bootstrap starting.
I20251211 09:11:01.911258 9177 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16: No bootstrap required, opened a new log
I20251211 09:11:01.911314 9177 ts_tablet_manager.cc:1403] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:01.911350 9179 tablet_bootstrap.cc:654] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:01.911476 9177 raft_consensus.cc:359] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.911525 9178 tablet_bootstrap.cc:654] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:01.911568 9177 raft_consensus.cc:385] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:01.911593 9177 raft_consensus.cc:740] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 383252b2ad184c97b701458377bd9a16, State: Initialized, Role: FOLLOWER
I20251211 09:11:01.911661 9177 consensus_queue.cc:260] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.911829 9177 ts_tablet_manager.cc:1434] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:01.911857 9162 heartbeater.cc:499] Master 127.0.119.254:46147 was elected leader, sending a full tablet report...
I20251211 09:11:01.912132 9178 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: No bootstrap required, opened a new log
I20251211 09:11:01.912199 9178 ts_tablet_manager.cc:1403] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:01.912143 9179 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: No bootstrap required, opened a new log
I20251211 09:11:01.912333 9179 ts_tablet_manager.cc:1403] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:01.912360 9178 raft_consensus.cc:359] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.912434 9178 raft_consensus.cc:385] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:01.912459 9178 raft_consensus.cc:740] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a825a558e2374cd998915490ce2808b9, State: Initialized, Role: FOLLOWER
I20251211 09:11:01.912503 9178 consensus_queue.cc:260] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.912493 9179 raft_consensus.cc:359] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.912604 9179 raft_consensus.cc:385] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:01.912642 9179 raft_consensus.cc:740] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ba5bd86fd54d53a467c217586dd1f6, State: Initialized, Role: FOLLOWER
I20251211 09:11:01.912703 9178 ts_tablet_manager.cc:1434] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:01.912730 9087 heartbeater.cc:499] Master 127.0.119.254:46147 was elected leader, sending a full tablet report...
I20251211 09:11:01.912813 9179 consensus_queue.cc:260] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.912943 9179 ts_tablet_manager.cc:1434] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:11:01.912981 9011 heartbeater.cc:499] Master 127.0.119.254:46147 was elected leader, sending a full tablet report...
I20251211 09:11:01.927683 9184 raft_consensus.cc:493] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:01.927773 9184 raft_consensus.cc:515] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.927927 9184 leader_election.cc:290] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193:40607), 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:01.929886 9185 raft_consensus.cc:493] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:01.929957 9185 raft_consensus.cc:515] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.930120 9185 leader_election.cc:290] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a825a558e2374cd998915490ce2808b9 (127.0.119.194:40773), 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:01.930600 8985 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ba5bd86fd54d53a467c217586dd1f6" is_pre_election: true
I20251211 09:11:01.930696 8985 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a825a558e2374cd998915490ce2808b9 in term 0.
I20251211 09:11:01.930970 9025 leader_election.cc:304] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ba5bd86fd54d53a467c217586dd1f6, a825a558e2374cd998915490ce2808b9; no voters:
I20251211 09:11:01.931068 9184 raft_consensus.cc:2804] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:11:01.931106 9184 raft_consensus.cc:493] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:01.931133 9184 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:01.931926 9184 raft_consensus.cc:515] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.932037 9184 leader_election.cc:290] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 1 election: Requested vote from peers 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193:40607), 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:01.932276 8985 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09ba5bd86fd54d53a467c217586dd1f6"
I20251211 09:11:01.932333 9136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "383252b2ad184c97b701458377bd9a16" is_pre_election: true
I20251211 09:11:01.932425 9136 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a825a558e2374cd998915490ce2808b9 in term 0.
I20251211 09:11:01.932504 9135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "383252b2ad184c97b701458377bd9a16"
I20251211 09:11:01.932542 9135 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:01.932884 9061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "09ba5bd86fd54d53a467c217586dd1f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a825a558e2374cd998915490ce2808b9" is_pre_election: true
I20251211 09:11:01.932973 9061 raft_consensus.cc:2393] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09ba5bd86fd54d53a467c217586dd1f6 in current term 1: Already voted for candidate a825a558e2374cd998915490ce2808b9 in this term.
I20251211 09:11:01.932333 8985 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:01.933372 9135 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a825a558e2374cd998915490ce2808b9 in term 1.
I20251211 09:11:01.933502 9025 leader_election.cc:304] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 383252b2ad184c97b701458377bd9a16, a825a558e2374cd998915490ce2808b9; no voters:
I20251211 09:11:01.933574 9184 raft_consensus.cc:2804] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:01.933710 9184 raft_consensus.cc:697] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 LEADER]: Becoming Leader. State: Replica: a825a558e2374cd998915490ce2808b9, State: Running, Role: LEADER
I20251211 09:11:01.933768 9184 consensus_queue.cc:237] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:01.934084 8985 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a825a558e2374cd998915490ce2808b9 in term 1.
I20251211 09:11:01.934242 8882 catalog_manager.cc:5654] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a825a558e2374cd998915490ce2808b9 (127.0.119.194). New cstate: current_term: 1 leader_uuid: "a825a558e2374cd998915490ce2808b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:01.934585 9135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "09ba5bd86fd54d53a467c217586dd1f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "383252b2ad184c97b701458377bd9a16" is_pre_election: true
I20251211 09:11:01.934659 9135 raft_consensus.cc:2393] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09ba5bd86fd54d53a467c217586dd1f6 in current term 1: Already voted for candidate a825a558e2374cd998915490ce2808b9 in this term.
I20251211 09:11:01.934790 8949 leader_election.cc:304] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09ba5bd86fd54d53a467c217586dd1f6; no voters: 383252b2ad184c97b701458377bd9a16, a825a558e2374cd998915490ce2808b9
I20251211 09:11:01.934909 9185 raft_consensus.cc:2749] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251211 09:11:01.951658 9135 raft_consensus.cc:1275] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 1 FOLLOWER]: Refusing update from remote peer a825a558e2374cd998915490ce2808b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:01.951661 8985 raft_consensus.cc:1275] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 1 FOLLOWER]: Refusing update from remote peer a825a558e2374cd998915490ce2808b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:01.951927 9184 consensus_queue.cc:1048] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:01.952013 9189 consensus_queue.cc:1048] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:12.325805 9184 raft_consensus.cc:993] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: : Instructing follower 09ba5bd86fd54d53a467c217586dd1f6 to start an election
I20251211 09:11:12.325909 9184 raft_consensus.cc:1081] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 LEADER]: Signalling peer 09ba5bd86fd54d53a467c217586dd1f6 to start an election
I20251211 09:11:12.326153 8985 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d"
dest_uuid: "09ba5bd86fd54d53a467c217586dd1f6"
from {username='slave'} at 127.0.0.1:60626
I20251211 09:11:12.326218 8985 raft_consensus.cc:493] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:11:12.326249 8985 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:12.326894 8985 raft_consensus.cc:515] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:12.327034 8985 leader_election.cc:290] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [CANDIDATE]: Term 2 election: Requested vote from peers a825a558e2374cd998915490ce2808b9 (127.0.119.194:40773), 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:12.327214 9135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "09ba5bd86fd54d53a467c217586dd1f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13748 } } ignore_live_leader: true dest_uuid: "383252b2ad184c97b701458377bd9a16"
I20251211 09:11:12.327246 9061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "09ba5bd86fd54d53a467c217586dd1f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13748 } } ignore_live_leader: true dest_uuid: "a825a558e2374cd998915490ce2808b9"
I20251211 09:11:12.327294 9135 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:12.327314 9061 raft_consensus.cc:3055] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:11:12.327342 9061 raft_consensus.cc:740] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a825a558e2374cd998915490ce2808b9, State: Running, Role: LEADER
I20251211 09:11:12.327430 9061 consensus_queue.cc:260] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13748, Committed index: 13748, Last appended: 1.13748, Last appended by leader: 13748, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:12.327524 9061 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:12.328085 9135 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ba5bd86fd54d53a467c217586dd1f6 in term 2.
I20251211 09:11:12.328204 9061 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ba5bd86fd54d53a467c217586dd1f6 in term 2.
I20251211 09:11:12.328290 8949 leader_election.cc:304] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ba5bd86fd54d53a467c217586dd1f6, 383252b2ad184c97b701458377bd9a16; no voters:
I20251211 09:11:12.328480 9226 raft_consensus.cc:2804] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:11:12.328567 9226 raft_consensus.cc:697] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 LEADER]: Becoming Leader. State: Replica: 09ba5bd86fd54d53a467c217586dd1f6, State: Running, Role: LEADER
I20251211 09:11:12.328619 9226 consensus_queue.cc:237] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13748, Committed index: 13748, Last appended: 1.13748, Last appended by leader: 13748, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:12.329118 8881 catalog_manager.cc:5654] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 reported cstate change: term changed from 1 to 2, leader changed from a825a558e2374cd998915490ce2808b9 (127.0.119.194) to 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193). New cstate: current_term: 2 leader_uuid: "09ba5bd86fd54d53a467c217586dd1f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:12.337538 479 tablet_replica.cc:333] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: stopping tablet replica
I20251211 09:11:12.337605 479 raft_consensus.cc:2243] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:11:12.337675 479 pending_rounds.cc:70] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Trying to abort 1 pending ops.
I20251211 09:11:12.337708 479 pending_rounds.cc:77] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Aborting op as it isn't in flight: id { term: 2 index: 13749 } timestamp: 7231259739458711552 op_type: NO_OP noop_request { }
I20251211 09:11:12.337762 479 raft_consensus.cc:2889] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 09:11:12.337786 479 raft_consensus.cc:2272] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:12.341594 479 ts_tablet_manager.cc:1916] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20251211 09:11:12.343062 479 ts_tablet_manager.cc:1929] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.13749
I20251211 09:11:12.343114 479 log.cc:1199] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Deleting WAL directory at /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1765444027994158-479-0/minicluster-data/ts-0-root/wals/42eaf4c181c54a2aa04a3484f00e177d
I20251211 09:11:13.853329 9240 raft_consensus.cc:493] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:13.853444 9240 raft_consensus.cc:515] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:13.853621 9240 leader_election.cc:290] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193:40607), 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:13.853935 9135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 13748 } } ignore_live_leader: false dest_uuid: "383252b2ad184c97b701458377bd9a16" is_pre_election: true
I20251211 09:11:13.853935 8985 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 13748 } } ignore_live_leader: false dest_uuid: "09ba5bd86fd54d53a467c217586dd1f6" is_pre_election: true
I20251211 09:11:13.854035 9135 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a825a558e2374cd998915490ce2808b9 in term 2.
I20251211 09:11:13.854044 8985 raft_consensus.cc:1803] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.13749
I20251211 09:11:13.854094 8985 raft_consensus.cc:2410] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a825a558e2374cd998915490ce2808b9 for term 3 because replica has last-logged OpId of term: 2 index: 13749, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 13748.
I20251211 09:11:13.854228 9025 leader_election.cc:304] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 383252b2ad184c97b701458377bd9a16, a825a558e2374cd998915490ce2808b9; no voters:
I20251211 09:11:13.854317 9240 raft_consensus.cc:2804] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251211 09:11:13.854362 9240 raft_consensus.cc:493] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:13.854391 9240 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:13.855060 9240 raft_consensus.cc:515] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:13.855167 9240 leader_election.cc:290] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 3 election: Requested vote from peers 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193:40607), 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:13.855419 8985 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 13748 } } ignore_live_leader: false dest_uuid: "09ba5bd86fd54d53a467c217586dd1f6"
I20251211 09:11:13.855448 9135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "a825a558e2374cd998915490ce2808b9" candidate_term: 3 candidate_status { last_received { term: 1 index: 13748 } } ignore_live_leader: false dest_uuid: "383252b2ad184c97b701458377bd9a16"
I20251211 09:11:13.855520 9135 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:13.855509 8985 raft_consensus.cc:1803] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.13749
I20251211 09:11:13.855647 8985 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:13.856145 9135 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a825a558e2374cd998915490ce2808b9 in term 3.
I20251211 09:11:13.856256 8985 raft_consensus.cc:2410] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a825a558e2374cd998915490ce2808b9 for term 3 because replica has last-logged OpId of term: 2 index: 13749, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 13748.
I20251211 09:11:13.856312 9025 leader_election.cc:304] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 383252b2ad184c97b701458377bd9a16, a825a558e2374cd998915490ce2808b9; no voters:
I20251211 09:11:13.856382 9240 raft_consensus.cc:2804] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 FOLLOWER]: Leader election won for term 3
I20251211 09:11:13.856472 9240 raft_consensus.cc:697] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 LEADER]: Becoming Leader. State: Replica: a825a558e2374cd998915490ce2808b9, State: Running, Role: LEADER
I20251211 09:11:13.856523 9240 consensus_queue.cc:237] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13748, Committed index: 13748, Last appended: 1.13748, Last appended by leader: 13748, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:13.857017 8881 catalog_manager.cc:5654] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 reported cstate change: term changed from 2 to 3, leader changed from 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193) to a825a558e2374cd998915490ce2808b9 (127.0.119.194). New cstate: current_term: 3 leader_uuid: "a825a558e2374cd998915490ce2808b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:13.885071 9135 raft_consensus.cc:1275] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 3 FOLLOWER]: Refusing update from remote peer a825a558e2374cd998915490ce2808b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 13748. Preceding OpId from leader: term: 3 index: 13750. (index mismatch)
W20251211 09:11:13.885133 9025 consensus_peers.cc:597] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 -> Peer 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193:40607): Couldn't send request to peer 09ba5bd86fd54d53a467c217586dd1f6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20251211 09:11:13.885434 9241 consensus_queue.cc:1048] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13749, Last known committed idx: 13748, Time since last communication: 0.000s
I20251211 09:11:13.886404 9250 mvcc.cc:204] Tried to move back new op lower bound from 7231259745831804928 to 7231259745716813824. Current Snapshot: MvccSnapshot[applied={T|T < 7231259745831804928}]
I20251211 09:11:14.338976 9257 ts_tablet_manager.cc:933] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Initiating tablet copy from peer a825a558e2374cd998915490ce2808b9 (127.0.119.194:40773)
I20251211 09:11:14.339221 9257 tablet_copy_client.cc:323] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: tablet copy: Beginning tablet copy session from remote peer at address 127.0.119.194:40773
I20251211 09:11:14.339542 9071 tablet_copy_service.cc:140] P a825a558e2374cd998915490ce2808b9: Received BeginTabletCopySession request for tablet 42eaf4c181c54a2aa04a3484f00e177d from peer 09ba5bd86fd54d53a467c217586dd1f6 ({username='slave'} at 127.0.0.1:47110)
I20251211 09:11:14.339607 9071 tablet_copy_service.cc:161] P a825a558e2374cd998915490ce2808b9: Beginning new tablet copy session on tablet 42eaf4c181c54a2aa04a3484f00e177d from peer 09ba5bd86fd54d53a467c217586dd1f6 at {username='slave'} at 127.0.0.1:47110: session id = 09ba5bd86fd54d53a467c217586dd1f6-42eaf4c181c54a2aa04a3484f00e177d
I20251211 09:11:14.340180 9071 tablet_copy_source_session.cc:215] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: Tablet Copy: opened 0 blocks and 3 log segments
I20251211 09:11:14.340530 9257 ts_tablet_manager.cc:1916] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Deleting tablet data with delete state TABLET_DATA_COPYING
I20251211 09:11:14.341965 9257 ts_tablet_manager.cc:1929] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.13749
I20251211 09:11:14.342063 9257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42eaf4c181c54a2aa04a3484f00e177d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:14.342548 9257 tablet_copy_client.cc:806] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: tablet copy: Starting download of 0 data blocks...
I20251211 09:11:14.342674 9257 tablet_copy_client.cc:670] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: tablet copy: Starting download of 3 WAL segments...
I20251211 09:11:14.378422 9257 tablet_copy_client.cc:538] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 09:11:14.379236 9257 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Bootstrap starting.
I20251211 09:11:15.173688 9257 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Bootstrap replayed 1/3 log segments. Stats: ops{read=4622 overwritten=0 applied=4618 ignored=0} inserts{seen=230850 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20251211 09:11:15.920140 9257 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Bootstrap replayed 2/3 log segments. Stats: ops{read=9242 overwritten=0 applied=9241 ignored=0} inserts{seen=462000 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:11:16.693460 9257 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Bootstrap replayed 3/3 log segments. Stats: ops{read=13854 overwritten=0 applied=13853 ignored=0} inserts{seen=687350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:11:16.693754 9257 tablet_bootstrap.cc:492] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Bootstrap complete.
I20251211 09:11:16.698397 9257 ts_tablet_manager.cc:1403] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Time spent bootstrapping tablet: real 2.319s user 2.048s sys 0.269s
I20251211 09:11:16.698593 9257 raft_consensus.cc:359] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:16.698787 9257 raft_consensus.cc:740] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09ba5bd86fd54d53a467c217586dd1f6, State: Initialized, Role: FOLLOWER
I20251211 09:11:16.698858 9257 consensus_queue.cc:260] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13853, Last appended: 3.13854, Last appended by leader: 13854, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:16.699025 9257 ts_tablet_manager.cc:1434] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 09:11:16.699329 9069 tablet_copy_service.cc:342] P a825a558e2374cd998915490ce2808b9: Request end of tablet copy session 09ba5bd86fd54d53a467c217586dd1f6-42eaf4c181c54a2aa04a3484f00e177d received from {username='slave'} at 127.0.0.1:47110
I20251211 09:11:16.699383 9069 tablet_copy_service.cc:434] P a825a558e2374cd998915490ce2808b9: ending tablet copy session 09ba5bd86fd54d53a467c217586dd1f6-42eaf4c181c54a2aa04a3484f00e177d on tablet 42eaf4c181c54a2aa04a3484f00e177d with peer 09ba5bd86fd54d53a467c217586dd1f6
I20251211 09:11:17.115797 8985 raft_consensus.cc:1217] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.13748->[3.13749-3.14054] Dedup: 3.13854->[3.13855-3.14054]
I20251211 09:11:17.120628 9277 raft_consensus.cc:993] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: : Instructing follower 383252b2ad184c97b701458377bd9a16 to start an election
I20251211 09:11:17.120837 9277 raft_consensus.cc:1081] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 LEADER]: Signalling peer 383252b2ad184c97b701458377bd9a16 to start an election
I20251211 09:11:17.120841 9281 raft_consensus.cc:993] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: : Instructing follower 09ba5bd86fd54d53a467c217586dd1f6 to start an election
I20251211 09:11:17.120972 9277 raft_consensus.cc:1081] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 LEADER]: Signalling peer 09ba5bd86fd54d53a467c217586dd1f6 to start an election
I20251211 09:11:17.121127 8985 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d"
dest_uuid: "09ba5bd86fd54d53a467c217586dd1f6"
from {username='slave'} at 127.0.0.1:60626
I20251211 09:11:17.121193 8985 raft_consensus.cc:493] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20251211 09:11:17.121132 9135 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d"
dest_uuid: "383252b2ad184c97b701458377bd9a16"
from {username='slave'} at 127.0.0.1:51788
I20251211 09:11:17.121222 8985 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 3 FOLLOWER]: Advancing to term 4
W20251211 09:11:17.121400 9025 consensus_peers.cc:409] unable to start election on peer 383252b2ad184c97b701458377bd9a16: Illegal state: leader elections are disabled
I20251211 09:11:17.121985 8985 raft_consensus.cc:515] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:17.122136 8985 leader_election.cc:290] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [CANDIDATE]: Term 4 election: Requested vote from peers a825a558e2374cd998915490ce2808b9 (127.0.119.194:40773), 383252b2ad184c97b701458377bd9a16 (127.0.119.195:33689)
I20251211 09:11:17.122263 9135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "09ba5bd86fd54d53a467c217586dd1f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 14055 } } ignore_live_leader: true dest_uuid: "383252b2ad184c97b701458377bd9a16"
I20251211 09:11:17.122329 9135 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:11:17.122370 9061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42eaf4c181c54a2aa04a3484f00e177d" candidate_uuid: "09ba5bd86fd54d53a467c217586dd1f6" candidate_term: 4 candidate_status { last_received { term: 3 index: 14055 } } ignore_live_leader: true dest_uuid: "a825a558e2374cd998915490ce2808b9"
I20251211 09:11:17.122432 9061 raft_consensus.cc:3055] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 LEADER]: Stepping down as leader of term 3
I20251211 09:11:17.122455 9061 raft_consensus.cc:740] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a825a558e2374cd998915490ce2808b9, State: Running, Role: LEADER
I20251211 09:11:17.122501 9061 consensus_queue.cc:260] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14055, Committed index: 14055, Last appended: 3.14055, Last appended by leader: 14055, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:17.122572 9061 raft_consensus.cc:3060] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:11:17.122979 9135 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ba5bd86fd54d53a467c217586dd1f6 in term 4.
I20251211 09:11:17.123184 8949 leader_election.cc:304] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09ba5bd86fd54d53a467c217586dd1f6, 383252b2ad184c97b701458377bd9a16; no voters:
I20251211 09:11:17.123267 9275 raft_consensus.cc:2804] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 4 FOLLOWER]: Leader election won for term 4
I20251211 09:11:17.123298 9061 raft_consensus.cc:2468] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09ba5bd86fd54d53a467c217586dd1f6 in term 4.
I20251211 09:11:17.123374 9275 raft_consensus.cc:697] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 4 LEADER]: Becoming Leader. State: Replica: 09ba5bd86fd54d53a467c217586dd1f6, State: Running, Role: LEADER
I20251211 09:11:17.123428 9275 consensus_queue.cc:237] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14055, Committed index: 14055, Last appended: 3.14055, Last appended by leader: 14055, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } }
I20251211 09:11:17.123750 8880 catalog_manager.cc:5654] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 reported cstate change: term changed from 3 to 4, leader changed from a825a558e2374cd998915490ce2808b9 (127.0.119.194) to 09ba5bd86fd54d53a467c217586dd1f6 (127.0.119.193). New cstate: current_term: 4 leader_uuid: "09ba5bd86fd54d53a467c217586dd1f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a825a558e2374cd998915490ce2808b9" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 40773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09ba5bd86fd54d53a467c217586dd1f6" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 40607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "383252b2ad184c97b701458377bd9a16" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33689 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:17.138832 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:11:17.141314 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:17.141599 479 tablet_replica.cc:333] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: stopping tablet replica
I20251211 09:11:17.141665 479 raft_consensus.cc:2243] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 4 LEADER]: Raft consensus shutting down.
I20251211 09:11:17.141803 479 pending_rounds.cc:70] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Trying to abort 1 pending ops.
I20251211 09:11:17.141827 479 pending_rounds.cc:77] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6: Aborting op as it isn't in flight: id { term: 4 index: 14056 } timestamp: 7231259759098007552 op_type: NO_OP noop_request { }
I20251211 09:11:17.141871 479 raft_consensus.cc:2889] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251211 09:11:17.141888 479 raft_consensus.cc:2272] T 42eaf4c181c54a2aa04a3484f00e177d P 09ba5bd86fd54d53a467c217586dd1f6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:17.155949 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:11:17.157122 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:11:17.159543 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:17.159693 479 tablet_replica.cc:333] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9: stopping tablet replica
I20251211 09:11:17.159750 479 raft_consensus.cc:2243] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:17.159799 479 raft_consensus.cc:2272] T 42eaf4c181c54a2aa04a3484f00e177d P a825a558e2374cd998915490ce2808b9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:17.181293 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:11:17.182359 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:11:17.185122 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:17.185303 479 tablet_replica.cc:333] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16: stopping tablet replica
I20251211 09:11:17.185356 479 raft_consensus.cc:2243] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:17.185405 479 raft_consensus.cc:2272] T 42eaf4c181c54a2aa04a3484f00e177d P 383252b2ad184c97b701458377bd9a16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:17.198895 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:11:17.199939 479 master.cc:561] Master@127.0.119.254:46147 shutting down...
I20251211 09:11:17.202116 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:11:17.202183 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:17.202204 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0db52c092eff4e068347bdb30d2f28e0: stopping tablet replica
I20251211 09:11:17.213883 479 master.cc:583] Master@127.0.119.254:46147 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound (15461 ms)
[----------] 21 tests from TxnParticipantITest (249233 ms total)
[----------] 2 tests from TxnParticipantElectionStormITest
[ RUN ] TxnParticipantElectionStormITest.TestFrequentElections
I20251211 09:11:17.232661 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:35381
I20251211 09:11:17.232816 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:17.234225 9291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:17.234402 479 server_base.cc:1047] running on GCE node
W20251211 09:11:17.234305 9294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:17.234351 9292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:17.234678 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:17.234711 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:17.234724 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444277234725 us; error 0 us; skew 500 ppm
I20251211 09:11:17.235280 479 webserver.cc:492] Webserver started at http://127.0.119.254:42613/ using document root <none> and password file <none>
I20251211 09:11:17.235349 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:17.235384 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:17.235422 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:17.235682 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "1005346adddc4367a3a98b0ce0f97b46"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.236528 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:17.236972 9299 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.237115 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.237161 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "1005346adddc4367a3a98b0ce0f97b46"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.237215 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:17.261991 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:17.262208 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:17.264762 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:35381
I20251211 09:11:17.277459 9351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:35381 every 8 connection(s)
I20251211 09:11:17.277642 9352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:17.278659 9352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: Bootstrap starting.
I20251211 09:11:17.278970 9352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:17.279465 9352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: No bootstrap required, opened a new log
I20251211 09:11:17.279587 9352 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:17.279639 9352 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:17.279661 9352 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1005346adddc4367a3a98b0ce0f97b46, State: Initialized, Role: FOLLOWER
I20251211 09:11:17.279719 9352 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:17.279752 9352 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:11:17.279772 9352 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:11:17.279804 9352 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:17.280303 9352 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:17.280360 9352 leader_election.cc:304] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1005346adddc4367a3a98b0ce0f97b46; no voters:
I20251211 09:11:17.280470 9352 leader_election.cc:290] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:11:17.280530 9355 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:17.280617 9352 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:11:17.280689 9355 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 LEADER]: Becoming Leader. State: Replica: 1005346adddc4367a3a98b0ce0f97b46, State: Running, Role: LEADER
I20251211 09:11:17.280750 9355 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:17.281000 9357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1005346adddc4367a3a98b0ce0f97b46. Latest consensus state: current_term: 1 leader_uuid: "1005346adddc4367a3a98b0ce0f97b46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER } }
I20251211 09:11:17.281088 9357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:17.280980 9356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1005346adddc4367a3a98b0ce0f97b46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER } }
I20251211 09:11:17.281152 9356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:17.281387 9362 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:11:17.281526 9362 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:11:17.282073 9362 catalog_manager.cc:1357] Generated new cluster ID: f7079280d4d849cb9861e12dbe980292
I20251211 09:11:17.282073 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:11:17.282140 9362 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:11:17.293139 9362 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:11:17.293576 9362 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:11:17.300288 9362 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: Generated new TSK 0
I20251211 09:11:17.300379 9362 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:11:17.313891 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:17.315428 9376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:17.315450 9373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:17.315461 479 server_base.cc:1047] running on GCE node
W20251211 09:11:17.315467 9374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:17.315743 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:17.315783 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:17.315796 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444277315797 us; error 0 us; skew 500 ppm
I20251211 09:11:17.316380 479 webserver.cc:492] Webserver started at http://127.0.119.193:33735/ using document root <none> and password file <none>
I20251211 09:11:17.316453 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:17.316505 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:17.316565 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:17.316865 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "2da53b301e274e63968e16c177efa678"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.317763 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:17.318205 9381 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.318342 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.318382 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "2da53b301e274e63968e16c177efa678"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.318424 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:17.332960 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:17.333164 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:17.333341 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:17.333528 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:17.333556 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.333585 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:17.333598 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.336246 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:45019
I20251211 09:11:17.336309 9444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:45019 every 8 connection(s)
I20251211 09:11:17.336635 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:17.337782 9449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:17.337788 9450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:17.337893 9452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:17.338279 479 server_base.cc:1047] running on GCE node
I20251211 09:11:17.338405 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:17.338438 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:17.338454 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444277338454 us; error 0 us; skew 500 ppm
I20251211 09:11:17.339167 479 webserver.cc:492] Webserver started at http://127.0.119.194:44633/ using document root <none> and password file <none>
I20251211 09:11:17.339263 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:17.339314 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:17.339371 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:17.339717 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "4268dfc39c6846ff9862641870b507d0"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.340610 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:11:17.341033 9457 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.341148 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.341189 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "4268dfc39c6846ff9862641870b507d0"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.341236 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:17.343915 9445 heartbeater.cc:344] Connected to a master server at 127.0.119.254:35381
I20251211 09:11:17.343979 9445 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:17.344085 9445 heartbeater.cc:507] Master 127.0.119.254:35381 requested a full tablet report, sending...
I20251211 09:11:17.344309 9316 ts_manager.cc:194] Registered new tserver with Master: 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:17.344887 9316 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48252
I20251211 09:11:17.350705 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:17.350893 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:17.351056 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:17.351248 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:17.351275 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.351311 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:17.351338 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.354146 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:44497
I20251211 09:11:17.354194 9522 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:44497 every 8 connection(s)
I20251211 09:11:17.354517 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:17.355722 9527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:17.355659 9526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:17.355768 479 server_base.cc:1047] running on GCE node
W20251211 09:11:17.356232 9529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:17.356421 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:17.356456 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:17.356469 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444277356469 us; error 0 us; skew 500 ppm
I20251211 09:11:17.357125 479 webserver.cc:492] Webserver started at http://127.0.119.195:40673/ using document root <none> and password file <none>
I20251211 09:11:17.357201 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:17.357277 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:17.357322 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:17.357643 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "b546844397f6426994e641f568e0c32e"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.357772 9523 heartbeater.cc:344] Connected to a master server at 127.0.119.254:35381
I20251211 09:11:17.357832 9523 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:17.357952 9523 heartbeater.cc:507] Master 127.0.119.254:35381 requested a full tablet report, sending...
I20251211 09:11:17.358182 9316 ts_manager.cc:194] Registered new tserver with Master: 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497)
I20251211 09:11:17.358544 9316 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48258
I20251211 09:11:17.358665 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:17.359140 9534 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.359283 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.359329 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "b546844397f6426994e641f568e0c32e"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:17.359380 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:17.378166 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:17.378414 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:17.378590 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:17.378803 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:17.378830 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.378867 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:17.378898 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.382259 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:33889
I20251211 09:11:17.382314 9597 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:33889 every 8 connection(s)
I20251211 09:11:17.385234 9598 heartbeater.cc:344] Connected to a master server at 127.0.119.254:35381
I20251211 09:11:17.385336 9598 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:17.385435 9598 heartbeater.cc:507] Master 127.0.119.254:35381 requested a full tablet report, sending...
I20251211 09:11:17.385673 9316 ts_manager.cc:194] Registered new tserver with Master: b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:17.385761 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00332021s
I20251211 09:11:17.386059 9316 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48270
I20251211 09:11:17.386114 479 test_util.cc:276] Using random seed: -2029634686
I20251211 09:11:17.390982 9316 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48278:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:11:17.391125 9316 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:11:17.395675 9562 tablet_service.cc:1505] Processing CreateTablet for tablet 7b1f2f134e3145e0a4662c29d28c2408 (DEFAULT_TABLE table=test-workload [id=9544c98fb7684a99920798da05be6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:17.395824 9562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1f2f134e3145e0a4662c29d28c2408. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:17.396013 9485 tablet_service.cc:1505] Processing CreateTablet for tablet 7b1f2f134e3145e0a4662c29d28c2408 (DEFAULT_TABLE table=test-workload [id=9544c98fb7684a99920798da05be6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:17.396109 9485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1f2f134e3145e0a4662c29d28c2408. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:17.397339 9615 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Bootstrap starting.
I20251211 09:11:17.397426 9409 tablet_service.cc:1505] Processing CreateTablet for tablet 7b1f2f134e3145e0a4662c29d28c2408 (DEFAULT_TABLE table=test-workload [id=9544c98fb7684a99920798da05be6e14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:17.397529 9409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1f2f134e3145e0a4662c29d28c2408. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:17.397563 9614 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Bootstrap starting.
I20251211 09:11:17.397910 9615 tablet_bootstrap.cc:654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:17.398087 9614 tablet_bootstrap.cc:654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:17.398516 9615 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: No bootstrap required, opened a new log
I20251211 09:11:17.398563 9615 ts_tablet_manager.cc:1403] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:17.398644 9618 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Bootstrap starting.
I20251211 09:11:17.398717 9615 raft_consensus.cc:359] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.398797 9615 raft_consensus.cc:385] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:17.398821 9615 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Initialized, Role: FOLLOWER
I20251211 09:11:17.398903 9615 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.399022 9614 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: No bootstrap required, opened a new log
I20251211 09:11:17.399071 9615 ts_tablet_manager.cc:1434] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:17.399081 9614 ts_tablet_manager.cc:1403] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:11:17.399083 9618 tablet_bootstrap.cc:654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:17.399201 9523 heartbeater.cc:499] Master 127.0.119.254:35381 was elected leader, sending a full tablet report...
I20251211 09:11:17.399296 9614 raft_consensus.cc:359] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.399374 9614 raft_consensus.cc:385] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:17.399405 9614 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Initialized, Role: FOLLOWER
I20251211 09:11:17.399515 9614 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.399667 9614 ts_tablet_manager.cc:1434] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:17.399714 9622 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:17.399747 9598 heartbeater.cc:499] Master 127.0.119.254:35381 was elected leader, sending a full tablet report...
I20251211 09:11:17.399762 9622 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.400175 9618 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: No bootstrap required, opened a new log
I20251211 09:11:17.400221 9618 ts_tablet_manager.cc:1403] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:11:17.400225 9622 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:17.400381 9618 raft_consensus.cc:359] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.400434 9618 raft_consensus.cc:385] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:17.400449 9618 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Initialized, Role: FOLLOWER
I20251211 09:11:17.400480 9618 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.400588 9618 ts_tablet_manager.cc:1434] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:17.400646 9445 heartbeater.cc:499] Master 127.0.119.254:35381 was elected leader, sending a full tablet report...
I20251211 09:11:17.402338 9619 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:17.402400 9619 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.402534 9619 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:17.403235 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0" is_pre_election: true
I20251211 09:11:17.403308 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 0.
I20251211 09:11:17.403450 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:17.403527 9622 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:11:17.403565 9622 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:17.403594 9622 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:17.403964 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678" is_pre_election: true
I20251211 09:11:17.404031 9419 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 0.
I20251211 09:11:17.404397 9622 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.404642 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:17.404642 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:17.404716 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:17.404728 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:17.405421 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e" is_pre_election: true
I20251211 09:11:17.405426 9419 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 1.
I20251211 09:11:17.405439 9622 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 1 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:17.405508 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 1.
I20251211 09:11:17.405687 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:17.405506 9572 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 1: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:17.405789 9622 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:17.405835 9622 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 1 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:17.405880 9622 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:17.406320 9316 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 0 to 1, leader changed from <none> to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 1 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:17.407451 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678" is_pre_election: true
I20251211 09:11:17.407508 9419 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 1: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:17.407644 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:17.407738 9619 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251211 09:11:17.417318 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 1 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:17.417336 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 1 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:17.417593 9621 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:17.417692 9622 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:27.443315 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:27.443413 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:27.444101 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.444259 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 2 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.447958 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 2 candidate_status { last_received { term: 1 index: 14725 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.447970 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 2 candidate_status { last_received { term: 1 index: 14725 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.448238 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.448340 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251211 09:11:27.448644 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 2 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 1. Current term is 2. Ops: []
I20251211 09:11:27.448840 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 1.14725, Next index: 14726, Last known committed idx: 14725, Time since last communication: 0.000s
W20251211 09:11:27.448957 9640 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20251211 09:11:27.448987 9640 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20251211 09:11:27.464124 9640 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:11:27.464202 9640 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:27.464265 9640 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14725, Committed index: 14725, Last appended: 1.14725, Last appended by leader: 14725, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.464401 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:27.470345 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:27.470418 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:27.471118 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.471278 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.471485 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 14725 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.471489 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 14725 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.471593 9418 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 2: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:27.472169 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 2.
I20251211 09:11:27.472349 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:27.472447 9674 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:11:27.472591 9674 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 2 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:27.472641 9674 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14725, Committed index: 14725, Last appended: 1.14725, Last appended by leader: 14725, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.473138 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 1 to 2, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 2 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:27.474223 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 2 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 14725. Preceding OpId from leader: term: 2 index: 14727. (index mismatch)
I20251211 09:11:27.474330 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 2 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 14725. Preceding OpId from leader: term: 2 index: 14727. (index mismatch)
I20251211 09:11:27.474406 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14726, Last known committed idx: 14725, Time since last communication: 0.000s
I20251211 09:11:27.474512 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14726, Last known committed idx: 14725, Time since last communication: 0.000s
I20251211 09:11:27.505697 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:27.505817 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:27.506668 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.506795 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 3 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 2. Current term is 3. Ops: []
I20251211 09:11:27.506829 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 3 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.506982 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 3 candidate_status { last_received { term: 2 index: 14727 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.507032 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 3 candidate_status { last_received { term: 2 index: 14727 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.507151 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 2.14727, Next index: 14728, Last known committed idx: 14727, Time since last communication: 0.000s
I20251211 09:11:27.507241 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.507375 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20251211 09:11:27.518045 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 3 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 2. Current term is 3. Ops: [2.14728-2.14728]
I20251211 09:11:27.518297 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 2.14727, Next index: 14728, Last known committed idx: 14727, Time since last communication: 0.000s
I20251211 09:11:27.546885 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.546972 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:11:27.547611 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.547755 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 4 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.547971 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 4 candidate_status { last_received { term: 2 index: 14727 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.547974 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 4 candidate_status { last_received { term: 2 index: 14727 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.548204 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.548298 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251211 09:11:27.552620 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 2. Current term is 4. Ops: [2.14728-2.14728]
I20251211 09:11:27.552798 9675 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 2.14727, Next index: 14728, Last known committed idx: 14727, Time since last communication: 0.000s
I20251211 09:11:27.567832 9674 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 2 LEADER]: Stepping down as leader of term 2
I20251211 09:11:27.567888 9674 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:27.567934 9674 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14728, Committed index: 14728, Last appended: 2.14728, Last appended by leader: 14728, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.568006 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:27.572584 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:27.572631 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:27.573117 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.573282 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 3 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:27.573407 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 14728 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.573460 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 3 candidate_status { last_received { term: 2 index: 14728 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.573536 9418 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 3. Current term is 4.
I20251211 09:11:27.573709 9536 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 3 election: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 3. Current term is 4.
I20251211 09:11:27.573755 9536 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20251211 09:11:27.573833 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:11:27.574218 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 3.
I20251211 09:11:27.574502 9640 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 3. Current term is 4.
I20251211 09:11:27.578567 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.578635 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 4 FOLLOWER]: Advancing to term 5
I20251211 09:11:27.579115 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.579227 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 5 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.579349 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 5 candidate_status { last_received { term: 2 index: 14727 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.579404 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 3 FOLLOWER]: Advancing to term 5
I20251211 09:11:27.579411 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 5 candidate_status { last_received { term: 2 index: 14727 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.579509 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 4 FOLLOWER]: Advancing to term 5
I20251211 09:11:27.579897 9495 raft_consensus.cc:2410] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for term 5 because replica has last-logged OpId of term: 2 index: 14728, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 14727.
I20251211 09:11:27.580189 9572 raft_consensus.cc:2410] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for term 5 because replica has last-logged OpId of term: 2 index: 14728, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 14727.
I20251211 09:11:27.580358 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.580444 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20251211 09:11:27.611294 9689 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.611383 9689 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 5 FOLLOWER]: Advancing to term 6
I20251211 09:11:27.611814 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.611871 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 5 FOLLOWER]: Advancing to term 6
I20251211 09:11:27.612190 9689 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.612347 9689 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 6 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.612543 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 6 candidate_status { last_received { term: 2 index: 14728 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.612605 9418 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 5 FOLLOWER]: Advancing to term 6
I20251211 09:11:27.612550 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 6 candidate_status { last_received { term: 2 index: 14728 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.612629 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.612738 9572 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 6: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:27.612797 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 6 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:27.612965 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 6 candidate_status { last_received { term: 2 index: 14728 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.612999 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 6 candidate_status { last_received { term: 2 index: 14728 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.613062 9495 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 6: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:27.613291 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:27.613363 9418 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 6.
I20251211 09:11:27.613495 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters: b546844397f6426994e641f568e0c32e
I20251211 09:11:27.613503 9640 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20251211 09:11:27.613591 9689 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 6 FOLLOWER]: Leader election won for term 6
I20251211 09:11:27.613642 9689 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 6 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:27.613691 9689 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14727, Committed index: 14727, Last appended: 2.14728, Last appended by leader: 14728, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.614080 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:27.624076 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 6 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 14728. Preceding OpId from leader: term: 6 index: 14729. (index mismatch)
I20251211 09:11:27.624090 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 6 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 14727. Preceding OpId from leader: term: 6 index: 14729. (index mismatch)
I20251211 09:11:27.624313 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14729, Last known committed idx: 14728, Time since last communication: 0.000s
I20251211 09:11:27.624416 9674 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14729, Last known committed idx: 14727, Time since last communication: 0.000s
I20251211 09:11:27.657135 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:27.657226 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 6 FOLLOWER]: Advancing to term 7
I20251211 09:11:27.657989 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.658145 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 7 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 6. Current term is 7. Ops: []
I20251211 09:11:27.658164 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 7 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.658309 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 7 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.658349 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 7 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.658392 9675 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 6.14730, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.658522 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.658627 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20251211 09:11:27.662986 9689 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 6 is higher.
I20251211 09:11:27.685921 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 7 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 6. Current term is 7. Ops: []
I20251211 09:11:27.686137 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 6.14730, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.691963 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.692032 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 7 FOLLOWER]: Advancing to term 8
I20251211 09:11:27.692612 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.692719 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 8 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.692883 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 8 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.692891 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 8 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.693107 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.693192 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20251211 09:11:27.707137 9689 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 6 is higher.
I20251211 09:11:27.714550 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 8 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 6. Current term is 8. Ops: []
I20251211 09:11:27.714753 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 6.14730, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.745769 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.745865 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 8 FOLLOWER]: Advancing to term 9
I20251211 09:11:27.746490 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.746644 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 9 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.746837 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 9 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.746837 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 9 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.747083 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.747193 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20251211 09:11:27.749795 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 6. Current term is 9. Ops: []
I20251211 09:11:27.749987 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 6.14730, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.753468 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:27.753553 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 6 FOLLOWER]: Advancing to term 7
I20251211 09:11:27.754295 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.754412 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 7 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:27.754520 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.754623 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 7 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.754720 9418 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 7. Current term is 9.
I20251211 09:11:27.754884 9536 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 7 election: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 7. Current term is 9.
I20251211 09:11:27.754913 9536 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20251211 09:11:27.754971 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 7 FOLLOWER]: Advancing to term 9
I20251211 09:11:27.755478 9640 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 9 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 7. Current term is 9.
I20251211 09:11:27.755556 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 9 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 6. Current term is 9. Ops: []
I20251211 09:11:27.755743 9675 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 6.14730, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.763495 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 6. Current term is 9. Ops: [6.14731-6.14731]
I20251211 09:11:27.763593 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 9 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 6. Current term is 9. Ops: [6.14731-6.14731]
I20251211 09:11:27.763690 9675 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 6.14730, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.763777 9689 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 6.14730, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.770911 9674 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 6 LEADER]: Stepping down as leader of term 6
I20251211 09:11:27.770963 9674 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:27.771026 9674 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14730, Committed index: 14730, Last appended: 6.14731, Last appended by leader: 14731, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.771116 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 6 FOLLOWER]: Advancing to term 7
I20251211 09:11:27.785118 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.785204 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 9 FOLLOWER]: Advancing to term 10
I20251211 09:11:27.785830 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.785980 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 10 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.786216 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 10 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.786216 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 10 candidate_status { last_received { term: 6 index: 14730 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.786336 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 7 FOLLOWER]: Advancing to term 10
I20251211 09:11:27.786326 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 9 FOLLOWER]: Advancing to term 10
I20251211 09:11:27.787034 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 10.
I20251211 09:11:27.787040 9495 raft_consensus.cc:2410] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for term 10 because replica has last-logged OpId of term: 6 index: 14731, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 14730.
I20251211 09:11:27.787271 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:27.787377 9669 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 10 FOLLOWER]: Leader election won for term 10
I20251211 09:11:27.787473 9669 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 10 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:27.787513 9669 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14730, Committed index: 14730, Last appended: 6.14730, Last appended by leader: 14730, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.787961 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 6 to 10, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 10 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:27.802457 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.802537 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 10 FOLLOWER]: Advancing to term 11
I20251211 09:11:27.803154 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.803280 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 11 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.803468 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 11 candidate_status { last_received { term: 6 index: 14731 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.803469 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 11 candidate_status { last_received { term: 6 index: 14731 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.803550 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 10 FOLLOWER]: Advancing to term 11
I20251211 09:11:27.804083 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 11.
I20251211 09:11:27.804252 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:27.804337 9675 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 11 FOLLOWER]: Leader election won for term 11
I20251211 09:11:27.804396 9675 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 11 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:27.804443 9675 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14730, Committed index: 14730, Last appended: 6.14731, Last appended by leader: 14731, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.813293 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 11 LEADER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 10. Current term is 11. Ops: []
I20251211 09:11:27.813485 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14731, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.813566 9669 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer 4268dfc39c6846ff9862641870b507d0 log is divergent from this leader: its last log entry 11.14732 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14730
W20251211 09:11:27.814797 9674 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 11 is higher.
I20251211 09:11:27.816757 9313 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 10 to 11, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 11 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:27.820672 9669 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 10 LEADER]: Stepping down as leader of term 10
I20251211 09:11:27.820714 9669 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:27.820765 9669 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14730, Committed index: 14730, Last appended: 10.14731, Last appended by leader: 14731, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.820833 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 10 FOLLOWER]: Advancing to term 11
I20251211 09:11:27.832080 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 11 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 10 index: 14731. Preceding OpId from leader: term: 11 index: 14732. (index mismatch)
I20251211 09:11:27.832311 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14732, Last known committed idx: 14730, Time since last communication: 0.000s
I20251211 09:11:27.832367 9675 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer 2da53b301e274e63968e16c177efa678 log is divergent from this leader: its last log entry 10.14731 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14730
I20251211 09:11:27.832583 9418 pending_rounds.cc:85] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Aborting all ops after (but not including) 14730
I20251211 09:11:27.832615 9418 pending_rounds.cc:107] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Aborting uncommitted NO_OP operation due to leader change: 10.14731
I20251211 09:11:27.832629 9418 raft_consensus.cc:2889] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251211 09:11:27.836150 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 11 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 6 index: 14730. Preceding OpId from leader: term: 11 index: 14732. (index mismatch)
I20251211 09:11:27.836352 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14732, Last known committed idx: 14730, Time since last communication: 0.000s
W20251211 09:11:27.843930 9674 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 11 is higher.
W20251211 09:11:27.860168 9674 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 11 is higher.
I20251211 09:11:27.864245 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:27.864305 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 11 FOLLOWER]: Advancing to term 12
I20251211 09:11:27.864950 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.865064 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 12 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.865290 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 12 candidate_status { last_received { term: 11 index: 14732 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.865290 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 12 candidate_status { last_received { term: 11 index: 14732 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.865540 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.865620 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20251211 09:11:27.867615 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:27.867666 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 11 FOLLOWER]: Advancing to term 12
I20251211 09:11:27.868153 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.868273 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 12 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:27.868389 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 14732 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.868412 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 12 candidate_status { last_received { term: 11 index: 14732 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.868482 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 12 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 11. Current term is 12. Ops: []
I20251211 09:11:27.868621 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:27.868676 9675 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 11.14732, Next index: 14733, Last known committed idx: 14732, Time since last communication: 0.000s
I20251211 09:11:27.868709 9640 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20251211 09:11:27.871323 9674 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 11 is higher.
I20251211 09:11:27.872599 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 12 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 11. Current term is 12. Ops: []
I20251211 09:11:27.872794 9689 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 11.14732, Next index: 14733, Last known committed idx: 14732, Time since last communication: 0.000s
I20251211 09:11:27.898074 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 12 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 11. Current term is 12. Ops: []
I20251211 09:11:27.898317 9689 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 11.14732, Next index: 14733, Last known committed idx: 14732, Time since last communication: 0.000s
I20251211 09:11:27.905059 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:27.905130 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 12 FOLLOWER]: Advancing to term 13
I20251211 09:11:27.905159 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 12 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 11. Current term is 12. Ops: []
I20251211 09:11:27.905357 9689 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 11.14732, Next index: 14733, Last known committed idx: 14732, Time since last communication: 0.000s
I20251211 09:11:27.905822 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.905952 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 13 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:27.906090 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 14732 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.906131 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 13 candidate_status { last_received { term: 11 index: 14732 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.906183 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 12 FOLLOWER]: Advancing to term 13
I20251211 09:11:27.906713 9419 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 13.
I20251211 09:11:27.906898 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters: 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:27.906981 9640 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 13 FOLLOWER]: Leader election won for term 13
I20251211 09:11:27.907047 9640 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 13 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:27.907092 9640 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14732, Committed index: 14732, Last appended: 11.14732, Last appended by leader: 14732, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.907449 9313 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 11 to 13, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 13 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:27.931833 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 13 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 14732. Preceding OpId from leader: term: 13 index: 14733. (index mismatch)
I20251211 09:11:27.932096 9640 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14733, Last known committed idx: 14732, Time since last communication: 0.000s
I20251211 09:11:27.933477 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 13 LEADER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 11. Current term is 13. Ops: []
I20251211 09:11:27.933676 9675 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 11.14732, Next index: 14733, Last known committed idx: 14733, Time since last communication: 0.000s
I20251211 09:11:27.933743 9675 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer b546844397f6426994e641f568e0c32e log is divergent from this leader: its last log entry 13.14733 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14733
I20251211 09:11:27.935899 9495 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 11 LEADER]: Stepping down as leader of term 11
I20251211 09:11:27.935933 9495 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:27.935971 9495 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14732, Committed index: 14732, Last appended: 11.14732, Last appended by leader: 14732, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.936035 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 11 FOLLOWER]: Advancing to term 13
I20251211 09:11:27.936584 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 13 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 11 index: 14732. Preceding OpId from leader: term: 13 index: 14733. (index mismatch)
I20251211 09:11:27.936818 9640 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14733, Last known committed idx: 14732, Time since last communication: 0.000s
I20251211 09:11:27.968919 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:27.969008 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 13 FOLLOWER]: Advancing to term 14
I20251211 09:11:27.969457 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:27.969514 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 13 FOLLOWER]: Advancing to term 14
I20251211 09:11:27.969784 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.969916 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 14 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.970119 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 14 candidate_status { last_received { term: 13 index: 14734 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.970119 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 14 candidate_status { last_received { term: 13 index: 14734 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:27.970279 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:27.970422 9495 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 in current term 14: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:27.970445 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 14 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:27.970549 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.970590 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14734 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:27.970693 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20251211 09:11:27.970710 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 14 candidate_status { last_received { term: 13 index: 14734 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:27.970757 9419 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 14: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:27.970872 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:27.970950 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20251211 09:11:27.973304 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 14 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 13. Current term is 14. Ops: []
I20251211 09:11:27.973464 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 13.14734, Next index: 14735, Last known committed idx: 14734, Time since last communication: 0.000s
I20251211 09:11:27.974262 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 14 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 13. Current term is 14. Ops: []
I20251211 09:11:27.974431 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 13.14734, Next index: 14735, Last known committed idx: 14734, Time since last communication: 0.000s
I20251211 09:11:27.998603 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 14 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 13. Current term is 14. Ops: []
I20251211 09:11:27.998823 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 13.14734, Next index: 14735, Last known committed idx: 14734, Time since last communication: 0.000s
I20251211 09:11:28.002712 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 14 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 13. Current term is 14. Ops: []
I20251211 09:11:28.002918 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 13.14734, Next index: 14735, Last known committed idx: 14734, Time since last communication: 0.000s
I20251211 09:11:28.006923 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.006978 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 14 FOLLOWER]: Advancing to term 15
I20251211 09:11:28.007555 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.007684 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 15 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.007875 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 15 candidate_status { last_received { term: 13 index: 14734 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.007872 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 15 candidate_status { last_received { term: 13 index: 14734 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.008001 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 14 FOLLOWER]: Advancing to term 15
I20251211 09:11:28.008701 9419 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 15.
I20251211 09:11:28.008908 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters: b546844397f6426994e641f568e0c32e
I20251211 09:11:28.009034 9675 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 15 FOLLOWER]: Leader election won for term 15
I20251211 09:11:28.009092 9675 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 15 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:28.009145 9675 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14734, Committed index: 14734, Last appended: 13.14734, Last appended by leader: 14734, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.009562 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 13 to 15, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 15 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:28.015996 9572 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 13 LEADER]: Stepping down as leader of term 13
I20251211 09:11:28.016008 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 15 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 13 index: 14734. Preceding OpId from leader: term: 15 index: 14735. (index mismatch)
I20251211 09:11:28.016048 9572 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.016155 9572 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14734, Committed index: 14734, Last appended: 13.14734, Last appended by leader: 14734, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.016237 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 13 FOLLOWER]: Advancing to term 15
I20251211 09:11:28.016748 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 15 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 13 index: 14734. Preceding OpId from leader: term: 15 index: 14735. (index mismatch)
I20251211 09:11:28.016997 9689 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14735, Last known committed idx: 14734, Time since last communication: 0.000s
I20251211 09:11:28.017074 9674 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14735, Last known committed idx: 14734, Time since last communication: 0.000s
I20251211 09:11:28.049270 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:28.049345 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 15 FOLLOWER]: Advancing to term 16
I20251211 09:11:28.049963 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.050091 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 16 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.050297 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 16 candidate_status { last_received { term: 15 index: 14736 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.050312 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 16 candidate_status { last_received { term: 15 index: 14736 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.050535 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.050637 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20251211 09:11:28.054792 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 16 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 15. Current term is 16. Ops: []
I20251211 09:11:28.055037 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 15.14736, Next index: 14737, Last known committed idx: 14736, Time since last communication: 0.000s
I20251211 09:11:28.072120 9667 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:28.072225 9667 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 15 FOLLOWER]: Advancing to term 16
I20251211 09:11:28.072888 9667 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.073053 9667 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 16 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.073263 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14736 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.073292 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14736 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.073334 9419 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 16: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:28.073503 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:28.073587 9667 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20251211 09:11:28.076145 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 16 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 15. Current term is 16. Ops: []
I20251211 09:11:28.076390 9689 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 15.14736, Next index: 14737, Last known committed idx: 14736, Time since last communication: 0.000s
W20251211 09:11:28.087034 9675 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 15 is higher.
I20251211 09:11:28.088896 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 16 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 15. Current term is 16. Ops: []
I20251211 09:11:28.089118 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 15.14736, Next index: 14737, Last known committed idx: 14736, Time since last communication: 0.000s
I20251211 09:11:28.095008 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.095062 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 16 FOLLOWER]: Advancing to term 17
I20251211 09:11:28.095618 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.095726 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 17 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.095934 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 17 candidate_status { last_received { term: 15 index: 14736 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.095978 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 17 candidate_status { last_received { term: 15 index: 14736 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.096061 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 16 FOLLOWER]: Advancing to term 17
I20251211 09:11:28.096562 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 17.
I20251211 09:11:28.096725 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters: 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:28.096805 9669 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 17 FOLLOWER]: Leader election won for term 17
I20251211 09:11:28.096873 9669 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 17 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.097015 9669 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14736, Committed index: 14736, Last appended: 15.14736, Last appended by leader: 14736, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.097424 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 15 to 17, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 17 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:28.101379 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 17 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 15. Current term is 17. Ops: []
I20251211 09:11:28.101583 9689 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 15.14736, Next index: 14737, Last known committed idx: 14736, Time since last communication: 0.000s
I20251211 09:11:28.122030 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 17 LEADER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 15. Current term is 17. Ops: []
I20251211 09:11:28.122277 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 15.14736, Next index: 14737, Last known committed idx: 14736, Time since last communication: 0.000s
I20251211 09:11:28.122395 9674 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer 2da53b301e274e63968e16c177efa678 log is divergent from this leader: its last log entry 17.14737 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14736
I20251211 09:11:28.123469 9495 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 15 LEADER]: Stepping down as leader of term 15
I20251211 09:11:28.123510 9495 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:28.123582 9495 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14736, Committed index: 14736, Last appended: 15.14736, Last appended by leader: 14736, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.123656 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 15 FOLLOWER]: Advancing to term 17
I20251211 09:11:28.124225 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 17 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 15 index: 14736. Preceding OpId from leader: term: 17 index: 14737. (index mismatch)
I20251211 09:11:28.124440 9669 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14737, Last known committed idx: 14736, Time since last communication: 0.000s
I20251211 09:11:28.125450 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 17 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 15 index: 14736. Preceding OpId from leader: term: 17 index: 14738. (index mismatch)
I20251211 09:11:28.125670 9669 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14737, Last known committed idx: 14736, Time since last communication: 0.000s
I20251211 09:11:28.157017 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:28.156955 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:28.157111 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 17 FOLLOWER]: Advancing to term 18
I20251211 09:11:28.157100 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 17 FOLLOWER]: Advancing to term 18
I20251211 09:11:28.157959 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.157959 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.158179 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 18 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.158178 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 18 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.158413 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.158387 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.158380 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.158435 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 18 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.158540 9572 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 18: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:28.158465 9495 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 18: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:28.158713 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.158725 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:28.158829 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20251211 09:11:28.158854 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20251211 09:11:28.158942 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 18 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 17. Current term is 18. Ops: []
I20251211 09:11:28.159139 9718 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 17.14738, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.161422 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 18 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 17. Current term is 18. Ops: []
I20251211 09:11:28.161598 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 17.14738, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.185101 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 18 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 17. Current term is 18. Ops: []
I20251211 09:11:28.185410 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 17.14738, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.198019 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 18 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 17. Current term is 18. Ops: []
I20251211 09:11:28.198280 9718 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 17.14738, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.199337 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.199385 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 18 FOLLOWER]: Advancing to term 19
I20251211 09:11:28.199972 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.200136 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 19 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.200229 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.200284 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.200282 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 18 FOLLOWER]: Advancing to term 19
I20251211 09:11:28.200349 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 19 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.200958 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.201077 9572 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 19: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:28.201092 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 19 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.201232 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.201220 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.201431 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20251211 09:11:28.201493 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.201555 9495 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 19: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:28.201694 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:28.201795 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20251211 09:11:28.217468 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 19 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 17. Current term is 19. Ops: []
I20251211 09:11:28.217785 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 17.14738, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.233671 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 19 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 17. Current term is 19. Ops: []
I20251211 09:11:28.233989 9718 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 17.14738, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.236049 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.236115 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 19 FOLLOWER]: Advancing to term 20
I20251211 09:11:28.236739 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.236892 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 20 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.237041 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.237041 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.237150 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 19 FOLLOWER]: Advancing to term 20
I20251211 09:11:28.237715 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 20.
I20251211 09:11:28.237917 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:28.238008 9711 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 20 FOLLOWER]: Leader election won for term 20
I20251211 09:11:28.238073 9711 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 20 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.238127 9711 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14738, Committed index: 14738, Last appended: 17.14738, Last appended by leader: 14738, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.238569 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 17 to 20, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 20 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:28.246616 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 20 LEADER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 17. Current term is 20. Ops: []
I20251211 09:11:28.246891 9703 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 17 LEADER]: Stepping down as leader of term 17
I20251211 09:11:28.246887 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 17.14738, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.246999 9703 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.247023 9669 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer b546844397f6426994e641f568e0c32e log is divergent from this leader: its last log entry 20.14739 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14738
I20251211 09:11:28.247072 9703 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14738, Committed index: 14738, Last appended: 17.14738, Last appended by leader: 14738, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.247154 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 17 FOLLOWER]: Advancing to term 18
I20251211 09:11:28.260830 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 20 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14738. Preceding OpId from leader: term: 20 index: 14739. (index mismatch)
I20251211 09:11:28.261118 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.270328 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.270402 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 18 FOLLOWER]: Advancing to term 19
I20251211 09:11:28.271136 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.271288 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 19 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.271517 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 19 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.271530 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 19 candidate_status { last_received { term: 17 index: 14738 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.271832 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.271920 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20251211 09:11:28.273947 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 19 FOLLOWER]: Advancing to term 20
I20251211 09:11:28.274525 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 20 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14738. Preceding OpId from leader: term: 20 index: 14739. (index mismatch)
I20251211 09:11:28.274742 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14739, Last known committed idx: 14738, Time since last communication: 0.000s
I20251211 09:11:28.305316 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:28.305418 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 20 FOLLOWER]: Advancing to term 21
I20251211 09:11:28.306170 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.306314 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 21 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.306556 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 21 candidate_status { last_received { term: 20 index: 14739 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.306553 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 21 candidate_status { last_received { term: 20 index: 14739 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.306816 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.306927 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20251211 09:11:28.309180 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 21 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 20. Current term is 21. Ops: []
I20251211 09:11:28.309418 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 20.14739, Next index: 14740, Last known committed idx: 14739, Time since last communication: 0.000s
I20251211 09:11:28.319370 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:28.319460 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 20 FOLLOWER]: Advancing to term 21
I20251211 09:11:28.320186 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.320312 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 21 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 20. Current term is 21. Ops: []
I20251211 09:11:28.320340 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 21 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.320488 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14739 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.320565 9419 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 21: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:28.320559 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 21 candidate_status { last_received { term: 20 index: 14739 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.320542 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 20.14739, Next index: 14740, Last known committed idx: 14739, Time since last communication: 0.000s
I20251211 09:11:28.320804 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.320887 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20251211 09:11:28.338028 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.338132 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 21 FOLLOWER]: Advancing to term 22
I20251211 09:11:28.338877 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.339008 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 22 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.339012 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 20. Current term is 22. Ops: []
I20251211 09:11:28.339206 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 22 candidate_status { last_received { term: 20 index: 14739 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.339265 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 22 candidate_status { last_received { term: 20 index: 14739 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.339289 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 20.14739, Next index: 14740, Last known committed idx: 14739, Time since last communication: 0.000s
I20251211 09:11:28.339329 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 21 FOLLOWER]: Advancing to term 22
I20251211 09:11:28.339824 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 22.
I20251211 09:11:28.339998 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters: b546844397f6426994e641f568e0c32e
I20251211 09:11:28.340093 9718 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 FOLLOWER]: Leader election won for term 22
I20251211 09:11:28.340185 9718 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.340345 9718 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14739, Committed index: 14739, Last appended: 20.14739, Last appended by leader: 14739, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.340795 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 20 to 22, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 22 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:28.354430 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 22 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 20. Current term is 22. Ops: []
I20251211 09:11:28.354664 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 20.14739, Next index: 14740, Last known committed idx: 14739, Time since last communication: 0.000s
W20251211 09:11:28.358247 9703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 22 is higher.
I20251211 09:11:28.362615 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 LEADER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 20. Current term is 22. Ops: []
I20251211 09:11:28.362840 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 20.14739, Next index: 14740, Last known committed idx: 14739, Time since last communication: 0.000s
I20251211 09:11:28.362936 9640 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer 2da53b301e274e63968e16c177efa678 log is divergent from this leader: its last log entry 22.14740 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14739
I20251211 09:11:28.368111 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 22 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 20 index: 14739. Preceding OpId from leader: term: 22 index: 14740. (index mismatch)
I20251211 09:11:28.368355 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14740, Last known committed idx: 14739, Time since last communication: 0.000s
I20251211 09:11:28.377197 9572 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 20 LEADER]: Stepping down as leader of term 20
I20251211 09:11:28.377274 9572 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.377315 9572 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14739, Committed index: 14739, Last appended: 20.14739, Last appended by leader: 14739, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
W20251211 09:11:28.377409 9703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 22 is higher.
I20251211 09:11:28.377452 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 20 FOLLOWER]: Advancing to term 22
I20251211 09:11:28.378053 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 22 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 20 index: 14739. Preceding OpId from leader: term: 22 index: 14740. (index mismatch)
I20251211 09:11:28.378316 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14740, Last known committed idx: 14739, Time since last communication: 0.000s
W20251211 09:11:28.398584 9703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 22 is higher.
W20251211 09:11:28.416786 9703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 22 is higher.
I20251211 09:11:28.438877 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:28.438970 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 22 FOLLOWER]: Advancing to term 23
I20251211 09:11:28.439639 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.439805 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 23 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.440016 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14740 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.440016 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 23 candidate_status { last_received { term: 22 index: 14740 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.440312 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:28.440428 9640 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20251211 09:11:28.443727 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 23 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 22. Current term is 23. Ops: []
I20251211 09:11:28.443964 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 22.14740, Next index: 14741, Last known committed idx: 14740, Time since last communication: 0.000s
I20251211 09:11:28.471632 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 23 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 22. Current term is 23. Ops: []
I20251211 09:11:28.471928 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 22.14740, Next index: 14741, Last known committed idx: 14740, Time since last communication: 0.000s
I20251211 09:11:28.476462 9718 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 LEADER]: Stepping down as leader of term 22
I20251211 09:11:28.476522 9718 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.476580 9718 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14740, Committed index: 14740, Last appended: 22.14740, Last appended by leader: 14740, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.476683 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 22 FOLLOWER]: Advancing to term 23
I20251211 09:11:28.482502 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:28.482585 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 22 FOLLOWER]: Advancing to term 23
I20251211 09:11:28.482996 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.483058 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 23 FOLLOWER]: Advancing to term 24
I20251211 09:11:28.483278 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.483418 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 23 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.483601 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 23 candidate_status { last_received { term: 22 index: 14740 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.483608 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 23 candidate_status { last_received { term: 22 index: 14740 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.483801 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.483906 9572 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 23. Current term is 24.
I20251211 09:11:28.483928 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 24 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.484053 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14740 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.484153 9460 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 23 election: Vote denied by peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 23. Current term is 24.
I20251211 09:11:28.484211 9460 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20251211 09:11:28.484279 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 23 FOLLOWER]: Advancing to term 24
I20251211 09:11:28.484365 9419 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 23.
I20251211 09:11:28.484159 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 24 candidate_status { last_received { term: 22 index: 14740 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.484830 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 23. Current term is 24.
I20251211 09:11:28.485383 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 24.
I20251211 09:11:28.485603 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:28.485711 9640 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 FOLLOWER]: Leader election won for term 24
I20251211 09:11:28.485774 9640 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.485831 9640 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14740, Committed index: 14740, Last appended: 22.14740, Last appended by leader: 14740, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.486254 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 22 to 24, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 24 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:28.514590 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 23 FOLLOWER]: Advancing to term 24
I20251211 09:11:28.515314 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 24 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14740. Preceding OpId from leader: term: 24 index: 14741. (index mismatch)
I20251211 09:11:28.515548 9640 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14741, Last known committed idx: 14740, Time since last communication: 0.000s
I20251211 09:11:28.515587 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 24 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14740. Preceding OpId from leader: term: 24 index: 14741. (index mismatch)
I20251211 09:11:28.515810 9640 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14741, Last known committed idx: 14740, Time since last communication: 0.000s
W20251211 09:11:28.526997 9667 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 24 is higher.
W20251211 09:11:28.529162 9667 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 24 is higher.
I20251211 09:11:28.547161 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:28.547257 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 24 FOLLOWER]: Advancing to term 25
I20251211 09:11:28.547884 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.548017 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 25 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.548242 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 25 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.548273 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 25 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.548501 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.548583 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20251211 09:11:28.553390 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 25 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 24. Current term is 25. Ops: []
I20251211 09:11:28.553591 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 24.14741, Next index: 14742, Last known committed idx: 14741, Time since last communication: 0.000s
I20251211 09:11:28.581948 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.582041 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 25 FOLLOWER]: Advancing to term 26
I20251211 09:11:28.582687 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.582824 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 26 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.583102 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 26 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.583119 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 26 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.583396 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.583498 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20251211 09:11:28.589214 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 24. Current term is 26. Ops: []
I20251211 09:11:28.589476 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 24.14741, Next index: 14742, Last known committed idx: 14741, Time since last communication: 0.000s
I20251211 09:11:28.614670 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 24. Current term is 26. Ops: []
I20251211 09:11:28.614939 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 24.14741, Next index: 14742, Last known committed idx: 14741, Time since last communication: 0.000s
I20251211 09:11:28.635707 9711 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 LEADER]: Stepping down as leader of term 24
I20251211 09:11:28.635805 9711 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.635871 9711 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14741, Committed index: 14741, Last appended: 24.14741, Last appended by leader: 14741, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.636004 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 24 FOLLOWER]: Advancing to term 25
I20251211 09:11:28.644171 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:28.644263 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 24 FOLLOWER]: Advancing to term 25
I20251211 09:11:28.644887 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.645044 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 25 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.645260 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.645303 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 25 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.645344 9419 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 25. Current term is 26.
I20251211 09:11:28.645550 9459 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 25 election: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 25. Current term is 26.
I20251211 09:11:28.645596 9459 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20251211 09:11:28.645653 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 25 FOLLOWER]: Advancing to term 26
I20251211 09:11:28.646099 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 25.
I20251211 09:11:28.646195 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.646239 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Advancing to term 27
I20251211 09:11:28.646258 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 25. Current term is 26.
I20251211 09:11:28.646703 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.646816 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 27 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.646941 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 27 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.646996 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 25 FOLLOWER]: Advancing to term 27
I20251211 09:11:28.646994 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 27 candidate_status { last_received { term: 24 index: 14741 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.647132 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 26 FOLLOWER]: Advancing to term 27
I20251211 09:11:28.647461 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 27.
I20251211 09:11:28.647589 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 27.
I20251211 09:11:28.647619 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:28.647691 9718 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 27 FOLLOWER]: Leader election won for term 27
I20251211 09:11:28.647740 9718 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 27 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.647796 9718 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14741, Committed index: 14741, Last appended: 24.14741, Last appended by leader: 14741, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.648162 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 24 to 27, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 27 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:28.674746 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 27 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 24 index: 14741. Preceding OpId from leader: term: 27 index: 14742. (index mismatch)
I20251211 09:11:28.675019 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14742, Last known committed idx: 14741, Time since last communication: 0.000s
I20251211 09:11:28.676367 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 27 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 24 index: 14741. Preceding OpId from leader: term: 27 index: 14742. (index mismatch)
I20251211 09:11:28.676541 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14742, Last known committed idx: 14741, Time since last communication: 0.000s
I20251211 09:11:28.731492 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 27 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:28.731600 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 27 FOLLOWER]: Advancing to term 28
I20251211 09:11:28.732267 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.732403 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 27. Current term is 28. Ops: []
I20251211 09:11:28.732548 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 28 candidate_status { last_received { term: 27 index: 14742 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.732586 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 28 candidate_status { last_received { term: 27 index: 14742 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.732432 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 28 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.732627 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 27 FOLLOWER]: Advancing to term 28
I20251211 09:11:28.732749 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 27.14742, Next index: 14743, Last known committed idx: 14742, Time since last communication: 0.000s
I20251211 09:11:28.733275 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 28.
I20251211 09:11:28.733472 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:28.733564 9711 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 FOLLOWER]: Leader election won for term 28
I20251211 09:11:28.733625 9711 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.733665 9711 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14742, Committed index: 14742, Last appended: 27.14742, Last appended by leader: 14742, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.734117 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 27 to 28, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 28 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:28.735033 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 28 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 27. Current term is 28. Ops: []
I20251211 09:11:28.735234 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 27.14742, Next index: 14743, Last known committed idx: 14742, Time since last communication: 0.000s
I20251211 09:11:28.757323 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 LEADER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 27. Current term is 28. Ops: []
I20251211 09:11:28.757364 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 28 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 27 index: 14742. Preceding OpId from leader: term: 28 index: 14743. (index mismatch)
I20251211 09:11:28.757560 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14743, Last known committed idx: 14742, Time since last communication: 0.000s
I20251211 09:11:28.757602 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 27.14742, Next index: 14743, Last known committed idx: 14742, Time since last communication: 0.000s
I20251211 09:11:28.757673 9703 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer b546844397f6426994e641f568e0c32e log is divergent from this leader: its last log entry 28.14743 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14742
I20251211 09:11:28.766427 9419 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 27 LEADER]: Stepping down as leader of term 27
I20251211 09:11:28.766501 9419 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.766561 9419 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14742, Committed index: 14742, Last appended: 27.14742, Last appended by leader: 14742, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.766659 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 27 FOLLOWER]: Advancing to term 28
I20251211 09:11:28.767333 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 28 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 27 index: 14742. Preceding OpId from leader: term: 28 index: 14743. (index mismatch)
I20251211 09:11:28.767567 9667 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14743, Last known committed idx: 14742, Time since last communication: 0.000s
I20251211 09:11:28.798178 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 28 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:28.798282 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 28 FOLLOWER]: Advancing to term 29
I20251211 09:11:28.798936 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.799079 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 29 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.799321 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 29 candidate_status { last_received { term: 28 index: 14743 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.799321 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 29 candidate_status { last_received { term: 28 index: 14743 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.799572 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.799686 9703 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20251211 09:11:28.803686 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 29 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 28. Current term is 29. Ops: []
I20251211 09:11:28.803927 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 28.14743, Next index: 14744, Last known committed idx: 14743, Time since last communication: 0.000s
I20251211 09:11:28.810694 9640 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 LEADER]: Stepping down as leader of term 28
I20251211 09:11:28.810750 9640 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.810789 9640 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14743, Committed index: 14743, Last appended: 28.14743, Last appended by leader: 14743, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.810887 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 28 FOLLOWER]: Advancing to term 29
I20251211 09:11:28.837407 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 28 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:28.837505 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 28 FOLLOWER]: Advancing to term 29
I20251211 09:11:28.838235 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.838399 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 29 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.838589 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 29 candidate_status { last_received { term: 28 index: 14743 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.838590 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 29 candidate_status { last_received { term: 28 index: 14743 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.838719 9419 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 29: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:28.838896 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.838945 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 29 FOLLOWER]: Advancing to term 30
I20251211 09:11:28.839273 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 29.
I20251211 09:11:28.839483 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:28.839604 9675 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 29 FOLLOWER]: Leader election won for term 29
I20251211 09:11:28.839604 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.839689 9675 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 29 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:28.839740 9675 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14743, Committed index: 14743, Last appended: 28.14743, Last appended by leader: 14743, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.839764 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 30 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.839929 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 30 candidate_status { last_received { term: 28 index: 14743 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.839996 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 29 FOLLOWER]: Advancing to term 30
I20251211 09:11:28.840196 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 28 to 29, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 29 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:28.840454 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 30.
I20251211 09:11:28.840541 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 30 candidate_status { last_received { term: 28 index: 14743 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.840602 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:28.840687 9703 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 30 FOLLOWER]: Leader election won for term 30
I20251211 09:11:28.840744 9703 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 30 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.840806 9703 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14743, Committed index: 14743, Last appended: 28.14743, Last appended by leader: 14743, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
W20251211 09:11:28.853415 9718 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 28 current term: 30 is higher.
I20251211 09:11:28.863008 9313 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 29 to 30, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 30 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:28.868511 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 30 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 29. Current term is 30. Ops: []
I20251211 09:11:28.868665 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 30 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 28 index: 14743. Preceding OpId from leader: term: 30 index: 14744. (index mismatch)
I20251211 09:11:28.868788 9675 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14744, Last known committed idx: 14743, Time since last communication: 0.000s
I20251211 09:11:28.868891 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14744, Last known committed idx: 14743, Time since last communication: 0.000s
I20251211 09:11:28.872362 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 30 LEADER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 29. Current term is 30. Ops: []
I20251211 09:11:28.872599 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14744, Last known committed idx: 14744, Time since last communication: 0.000s
I20251211 09:11:28.872673 9674 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer 2da53b301e274e63968e16c177efa678 log is divergent from this leader: its last log entry 30.14744 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14744
I20251211 09:11:28.875586 9495 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 29 LEADER]: Stepping down as leader of term 29
I20251211 09:11:28.875629 9495 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:28.875679 9495 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14743, Committed index: 14743, Last appended: 29.14744, Last appended by leader: 14744, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.875751 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 29 FOLLOWER]: Advancing to term 30
I20251211 09:11:28.876467 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 30 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 29 index: 14744. Preceding OpId from leader: term: 30 index: 14744. (term mismatch)
I20251211 09:11:28.876502 9495 pending_rounds.cc:85] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Aborting all ops after (but not including) 14743
I20251211 09:11:28.876513 9495 pending_rounds.cc:107] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Aborting uncommitted NO_OP operation due to leader change: 29.14744
I20251211 09:11:28.876525 9495 raft_consensus.cc:2889] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251211 09:11:28.876744 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14744, Last known committed idx: 14743, Time since last communication: 0.000s
I20251211 09:11:28.900605 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 30 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:28.900697 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 30 FOLLOWER]: Advancing to term 31
I20251211 09:11:28.901419 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.901580 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 31 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.901813 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 31 candidate_status { last_received { term: 30 index: 14744 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.901813 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 31 candidate_status { last_received { term: 30 index: 14744 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.902056 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:28.902173 9640 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20251211 09:11:28.904593 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 31 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 30. Current term is 31. Ops: []
I20251211 09:11:28.904798 9718 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 30.14744, Next index: 14745, Last known committed idx: 14744, Time since last communication: 0.000s
I20251211 09:11:28.937348 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:28.937444 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 30 FOLLOWER]: Advancing to term 31
I20251211 09:11:28.938195 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.938334 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 31 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 30. Current term is 31. Ops: []
I20251211 09:11:28.938344 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 31 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:28.938493 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 31 candidate_status { last_received { term: 30 index: 14744 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:28.938498 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 31 candidate_status { last_received { term: 30 index: 14744 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.938582 9572 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 31: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:28.938591 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 30.14744, Next index: 14745, Last known committed idx: 14744, Time since last communication: 0.000s
I20251211 09:11:28.938874 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:28.938971 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20251211 09:11:28.939522 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:28.939554 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 31 FOLLOWER]: Advancing to term 32
I20251211 09:11:28.940424 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.940527 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 32 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 30. Current term is 32. Ops: []
I20251211 09:11:28.940557 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 32 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:28.940686 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 32 candidate_status { last_received { term: 30 index: 14744 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:28.940697 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 32 candidate_status { last_received { term: 30 index: 14744 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:28.940785 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 31 FOLLOWER]: Advancing to term 32
I20251211 09:11:28.940819 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 30.14744, Next index: 14745, Last known committed idx: 14744, Time since last communication: 0.000s
I20251211 09:11:28.941381 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 32.
I20251211 09:11:28.941550 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:28.941632 9640 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 32 FOLLOWER]: Leader election won for term 32
I20251211 09:11:28.941694 9640 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 32 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:28.941745 9640 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14744, Committed index: 14744, Last appended: 30.14744, Last appended by leader: 14744, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.941865 9718 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 30 LEADER]: Stepping down as leader of term 30
I20251211 09:11:28.941910 9718 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:28.942054 9718 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14744, Committed index: 14744, Last appended: 30.14744, Last appended by leader: 14744, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:28.942157 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 30 FOLLOWER]: Advancing to term 31
I20251211 09:11:28.942160 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 30 to 32, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 32 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:28.968793 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 32 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 30 index: 14744. Preceding OpId from leader: term: 32 index: 14745. (index mismatch)
I20251211 09:11:28.969066 9640 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14745, Last known committed idx: 14744, Time since last communication: 0.000s
I20251211 09:11:28.969223 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 31 FOLLOWER]: Advancing to term 32
I20251211 09:11:28.970144 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 32 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 30 index: 14744. Preceding OpId from leader: term: 32 index: 14745. (index mismatch)
I20251211 09:11:28.970359 9640 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14745, Last known committed idx: 14744, Time since last communication: 0.000s
I20251211 09:11:29.001621 9669 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 32 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.001716 9669 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 32 FOLLOWER]: Advancing to term 33
I20251211 09:11:29.002447 9669 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.002542 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 33 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 32. Current term is 33. Ops: []
I20251211 09:11:29.002578 9669 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 33 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.002761 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 33 candidate_status { last_received { term: 32 index: 14745 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.002795 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 32.14745, Next index: 14746, Last known committed idx: 14745, Time since last communication: 0.000s
I20251211 09:11:29.002761 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 33 candidate_status { last_received { term: 32 index: 14745 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.003064 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.003177 9669 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
W20251211 09:11:29.017904 9633 lock_manager.cc:494] Txn 1 has not acquired the partition lock after 1000ms
I20251211 09:11:29.018882 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 33 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 32. Current term is 33. Ops: [32.14746-32.14746]
I20251211 09:11:29.019090 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 32.14745, Next index: 14746, Last known committed idx: 14745, Time since last communication: 0.000s
I20251211 09:11:29.039304 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.039394 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 33 FOLLOWER]: Advancing to term 34
I20251211 09:11:29.040208 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.040364 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 34 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.040576 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 34 candidate_status { last_received { term: 32 index: 14745 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.040589 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 34 candidate_status { last_received { term: 32 index: 14745 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.040858 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.040952 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20251211 09:11:29.054986 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 34 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 32. Current term is 34. Ops: [32.14746-32.14746]
I20251211 09:11:29.055230 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 32.14745, Next index: 14746, Last known committed idx: 14745, Time since last communication: 0.000s
I20251211 09:11:29.056315 9711 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 32 LEADER]: Stepping down as leader of term 32
I20251211 09:11:29.056361 9711 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 32 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:29.056439 9711 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14746, Committed index: 14746, Last appended: 32.14746, Last appended by leader: 14746, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.056524 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 32 FOLLOWER]: Advancing to term 33
I20251211 09:11:29.077291 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.077379 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 34 FOLLOWER]: Advancing to term 35
I20251211 09:11:29.077783 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 32 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.077872 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 32 FOLLOWER]: Advancing to term 33
I20251211 09:11:29.078115 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.078290 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 35 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.078476 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 35 candidate_status { last_received { term: 32 index: 14745 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.078485 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 35 candidate_status { last_received { term: 32 index: 14745 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.078578 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 33 FOLLOWER]: Advancing to term 35
I20251211 09:11:29.078569 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.078625 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 33 FOLLOWER]: Advancing to term 35
I20251211 09:11:29.078681 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 33 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.078872 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 33 candidate_status { last_received { term: 32 index: 14746 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.078971 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 33 candidate_status { last_received { term: 32 index: 14746 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.079007 9419 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 33. Current term is 35.
I20251211 09:11:29.079147 9459 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 33 election: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 33. Current term is 35.
I20251211 09:11:29.079186 9459 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 33 election: Cancelling election due to peer responding with higher term
I20251211 09:11:29.079226 9572 raft_consensus.cc:2410] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for term 35 because replica has last-logged OpId of term: 32 index: 14746, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 14745.
I20251211 09:11:29.079300 9495 raft_consensus.cc:2410] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for term 35 because replica has last-logged OpId of term: 32 index: 14746, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 14745.
I20251211 09:11:29.079385 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 35 FOLLOWER]: Leader election lost for term 33. Reason: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 33. Current term is 35.
I20251211 09:11:29.079443 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.079572 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20251211 09:11:29.083458 9667 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.083503 9667 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 35 FOLLOWER]: Advancing to term 36
I20251211 09:11:29.084003 9667 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.084115 9667 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 36 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.084255 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 36 candidate_status { last_received { term: 32 index: 14746 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.084261 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 36 candidate_status { last_received { term: 32 index: 14746 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.084324 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 35 FOLLOWER]: Advancing to term 36
I20251211 09:11:29.084345 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 35 FOLLOWER]: Advancing to term 36
I20251211 09:11:29.084808 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 36.
I20251211 09:11:29.084817 9419 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 36.
I20251211 09:11:29.084980 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:29.085062 9667 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 36 FOLLOWER]: Leader election won for term 36
I20251211 09:11:29.085228 9667 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 36 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:29.085306 9667 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14745, Committed index: 14745, Last appended: 32.14746, Last appended by leader: 14746, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.085819 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 32 to 36. New cstate: current_term: 36 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:29.108994 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 36 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 32 index: 14745. Preceding OpId from leader: term: 36 index: 14747. (index mismatch)
I20251211 09:11:29.109311 9667 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14747, Last known committed idx: 14745, Time since last communication: 0.000s
I20251211 09:11:29.113873 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 36 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 32 index: 14746. Preceding OpId from leader: term: 36 index: 14747. (index mismatch)
I20251211 09:11:29.114082 9667 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14747, Last known committed idx: 14746, Time since last communication: 0.000s
W20251211 09:11:29.116532 9711 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 33 current term: 36 is higher.
I20251211 09:11:29.140182 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 36 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.140275 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 36 FOLLOWER]: Advancing to term 37
I20251211 09:11:29.141060 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.141213 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 37 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.141431 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 37 candidate_status { last_received { term: 36 index: 14747 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.141439 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 37 candidate_status { last_received { term: 36 index: 14747 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.141675 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.141768 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20251211 09:11:29.144762 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 36 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.144847 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 36 FOLLOWER]: Advancing to term 37
I20251211 09:11:29.145614 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.145759 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 37 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.145944 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 37 candidate_status { last_received { term: 36 index: 14747 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.145946 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 37 candidate_status { last_received { term: 36 index: 14747 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.146096 9419 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 37: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:29.146183 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 37 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 36. Current term is 37. Ops: []
I20251211 09:11:29.146277 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.146402 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20251211 09:11:29.146386 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 36.14747, Next index: 14748, Last known committed idx: 14747, Time since last communication: 0.000s
I20251211 09:11:29.148131 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 37 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 36. Current term is 37. Ops: []
I20251211 09:11:29.148281 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 36.14747, Next index: 14748, Last known committed idx: 14747, Time since last communication: 0.000s
I20251211 09:11:29.173926 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 37 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 36. Current term is 37. Ops: []
I20251211 09:11:29.174180 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 36.14747, Next index: 14748, Last known committed idx: 14747, Time since last communication: 0.000s
I20251211 09:11:29.176865 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 37 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 36. Current term is 37. Ops: []
I20251211 09:11:29.177066 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 36.14747, Next index: 14748, Last known committed idx: 14747, Time since last communication: 0.000s
I20251211 09:11:29.177731 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.177770 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 37 FOLLOWER]: Advancing to term 38
I20251211 09:11:29.178350 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.178478 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 38 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.178649 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 38 candidate_status { last_received { term: 36 index: 14747 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.178633 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 38 candidate_status { last_received { term: 36 index: 14747 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.178730 9418 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 37 FOLLOWER]: Advancing to term 38
I20251211 09:11:29.179239 9418 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 38.
I20251211 09:11:29.179400 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters: b546844397f6426994e641f568e0c32e
I20251211 09:11:29.179481 9675 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 38 FOLLOWER]: Leader election won for term 38
I20251211 09:11:29.179528 9675 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 38 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:29.179564 9675 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14747, Committed index: 14747, Last appended: 36.14747, Last appended by leader: 14747, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
W20251211 09:11:29.179811 9711 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 34 current term: 36 is higher.
I20251211 09:11:29.179987 9313 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 36 to 38, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 38 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:29.202070 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 38 LEADER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 36. Current term is 38. Ops: []
I20251211 09:11:29.202335 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 36.14747, Next index: 14748, Last known committed idx: 14747, Time since last communication: 0.000s
I20251211 09:11:29.202433 9640 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer 4268dfc39c6846ff9862641870b507d0 log is divergent from this leader: its last log entry 38.14748 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14747
I20251211 09:11:29.203125 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 38 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 36 index: 14747. Preceding OpId from leader: term: 38 index: 14748. (index mismatch)
I20251211 09:11:29.203330 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14748, Last known committed idx: 14747, Time since last communication: 0.000s
I20251211 09:11:29.209012 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 38 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 36. Current term is 38. Ops: []
I20251211 09:11:29.209266 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 36.14747, Next index: 14748, Last known committed idx: 14748, Time since last communication: 0.000s
I20251211 09:11:29.212603 9572 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 36 LEADER]: Stepping down as leader of term 36
I20251211 09:11:29.212661 9572 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 36 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:29.212705 9572 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14747, Committed index: 14747, Last appended: 36.14747, Last appended by leader: 14747, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.212774 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 36 FOLLOWER]: Advancing to term 38
I20251211 09:11:29.213349 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 38 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 36 index: 14747. Preceding OpId from leader: term: 38 index: 14748. (index mismatch)
I20251211 09:11:29.213573 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14748, Last known committed idx: 14747, Time since last communication: 0.000s
I20251211 09:11:29.234759 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 38 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:29.234853 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 38 FOLLOWER]: Advancing to term 39
I20251211 09:11:29.235507 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.235642 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 39 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.235826 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 39 candidate_status { last_received { term: 38 index: 14748 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.235873 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 39 candidate_status { last_received { term: 38 index: 14748 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.236068 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.236171 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20251211 09:11:29.240442 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 39 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 38. Current term is 39. Ops: []
I20251211 09:11:29.240656 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 38.14748, Next index: 14749, Last known committed idx: 14748, Time since last communication: 0.000s
I20251211 09:11:29.244038 9640 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 38 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:29.244094 9640 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 38 FOLLOWER]: Advancing to term 39
I20251211 09:11:29.244645 9640 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.244787 9640 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 39 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.244954 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 39 candidate_status { last_received { term: 38 index: 14748 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.245012 9418 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 39: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:29.244984 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 39 candidate_status { last_received { term: 38 index: 14748 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.245169 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:29.245294 9640 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20251211 09:11:29.250523 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 39 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 38. Current term is 39. Ops: []
I20251211 09:11:29.250733 9719 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 38.14748, Next index: 14749, Last known committed idx: 14748, Time since last communication: 0.000s
I20251211 09:11:29.273527 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 39 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.273617 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 39 FOLLOWER]: Advancing to term 40
I20251211 09:11:29.274217 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.274343 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 40 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.274555 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 40 candidate_status { last_received { term: 38 index: 14748 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.274575 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 40 candidate_status { last_received { term: 38 index: 14748 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.274644 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 39 FOLLOWER]: Advancing to term 40
I20251211 09:11:29.275161 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 40.
I20251211 09:11:29.275326 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters: 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:29.275444 9718 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 40 FOLLOWER]: Leader election won for term 40
I20251211 09:11:29.275511 9718 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 40 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:29.275553 9718 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14748, Committed index: 14748, Last appended: 38.14748, Last appended by leader: 14748, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.275743 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 40 LEADER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 38. Current term is 40. Ops: []
I20251211 09:11:29.275934 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 38.14748, Next index: 14749, Last known committed idx: 14748, Time since last communication: 0.000s
I20251211 09:11:29.276012 9674 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer 2da53b301e274e63968e16c177efa678 log is divergent from this leader: its last log entry 40.14749 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14748
I20251211 09:11:29.276021 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 40 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 38. Current term is 40. Ops: []
I20251211 09:11:29.276088 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 38 to 40, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 40 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:29.276206 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 38.14748, Next index: 14749, Last known committed idx: 14748, Time since last communication: 0.000s
I20251211 09:11:29.297549 9675 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 38 LEADER]: Stepping down as leader of term 38
I20251211 09:11:29.297619 9675 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 38 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:29.297677 9675 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14748, Committed index: 14748, Last appended: 38.14748, Last appended by leader: 14748, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.297822 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 38 FOLLOWER]: Advancing to term 39
I20251211 09:11:29.300302 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 39 FOLLOWER]: Advancing to term 40
I20251211 09:11:29.300829 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 40 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 38 index: 14748. Preceding OpId from leader: term: 40 index: 14749. (index mismatch)
I20251211 09:11:29.301054 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14749, Last known committed idx: 14748, Time since last communication: 0.000s
I20251211 09:11:29.305039 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 40 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 38 index: 14748. Preceding OpId from leader: term: 40 index: 14749. (index mismatch)
I20251211 09:11:29.305217 9718 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14749, Last known committed idx: 14748, Time since last communication: 0.000s
I20251211 09:11:29.457864 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 40 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:29.457964 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 40 FOLLOWER]: Advancing to term 41
I20251211 09:11:29.458575 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.458726 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 41 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.458938 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 41 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.458941 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 41 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.459214 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 41 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.459308 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 41 FOLLOWER]: Leader election lost for term 41. Reason: could not achieve majority
I20251211 09:11:29.460477 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 41 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 40. Current term is 41. Ops: []
I20251211 09:11:29.460654 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 40.14749, Next index: 14750, Last known committed idx: 14749, Time since last communication: 0.000s
I20251211 09:11:29.463145 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 40 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:29.463196 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 40 FOLLOWER]: Advancing to term 41
I20251211 09:11:29.463694 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.463826 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 41 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.463855 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 41 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 40. Current term is 41. Ops: []
I20251211 09:11:29.463904 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 41 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.463984 9495 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 41 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 41: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:29.463994 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 41 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.464151 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 41 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:29.464159 9718 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 40.14749, Next index: 14750, Last known committed idx: 14749, Time since last communication: 0.000s
I20251211 09:11:29.464253 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 41 FOLLOWER]: Leader election lost for term 41. Reason: could not achieve majority
I20251211 09:11:29.486083 9572 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 41 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 40. Current term is 41. Ops: []
I20251211 09:11:29.486322 9718 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 40.14749, Next index: 14750, Last known committed idx: 14749, Time since last communication: 0.000s
I20251211 09:11:29.486666 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 41 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 40. Current term is 41. Ops: []
I20251211 09:11:29.486858 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 40.14749, Next index: 14750, Last known committed idx: 14749, Time since last communication: 0.000s
I20251211 09:11:29.489604 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 41 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.489648 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 41 FOLLOWER]: Advancing to term 42
I20251211 09:11:29.490201 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.490324 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 42 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.490474 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 42 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.490474 9572 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 42 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.490581 9572 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 41 FOLLOWER]: Advancing to term 42
I20251211 09:11:29.491117 9572 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 42 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 42.
I20251211 09:11:29.491333 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 42 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:29.491430 9675 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 42 FOLLOWER]: Leader election won for term 42
I20251211 09:11:29.491487 9675 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 42 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:29.491541 9675 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14749, Committed index: 14749, Last appended: 40.14749, Last appended by leader: 14749, Current term: 42, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.491923 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 40 to 42, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 42 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:29.496857 9703 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 40 LEADER]: Stepping down as leader of term 40
I20251211 09:11:29.496907 9703 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 40 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:29.496989 9703 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14749, Committed index: 14749, Last appended: 40.14749, Last appended by leader: 14749, Current term: 40, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.497081 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 40 FOLLOWER]: Advancing to term 41
I20251211 09:11:29.527190 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 41 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.527280 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 41 FOLLOWER]: Advancing to term 42
I20251211 09:11:29.527873 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.528052 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 42 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 40 index: 14749. Preceding OpId from leader: term: 42 index: 14750. (index mismatch)
I20251211 09:11:29.528066 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 42 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.528115 9572 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 42 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 40 index: 14749. Preceding OpId from leader: term: 42 index: 14750. (index mismatch)
I20251211 09:11:29.528237 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 42 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.528245 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 42 candidate_status { last_received { term: 40 index: 14749 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.528349 9571 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 42 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 in current term 42: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:29.528384 9719 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14750, Last known committed idx: 14749, Time since last communication: 0.000s
I20251211 09:11:29.528455 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14750, Last known committed idx: 14749, Time since last communication: 0.000s
I20251211 09:11:29.528596 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 42 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.528680 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 42 FOLLOWER]: Leader election lost for term 42. Reason: could not achieve majority
I20251211 09:11:29.560096 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 42 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:29.560178 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 42 FOLLOWER]: Advancing to term 43
I20251211 09:11:29.560793 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.560920 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 43 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.561091 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 43 candidate_status { last_received { term: 42 index: 14750 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.561092 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 43 candidate_status { last_received { term: 42 index: 14750 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.561393 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 43 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.561482 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 43 FOLLOWER]: Leader election lost for term 43. Reason: could not achieve majority
I20251211 09:11:29.561555 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 43 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 42. Current term is 43. Ops: []
I20251211 09:11:29.561751 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 42.14750, Next index: 14751, Last known committed idx: 14750, Time since last communication: 0.000s
I20251211 09:11:29.583689 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 42 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:29.583797 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 42 FOLLOWER]: Advancing to term 43
I20251211 09:11:29.584401 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.584523 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 43 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 42. Current term is 43. Ops: []
I20251211 09:11:29.584565 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 43 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.584704 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 43 candidate_status { last_received { term: 42 index: 14750 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.584725 9719 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 42.14750, Next index: 14751, Last known committed idx: 14750, Time since last communication: 0.000s
I20251211 09:11:29.584730 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 43 candidate_status { last_received { term: 42 index: 14750 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.584865 9418 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 43 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 43: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:29.585000 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 43 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:29.585098 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 43 FOLLOWER]: Leader election lost for term 43. Reason: could not achieve majority
I20251211 09:11:29.593739 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 43 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 42. Current term is 43. Ops: []
I20251211 09:11:29.593963 9719 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 42.14750, Next index: 14751, Last known committed idx: 14750, Time since last communication: 0.000s
I20251211 09:11:29.598706 9675 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 42 LEADER]: Stepping down as leader of term 42
I20251211 09:11:29.598752 9675 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 42 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:29.598819 9675 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14750, Committed index: 14750, Last appended: 42.14750, Last appended by leader: 14750, Current term: 42, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.598912 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 42 FOLLOWER]: Advancing to term 43
I20251211 09:11:29.601806 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 43 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.601861 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 43 FOLLOWER]: Advancing to term 44
I20251211 09:11:29.602411 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.602541 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 44 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.602717 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 44 candidate_status { last_received { term: 42 index: 14750 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.602777 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 43 FOLLOWER]: Advancing to term 44
I20251211 09:11:29.602726 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 44 candidate_status { last_received { term: 42 index: 14750 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.602815 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 43 FOLLOWER]: Advancing to term 44
I20251211 09:11:29.603278 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 44.
I20251211 09:11:29.603430 9571 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 44.
I20251211 09:11:29.603453 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 44 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters:
I20251211 09:11:29.603551 9703 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 44 FOLLOWER]: Leader election won for term 44
I20251211 09:11:29.603607 9703 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 44 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:29.603662 9703 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14750, Committed index: 14750, Last appended: 42.14750, Last appended by leader: 14750, Current term: 44, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.604074 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 42 to 44, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 44 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:29.626358 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 44 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 42 index: 14750. Preceding OpId from leader: term: 44 index: 14751. (index mismatch)
I20251211 09:11:29.626639 9703 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14751, Last known committed idx: 14750, Time since last communication: 0.000s
I20251211 09:11:29.633478 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 44 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 42 index: 14750. Preceding OpId from leader: term: 44 index: 14751. (index mismatch)
I20251211 09:11:29.633723 9703 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14751, Last known committed idx: 14750, Time since last communication: 0.000s
I20251211 09:11:29.658267 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 44 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:29.658352 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 44 FOLLOWER]: Advancing to term 45
I20251211 09:11:29.658933 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.659081 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 45 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.659289 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 45 candidate_status { last_received { term: 44 index: 14751 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.659289 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 45 candidate_status { last_received { term: 44 index: 14751 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.659502 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 45 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:29.659580 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 45 FOLLOWER]: Leader election lost for term 45. Reason: could not achieve majority
I20251211 09:11:29.663621 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 45 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 44. Current term is 45. Ops: []
I20251211 09:11:29.663827 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 44.14751, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.664573 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 44 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:29.664610 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 44 FOLLOWER]: Advancing to term 45
I20251211 09:11:29.665190 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.665340 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 45 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.665462 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 45 candidate_status { last_received { term: 44 index: 14751 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.665479 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 45 candidate_status { last_received { term: 44 index: 14751 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.665525 9571 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 45 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 45: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:29.665719 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 45 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.665834 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 45 FOLLOWER]: Leader election lost for term 45. Reason: could not achieve majority
I20251211 09:11:29.667588 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 45 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 44. Current term is 45. Ops: []
I20251211 09:11:29.667754 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 44.14751, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.688776 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 45 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 44. Current term is 45. Ops: []
I20251211 09:11:29.689062 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 44.14751, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.699994 9495 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 45 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 44. Current term is 45. Ops: []
I20251211 09:11:29.700237 9718 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 44.14751, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.702888 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 45 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.702929 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 45 FOLLOWER]: Advancing to term 46
I20251211 09:11:29.703466 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.703574 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 46 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.703751 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 46 candidate_status { last_received { term: 44 index: 14751 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.703751 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 46 candidate_status { last_received { term: 44 index: 14751 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.703861 9495 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 45 FOLLOWER]: Advancing to term 46
I20251211 09:11:29.704335 9495 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 46 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 46.
I20251211 09:11:29.704514 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 46 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:29.704625 9711 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 46 FOLLOWER]: Leader election won for term 46
I20251211 09:11:29.704684 9711 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 46 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:29.704741 9711 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14751, Committed index: 14751, Last appended: 44.14751, Last appended by leader: 14751, Current term: 46, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.705200 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 44 to 46, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 46 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:29.723150 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 46 LEADER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 44. Current term is 46. Ops: []
I20251211 09:11:29.723389 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 44.14751, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.723497 9669 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer b546844397f6426994e641f568e0c32e log is divergent from this leader: its last log entry 46.14752 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14751
I20251211 09:11:29.734540 9495 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 46 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 44 index: 14751. Preceding OpId from leader: term: 46 index: 14752. (index mismatch)
I20251211 09:11:29.734772 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.735402 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 46 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 44. Current term is 46. Ops: []
I20251211 09:11:29.735590 9669 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 44.14751, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.739470 9418 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 44 LEADER]: Stepping down as leader of term 44
I20251211 09:11:29.739526 9418 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 44 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:29.739566 9418 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14751, Committed index: 14751, Last appended: 44.14751, Last appended by leader: 14751, Current term: 44, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.739657 9418 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 44 FOLLOWER]: Advancing to term 46
I20251211 09:11:29.740254 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 46 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 44 index: 14751. Preceding OpId from leader: term: 46 index: 14752. (index mismatch)
I20251211 09:11:29.740448 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14752, Last known committed idx: 14751, Time since last communication: 0.000s
I20251211 09:11:29.766538 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 46 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.766638 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 46 FOLLOWER]: Advancing to term 47
I20251211 09:11:29.767766 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.767927 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 47 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.768114 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 47 candidate_status { last_received { term: 46 index: 14752 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.768225 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 47 candidate_status { last_received { term: 46 index: 14752 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.768424 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 47 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.768508 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 47 FOLLOWER]: Leader election lost for term 47. Reason: could not achieve majority
I20251211 09:11:29.771343 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 47 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 46. Current term is 47. Ops: []
I20251211 09:11:29.771550 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 46.14752, Next index: 14753, Last known committed idx: 14752, Time since last communication: 0.000s
I20251211 09:11:29.798772 9718 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 46 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.798863 9718 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 46 FOLLOWER]: Advancing to term 47
I20251211 09:11:29.799521 9718 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.799661 9718 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 47 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.799881 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 47 candidate_status { last_received { term: 46 index: 14752 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.799885 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 47 candidate_status { last_received { term: 46 index: 14752 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.799993 9494 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 47 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 in current term 47: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:29.800132 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 47 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.800230 9718 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 47 FOLLOWER]: Leader election lost for term 47. Reason: could not achieve majority
I20251211 09:11:29.801656 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 47 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 46. Current term is 47. Ops: []
I20251211 09:11:29.801857 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 46.14752, Next index: 14753, Last known committed idx: 14752, Time since last communication: 0.000s
I20251211 09:11:29.803730 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 47 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 46. Current term is 47. Ops: []
I20251211 09:11:29.803908 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 46.14752, Next index: 14753, Last known committed idx: 14752, Time since last communication: 0.000s
I20251211 09:11:29.807914 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 47 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.807973 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 47 FOLLOWER]: Advancing to term 48
I20251211 09:11:29.808580 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.808712 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 48 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.808849 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 48 candidate_status { last_received { term: 46 index: 14752 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.808849 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 48 candidate_status { last_received { term: 46 index: 14752 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.808945 9418 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 47 FOLLOWER]: Advancing to term 48
I20251211 09:11:29.809464 9418 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 48 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 48.
I20251211 09:11:29.809608 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 48 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters: b546844397f6426994e641f568e0c32e
I20251211 09:11:29.809701 9675 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 48 FOLLOWER]: Leader election won for term 48
I20251211 09:11:29.809749 9675 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 48 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:29.809803 9675 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14752, Committed index: 14752, Last appended: 46.14752, Last appended by leader: 14752, Current term: 48, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.810174 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 46 to 48, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 48 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:29.815090 9711 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 46 LEADER]: Stepping down as leader of term 46
I20251211 09:11:29.815141 9711 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 46 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:29.815200 9711 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14752, Committed index: 14752, Last appended: 46.14752, Last appended by leader: 14752, Current term: 46, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.815279 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 46 FOLLOWER]: Advancing to term 47
I20251211 09:11:29.837877 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 47 FOLLOWER]: Advancing to term 48
I20251211 09:11:29.838600 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 48 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 46 index: 14752. Preceding OpId from leader: term: 48 index: 14753. (index mismatch)
I20251211 09:11:29.838842 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14753, Last known committed idx: 14752, Time since last communication: 0.000s
I20251211 09:11:29.839843 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 48 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 46 index: 14752. Preceding OpId from leader: term: 48 index: 14753. (index mismatch)
I20251211 09:11:29.840031 9719 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14753, Last known committed idx: 14752, Time since last communication: 0.000s
I20251211 09:11:29.870883 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 48 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:29.870981 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 48 FOLLOWER]: Advancing to term 49
I20251211 09:11:29.871666 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.871812 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 49 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 48. Current term is 49. Ops: []
I20251211 09:11:29.871815 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 49 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.871954 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 49 candidate_status { last_received { term: 48 index: 14753 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.871929 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 49 candidate_status { last_received { term: 48 index: 14753 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.872035 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 48.14753, Next index: 14754, Last known committed idx: 14753, Time since last communication: 0.000s
I20251211 09:11:29.872279 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 49 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:29.872370 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 49 FOLLOWER]: Leader election lost for term 49. Reason: could not achieve majority
I20251211 09:11:29.902200 9675 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 48 LEADER]: Stepping down as leader of term 48
I20251211 09:11:29.902283 9675 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 48 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:29.902341 9675 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14753, Committed index: 14753, Last appended: 48.14753, Last appended by leader: 14753, Current term: 48, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.902467 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 48 FOLLOWER]: Advancing to term 49
I20251211 09:11:29.915854 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 49 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:29.915946 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 49 FOLLOWER]: Advancing to term 50
I20251211 09:11:29.916553 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.916699 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 50 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:29.916916 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 50 candidate_status { last_received { term: 48 index: 14753 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.916957 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 50 candidate_status { last_received { term: 48 index: 14753 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.917066 9494 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 49 FOLLOWER]: Advancing to term 50
I20251211 09:11:29.917716 9494 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 50 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 50.
I20251211 09:11:29.917903 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 50 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:29.917999 9711 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 50 FOLLOWER]: Leader election won for term 50
I20251211 09:11:29.918056 9711 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 50 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:29.918120 9711 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14753, Committed index: 14753, Last appended: 48.14753, Last appended by leader: 14753, Current term: 50, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.918540 9313 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 48 to 50, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 50 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:29.922580 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 48 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:29.922636 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 48 FOLLOWER]: Advancing to term 49
I20251211 09:11:29.923142 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.923240 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 49 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.923441 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 49 candidate_status { last_received { term: 48 index: 14753 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.923444 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 49 candidate_status { last_received { term: 48 index: 14753 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.923550 9494 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for earlier term 49. Current term is 50.
I20251211 09:11:29.923689 9384 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 49 election: Vote denied by peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for earlier term 49. Current term is 50.
I20251211 09:11:29.923734 9384 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 49 election: Cancelling election due to peer responding with higher term
I20251211 09:11:29.923807 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 49 FOLLOWER]: Advancing to term 50
I20251211 09:11:29.924280 9703 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 50 FOLLOWER]: Leader election lost for term 49. Reason: Vote denied by peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for earlier term 49. Current term is 50.
I20251211 09:11:29.942956 9494 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 50 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 48 index: 14753. Preceding OpId from leader: term: 50 index: 14754. (index mismatch)
I20251211 09:11:29.943265 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14754, Last known committed idx: 14753, Time since last communication: 0.000s
I20251211 09:11:29.946928 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 50 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 48 index: 14753. Preceding OpId from leader: term: 50 index: 14754. (index mismatch)
I20251211 09:11:29.947158 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14754, Last known committed idx: 14753, Time since last communication: 0.000s
I20251211 09:11:29.975294 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 50 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.975384 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 50 FOLLOWER]: Advancing to term 51
I20251211 09:11:29.976017 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.976161 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 51 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.976397 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 51 candidate_status { last_received { term: 50 index: 14754 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.976397 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 51 candidate_status { last_received { term: 50 index: 14754 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:29.976678 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 51 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.976810 9675 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 51 FOLLOWER]: Leader election lost for term 51. Reason: could not achieve majority
I20251211 09:11:29.977492 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 51 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 50. Current term is 51. Ops: []
I20251211 09:11:29.977722 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 50.14754, Next index: 14755, Last known committed idx: 14754, Time since last communication: 0.000s
I20251211 09:11:29.978202 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 50 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:29.978243 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 50 FOLLOWER]: Advancing to term 51
I20251211 09:11:29.978925 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:29.979067 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 51 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:29.979239 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 51 candidate_status { last_received { term: 50 index: 14754 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:29.979383 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 51 candidate_status { last_received { term: 50 index: 14754 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:29.979478 9494 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 51 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 in current term 51: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:29.979602 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 51 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:29.979673 9703 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 51 FOLLOWER]: Leader election lost for term 51. Reason: could not achieve majority
I20251211 09:11:29.983582 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 51 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 50. Current term is 51. Ops: []
I20251211 09:11:29.983803 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 50.14754, Next index: 14755, Last known committed idx: 14754, Time since last communication: 0.000s
I20251211 09:11:30.000897 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 51 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 50. Current term is 51. Ops: []
I20251211 09:11:30.001168 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 50.14754, Next index: 14755, Last known committed idx: 14754, Time since last communication: 0.000s
I20251211 09:11:30.013329 9675 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 51 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.013412 9675 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 51 FOLLOWER]: Advancing to term 52
I20251211 09:11:30.014048 9675 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.014196 9675 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 52 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.014421 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 52 candidate_status { last_received { term: 50 index: 14754 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.014421 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 52 candidate_status { last_received { term: 50 index: 14754 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.014529 9418 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 51 FOLLOWER]: Advancing to term 52
I20251211 09:11:30.015156 9418 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 52 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 52.
I20251211 09:11:30.015333 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 52 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters: b546844397f6426994e641f568e0c32e
I20251211 09:11:30.015416 9675 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 52 FOLLOWER]: Leader election won for term 52
I20251211 09:11:30.015470 9675 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 52 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:30.015523 9675 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14754, Committed index: 14754, Last appended: 50.14754, Last appended by leader: 14754, Current term: 52, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.015950 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 50 to 52, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 52 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:30.017024 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 52 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 50. Current term is 52. Ops: []
I20251211 09:11:30.017221 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 50.14754, Next index: 14755, Last known committed idx: 14754, Time since last communication: 0.000s
I20251211 09:11:30.031427 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 52 LEADER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 50. Current term is 52. Ops: []
I20251211 09:11:30.031692 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 50.14754, Next index: 14755, Last known committed idx: 14754, Time since last communication: 0.000s
I20251211 09:11:30.031780 9711 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer 4268dfc39c6846ff9862641870b507d0 log is divergent from this leader: its last log entry 52.14755 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14754
I20251211 09:11:30.043277 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 52 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 50 index: 14754. Preceding OpId from leader: term: 52 index: 14755. (index mismatch)
I20251211 09:11:30.043577 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14755, Last known committed idx: 14754, Time since last communication: 0.000s
I20251211 09:11:30.045490 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 52 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 50. Current term is 52. Ops: []
I20251211 09:11:30.045673 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 50.14754, Next index: 14755, Last known committed idx: 14755, Time since last communication: 0.000s
I20251211 09:11:30.047263 9571 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 50 LEADER]: Stepping down as leader of term 50
I20251211 09:11:30.047299 9571 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 50 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:30.047343 9571 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14754, Committed index: 14754, Last appended: 50.14754, Last appended by leader: 14754, Current term: 50, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.047428 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 50 FOLLOWER]: Advancing to term 52
I20251211 09:11:30.047987 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 52 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 50 index: 14754. Preceding OpId from leader: term: 52 index: 14755. (index mismatch)
I20251211 09:11:30.048209 9675 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14755, Last known committed idx: 14754, Time since last communication: 0.000s
I20251211 09:11:30.108223 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 52 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:30.108314 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 52 FOLLOWER]: Advancing to term 53
I20251211 09:11:30.108934 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.109084 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 53 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 52. Current term is 53. Ops: []
I20251211 09:11:30.109120 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 53 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.109269 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 53 candidate_status { last_received { term: 52 index: 14755 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.109333 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 53 candidate_status { last_received { term: 52 index: 14755 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.109376 9719 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 52.14755, Next index: 14756, Last known committed idx: 14755, Time since last communication: 0.000s
I20251211 09:11:30.109488 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 53 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.109642 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 53 FOLLOWER]: Leader election lost for term 53. Reason: could not achieve majority
I20251211 09:11:30.134647 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 53 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 52. Current term is 53. Ops: []
I20251211 09:11:30.134907 9719 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 52.14755, Next index: 14756, Last known committed idx: 14755, Time since last communication: 0.000s
I20251211 09:11:30.142020 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 53 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.142112 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 53 FOLLOWER]: Advancing to term 54
I20251211 09:11:30.142700 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.142788 9733 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 52 LEADER]: Stepping down as leader of term 52
I20251211 09:11:30.142864 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 54 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.142824 9733 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 52 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:30.142973 9733 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14755, Committed index: 14755, Last appended: 52.14755, Last appended by leader: 14755, Current term: 52, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.142997 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 54 candidate_status { last_received { term: 52 index: 14755 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.143070 9733 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 52 FOLLOWER]: Advancing to term 53
I20251211 09:11:30.143021 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 54 candidate_status { last_received { term: 52 index: 14755 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.143625 9494 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 53 FOLLOWER]: Advancing to term 54
I20251211 09:11:30.144068 9494 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 54 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 54.
I20251211 09:11:30.144256 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 54 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:30.144352 9711 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 54 FOLLOWER]: Leader election won for term 54
I20251211 09:11:30.144407 9711 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 54 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:30.144443 9711 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14755, Committed index: 14755, Last appended: 52.14755, Last appended by leader: 14755, Current term: 54, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.144902 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 52 to 54, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 54 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
W20251211 09:11:30.148408 9633 lock_manager.cc:494] Txn 2 has not acquired the partition lock after 1000ms
I20251211 09:11:30.156035 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 52 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:30.156098 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 52 FOLLOWER]: Advancing to term 53
I20251211 09:11:30.156651 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.156776 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 53 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.157040 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 53 candidate_status { last_received { term: 52 index: 14755 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.157047 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 53 candidate_status { last_received { term: 52 index: 14755 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.157181 9494 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 54 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for earlier term 53. Current term is 54.
I20251211 09:11:30.157346 9384 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 53 election: Vote denied by peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 54 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for earlier term 53. Current term is 54.
I20251211 09:11:30.157397 9384 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 53 election: Cancelling election due to peer responding with higher term
I20251211 09:11:30.157462 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 53 FOLLOWER]: Advancing to term 54
I20251211 09:11:30.157946 9703 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 54 FOLLOWER]: Leader election lost for term 53. Reason: Vote denied by peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 54 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 for earlier term 53. Current term is 54.
W20251211 09:11:30.161002 9667 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 51 current term: 54 is higher.
I20251211 09:11:30.169399 9494 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 54 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 52 index: 14755. Preceding OpId from leader: term: 54 index: 14756. (index mismatch)
I20251211 09:11:30.169677 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14756, Last known committed idx: 14755, Time since last communication: 0.000s
I20251211 09:11:30.180876 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 54 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 52 index: 14755. Preceding OpId from leader: term: 54 index: 14756. (index mismatch)
I20251211 09:11:30.181133 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14756, Last known committed idx: 14755, Time since last communication: 0.000s
W20251211 09:11:30.212466 9711 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 52 current term: 54 is higher.
W20251211 09:11:30.217685 9711 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 52 current term: 54 is higher.
I20251211 09:11:30.227880 9733 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 54 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:30.227983 9733 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 54 FOLLOWER]: Advancing to term 55
I20251211 09:11:30.228650 9733 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.228822 9733 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 55 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.229043 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 55 candidate_status { last_received { term: 54 index: 14756 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.229050 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 55 candidate_status { last_received { term: 54 index: 14756 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.229313 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.229410 9733 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20251211 09:11:30.230829 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 55 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 54. Current term is 55. Ops: []
I20251211 09:11:30.231035 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 54.14756, Next index: 14757, Last known committed idx: 14756, Time since last communication: 0.000s
I20251211 09:11:30.241868 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 54 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:30.241961 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 54 FOLLOWER]: Advancing to term 55
I20251211 09:11:30.242612 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.242760 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 55 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.242992 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 55 candidate_status { last_received { term: 54 index: 14756 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.243023 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 55 candidate_status { last_received { term: 54 index: 14756 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.243105 9494 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 55 FOLLOWER]: Leader election vote request: Denying vote to candidate 2da53b301e274e63968e16c177efa678 in current term 55: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:30.243244 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.243350 9703 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20251211 09:11:30.245564 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 55 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 54. Current term is 55. Ops: []
I20251211 09:11:30.245781 9667 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 54.14756, Next index: 14757, Last known committed idx: 14756, Time since last communication: 0.000s
I20251211 09:11:30.252990 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 55 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 54. Current term is 55. Ops: []
I20251211 09:11:30.253197 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 54.14756, Next index: 14757, Last known committed idx: 14756, Time since last communication: 0.000s
W20251211 09:11:30.260980 9711 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 52 current term: 54 is higher.
I20251211 09:11:30.266862 9733 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 55 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.266937 9733 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 55 FOLLOWER]: Advancing to term 56
I20251211 09:11:30.267524 9733 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.267650 9733 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 56 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.267853 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 56 candidate_status { last_received { term: 54 index: 14756 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.267917 9418 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 55 FOLLOWER]: Advancing to term 56
I20251211 09:11:30.267863 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 56 candidate_status { last_received { term: 54 index: 14756 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.268508 9418 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 56.
I20251211 09:11:30.268661 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 56 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters: b546844397f6426994e641f568e0c32e
I20251211 09:11:30.268747 9733 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 56 FOLLOWER]: Leader election won for term 56
I20251211 09:11:30.268824 9733 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 56 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:30.268885 9733 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14756, Committed index: 14756, Last appended: 54.14756, Last appended by leader: 14756, Current term: 56, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.269345 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 54 to 56, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 56 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:30.280695 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 56 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 54. Current term is 56. Ops: []
I20251211 09:11:30.281049 9640 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 54.14756, Next index: 14757, Last known committed idx: 14756, Time since last communication: 0.000s
I20251211 09:11:30.287348 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 56 LEADER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 54. Current term is 56. Ops: []
I20251211 09:11:30.287556 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 54.14756, Next index: 14757, Last known committed idx: 14756, Time since last communication: 0.000s
I20251211 09:11:30.287638 9711 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer 4268dfc39c6846ff9862641870b507d0 log is divergent from this leader: its last log entry 56.14757 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14756
I20251211 09:11:30.295854 9571 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 54 LEADER]: Stepping down as leader of term 54
I20251211 09:11:30.295903 9571 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 54 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:30.295970 9571 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14756, Committed index: 14756, Last appended: 54.14756, Last appended by leader: 14756, Current term: 54, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.296072 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 54 FOLLOWER]: Advancing to term 56
I20251211 09:11:30.296655 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 56 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 54 index: 14756. Preceding OpId from leader: term: 56 index: 14757. (index mismatch)
I20251211 09:11:30.296911 9418 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 56 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 54 index: 14756. Preceding OpId from leader: term: 56 index: 14757. (index mismatch)
I20251211 09:11:30.296901 9733 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14757, Last known committed idx: 14756, Time since last communication: 0.000s
I20251211 09:11:30.297116 9733 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14757, Last known committed idx: 14756, Time since last communication: 0.000s
I20251211 09:11:30.351147 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 56 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:30.351267 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 56 FOLLOWER]: Advancing to term 57
I20251211 09:11:30.351919 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.352069 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 57 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.352283 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 57 candidate_status { last_received { term: 56 index: 14757 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.352299 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 57 candidate_status { last_received { term: 56 index: 14757 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.352407 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 56 FOLLOWER]: Advancing to term 57
I20251211 09:11:30.353010 9571 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 57 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 57.
I20251211 09:11:30.353217 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 57 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters: 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.353327 9703 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 57 FOLLOWER]: Leader election won for term 57
I20251211 09:11:30.353420 9703 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 57 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:30.353458 9703 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14757, Committed index: 14757, Last appended: 56.14757, Last appended by leader: 14757, Current term: 57, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.353875 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 56 to 57, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 57 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:30.356573 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 57 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 56. Current term is 57. Ops: []
I20251211 09:11:30.356573 9418 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 57 LEADER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 56. Current term is 57. Ops: []
I20251211 09:11:30.356804 9733 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 56.14757, Next index: 14758, Last known committed idx: 14757, Time since last communication: 0.000s
I20251211 09:11:30.356885 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 56.14757, Next index: 14758, Last known committed idx: 14757, Time since last communication: 0.000s
I20251211 09:11:30.356971 9674 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer 2da53b301e274e63968e16c177efa678 log is divergent from this leader: its last log entry 57.14758 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14757
I20251211 09:11:30.382422 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 57 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 56. Current term is 57. Ops: []
I20251211 09:11:30.382422 9494 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 56 LEADER]: Stepping down as leader of term 56
I20251211 09:11:30.382537 9494 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 56 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:30.382586 9494 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14757, Committed index: 14757, Last appended: 56.14757, Last appended by leader: 14757, Current term: 56, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.382670 9494 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 56 FOLLOWER]: Advancing to term 57
I20251211 09:11:30.383024 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 57 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 56 index: 14757. Preceding OpId from leader: term: 57 index: 14758. (index mismatch)
I20251211 09:11:30.383239 9703 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14758, Last known committed idx: 14757, Time since last communication: 0.000s
I20251211 09:11:30.383385 9494 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 57 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 56 index: 14757. Preceding OpId from leader: term: 57 index: 14758. (index mismatch)
I20251211 09:11:30.383599 9703 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14758, Last known committed idx: 14757, Time since last communication: 0.000s
I20251211 09:11:30.414784 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 57 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:30.414918 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 57 FOLLOWER]: Advancing to term 58
I20251211 09:11:30.414929 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 57 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:30.415009 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 57 FOLLOWER]: Advancing to term 58
I20251211 09:11:30.415542 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.415544 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.415695 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 58 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.415724 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 58 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.415931 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 58 candidate_status { last_received { term: 57 index: 14758 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.415971 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 58 candidate_status { last_received { term: 57 index: 14758 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.415970 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 58 candidate_status { last_received { term: 57 index: 14758 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.416091 9571 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 58 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 58: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:30.416126 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 58 candidate_status { last_received { term: 57 index: 14758 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.416185 9494 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 58 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 58: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:30.416283 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 58 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.416292 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 58 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.416373 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 58 FOLLOWER]: Leader election lost for term 58. Reason: could not achieve majority
I20251211 09:11:30.416442 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 58 FOLLOWER]: Leader election lost for term 58. Reason: could not achieve majority
I20251211 09:11:30.418217 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 58 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 57. Current term is 58. Ops: []
I20251211 09:11:30.418409 9741 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 57.14758, Next index: 14759, Last known committed idx: 14758, Time since last communication: 0.000s
I20251211 09:11:30.419404 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 58 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 57. Current term is 58. Ops: []
I20251211 09:11:30.419574 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 57.14758, Next index: 14759, Last known committed idx: 14758, Time since last communication: 0.000s
I20251211 09:11:30.445650 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 58 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 57. Current term is 58. Ops: []
I20251211 09:11:30.445904 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 57.14758, Next index: 14759, Last known committed idx: 14758, Time since last communication: 0.000s
I20251211 09:11:30.446755 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 58 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.446812 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 58 FOLLOWER]: Advancing to term 59
I20251211 09:11:30.447363 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.447489 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 59 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.447659 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 59 candidate_status { last_received { term: 57 index: 14758 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.447662 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 59 candidate_status { last_received { term: 57 index: 14758 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.447733 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 58 FOLLOWER]: Advancing to term 59
I20251211 09:11:30.448278 9571 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 59 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4268dfc39c6846ff9862641870b507d0 in term 59.
I20251211 09:11:30.448443 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 59 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:30.448530 9674 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 59 FOLLOWER]: Leader election won for term 59
I20251211 09:11:30.448580 9674 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 59 LEADER]: Becoming Leader. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:30.448616 9674 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14758, Committed index: 14758, Last appended: 57.14758, Last appended by leader: 14758, Current term: 59, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.449013 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 reported cstate change: term changed from 57 to 59, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to 4268dfc39c6846ff9862641870b507d0 (127.0.119.194). New cstate: current_term: 59 leader_uuid: "4268dfc39c6846ff9862641870b507d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:30.454348 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 59 LEADER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 57. Current term is 59. Ops: []
I20251211 09:11:30.454560 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 57.14758, Next index: 14759, Last known committed idx: 14758, Time since last communication: 0.000s
I20251211 09:11:30.454639 9740 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer 4268dfc39c6846ff9862641870b507d0 log is divergent from this leader: its last log entry 59.14759 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14758
I20251211 09:11:30.463625 9741 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 57 LEADER]: Stepping down as leader of term 57
I20251211 09:11:30.463701 9741 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 57 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:30.463759 9741 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14758, Committed index: 14758, Last appended: 57.14758, Last appended by leader: 14758, Current term: 57, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.463857 9741 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 57 FOLLOWER]: Advancing to term 58
W20251211 09:11:30.472353 9719 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 57 current term: 59 is higher.
I20251211 09:11:30.474524 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 59 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 57 index: 14758. Preceding OpId from leader: term: 59 index: 14759. (index mismatch)
I20251211 09:11:30.474818 9674 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14759, Last known committed idx: 14758, Time since last communication: 0.000s
I20251211 09:11:30.478255 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 58 FOLLOWER]: Advancing to term 59
I20251211 09:11:30.478873 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 59 FOLLOWER]: Refusing update from remote peer 4268dfc39c6846ff9862641870b507d0: Log matching property violated. Preceding OpId in replica: term: 57 index: 14758. Preceding OpId from leader: term: 59 index: 14759. (index mismatch)
I20251211 09:11:30.479070 9674 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14759, Last known committed idx: 14758, Time since last communication: 0.000s
I20251211 09:11:30.533699 9740 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 59 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:30.533795 9740 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 59 FOLLOWER]: Advancing to term 60
I20251211 09:11:30.534493 9740 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.534629 9740 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 60 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.534834 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 60 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.534861 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 60 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.535122 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.535219 9740 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20251211 09:11:30.537838 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 60 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 59. Current term is 60. Ops: []
I20251211 09:11:30.538081 9733 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 59.14759, Next index: 14760, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.561592 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 59 FOLLOWER]: Starting leader election (detected failure of leader 4268dfc39c6846ff9862641870b507d0)
I20251211 09:11:30.561684 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 59 FOLLOWER]: Advancing to term 60
I20251211 09:11:30.562340 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.562487 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 60 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.562693 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 60 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.562693 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 60 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.562844 9419 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 60: Already voted for candidate 2da53b301e274e63968e16c177efa678 in this term.
I20251211 09:11:30.563012 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.563170 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20251211 09:11:30.564198 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 60 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 59. Current term is 60. Ops: []
I20251211 09:11:30.564380 9674 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 59.14759, Next index: 14760, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.567893 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 60 FOLLOWER]: Rejecting Update request from peer 4268dfc39c6846ff9862641870b507d0 for earlier term 59. Current term is 60. Ops: []
I20251211 09:11:30.568135 9733 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 59.14759, Next index: 14760, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.574292 9719 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 59 LEADER]: Stepping down as leader of term 59
I20251211 09:11:30.574347 9719 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 59 LEADER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Running, Role: LEADER
I20251211 09:11:30.574414 9719 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14759, Committed index: 14759, Last appended: 59.14759, Last appended by leader: 14759, Current term: 59, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.574522 9740 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 60 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.574512 9719 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 59 FOLLOWER]: Advancing to term 60
I20251211 09:11:30.574592 9740 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 60 FOLLOWER]: Advancing to term 61
I20251211 09:11:30.575219 9740 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.575320 9740 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 61 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.575474 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 61 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.575515 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 61 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.575537 9494 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 60 FOLLOWER]: Advancing to term 61
I20251211 09:11:30.575573 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 60 FOLLOWER]: Advancing to term 61
I20251211 09:11:30.576013 9494 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 61.
I20251211 09:11:30.576032 9571 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 61.
I20251211 09:11:30.576201 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 61 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0; no voters:
I20251211 09:11:30.576282 9740 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 61 FOLLOWER]: Leader election won for term 61
I20251211 09:11:30.576335 9740 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 61 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:30.576385 9740 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14759, Committed index: 14759, Last appended: 59.14759, Last appended by leader: 14759, Current term: 61, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.576788 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 59 to 61, leader changed from 4268dfc39c6846ff9862641870b507d0 (127.0.119.194) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 61 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:30.604372 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 61 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 59 index: 14759. Preceding OpId from leader: term: 61 index: 14760. (index mismatch)
I20251211 09:11:30.604650 9740 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14760, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.610818 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 61 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.610893 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 61 FOLLOWER]: Advancing to term 62
I20251211 09:11:30.611482 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.611614 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 62 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.611780 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 62 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.611861 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 62 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.611948 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 62 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 61. Current term is 62. Ops: []
I20251211 09:11:30.612128 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 62 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.612212 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14760, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.612236 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 62 FOLLOWER]: Leader election lost for term 62. Reason: could not achieve majority
I20251211 09:11:30.629024 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 62 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 61. Current term is 62. Ops: [61.14760-61.14760]
I20251211 09:11:30.629329 9741 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 59.14759, Next index: 14760, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.636070 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 61 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:30.636149 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 61 FOLLOWER]: Advancing to term 62
I20251211 09:11:30.636790 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.636955 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 62 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.637113 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 62 candidate_status { last_received { term: 61 index: 14760 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.637190 9494 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 62 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 62: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:30.637120 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 62 candidate_status { last_received { term: 61 index: 14760 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.637423 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 62 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.637516 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 62 FOLLOWER]: Leader election lost for term 62. Reason: could not achieve majority
I20251211 09:11:30.641745 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 62 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 61. Current term is 62. Ops: []
I20251211 09:11:30.641959 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 61.14760, Next index: 14761, Last known committed idx: 14760, Time since last communication: 0.000s
I20251211 09:11:30.644851 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 62 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.644909 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 62 FOLLOWER]: Advancing to term 63
I20251211 09:11:30.645529 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.645650 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 63 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.645778 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 63 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.645808 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 63 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.645870 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 62 FOLLOWER]: Advancing to term 63
I20251211 09:11:30.646409 9571 raft_consensus.cc:2410] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 63 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for term 63 because replica has last-logged OpId of term: 61 index: 14760, which is greater than that of the candidate, which has last-logged OpId of term: 59 index: 14759.
I20251211 09:11:30.646577 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 63 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.646678 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 63 FOLLOWER]: Leader election lost for term 63. Reason: could not achieve majority
I20251211 09:11:30.664726 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 63 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 61. Current term is 63. Ops: [61.14760-61.14760]
I20251211 09:11:30.665064 9741 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 59.14759, Next index: 14760, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.672138 9703 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 61 LEADER]: Stepping down as leader of term 61
I20251211 09:11:30.672148 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 63 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 61. Current term is 63. Ops: []
I20251211 09:11:30.672221 9703 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 61 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:30.672338 9703 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14760, Committed index: 14760, Last appended: 61.14760, Last appended by leader: 14760, Current term: 61, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.672452 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 61 FOLLOWER]: Advancing to term 62
I20251211 09:11:30.681998 9719 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 63 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.682092 9719 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 63 FOLLOWER]: Advancing to term 64
I20251211 09:11:30.682530 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 63 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.682601 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 63 FOLLOWER]: Advancing to term 64
I20251211 09:11:30.682900 9719 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.683063 9719 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 64 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.683259 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 64 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.683243 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 64 candidate_status { last_received { term: 59 index: 14759 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.683313 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.683384 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 62 FOLLOWER]: Advancing to term 64
I20251211 09:11:30.683413 9571 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 64 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 64: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:30.683450 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 64 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.683588 9418 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 64 candidate_status { last_received { term: 61 index: 14760 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.683657 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 64 candidate_status { last_received { term: 61 index: 14760 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.683724 9494 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 64 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 64: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:30.683840 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 64 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.683938 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 64 FOLLOWER]: Leader election lost for term 64. Reason: could not achieve majority
I20251211 09:11:30.684041 9419 raft_consensus.cc:2410] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 64 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for term 64 because replica has last-logged OpId of term: 61 index: 14760, which is greater than that of the candidate, which has last-logged OpId of term: 59 index: 14759.
I20251211 09:11:30.684209 9459 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 64 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.684303 9719 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 64 FOLLOWER]: Leader election lost for term 64. Reason: could not achieve majority
I20251211 09:11:30.707588 9740 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 64 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.707676 9740 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 64 FOLLOWER]: Advancing to term 65
I20251211 09:11:30.708299 9740 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.708429 9740 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 65 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.708676 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 65 candidate_status { last_received { term: 61 index: 14760 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.708690 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 65 candidate_status { last_received { term: 61 index: 14760 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.708773 9494 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 64 FOLLOWER]: Advancing to term 65
I20251211 09:11:30.708778 9571 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 64 FOLLOWER]: Advancing to term 65
I20251211 09:11:30.709431 9494 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 65 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 65.
I20251211 09:11:30.709431 9571 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 65 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 65.
I20251211 09:11:30.709663 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 65 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters:
I20251211 09:11:30.709755 9740 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 65 FOLLOWER]: Leader election won for term 65
I20251211 09:11:30.709805 9740 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 65 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:30.709867 9740 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14760, Committed index: 14760, Last appended: 61.14760, Last appended by leader: 14760, Current term: 65, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.710343 9314 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 61 to 65. New cstate: current_term: 65 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
W20251211 09:11:30.717291 9703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 62 current term: 65 is higher.
I20251211 09:11:30.737659 9494 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 65 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 59 index: 14759. Preceding OpId from leader: term: 65 index: 14761. (index mismatch)
I20251211 09:11:30.737967 9740 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14761, Last known committed idx: 14759, Time since last communication: 0.000s
I20251211 09:11:30.741712 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 65 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 61 index: 14760. Preceding OpId from leader: term: 65 index: 14761. (index mismatch)
I20251211 09:11:30.741950 9740 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14761, Last known committed idx: 14760, Time since last communication: 0.000s
W20251211 09:11:30.743458 9703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 62 current term: 65 is higher.
I20251211 09:11:30.773100 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 65 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:30.773196 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 65 FOLLOWER]: Advancing to term 66
I20251211 09:11:30.773896 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.774072 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 66 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.774299 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 66 candidate_status { last_received { term: 65 index: 14761 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.774299 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 66 candidate_status { last_received { term: 65 index: 14761 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.774573 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 66 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.774672 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 66 FOLLOWER]: Leader election lost for term 66. Reason: could not achieve majority
I20251211 09:11:30.777935 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 66 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 65. Current term is 66. Ops: []
I20251211 09:11:30.778200 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 65.14761, Next index: 14762, Last known committed idx: 14761, Time since last communication: 0.000s
W20251211 09:11:30.778594 9703 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 63 current term: 65 is higher.
I20251211 09:11:30.794185 9719 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 65 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:30.794294 9719 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 65 FOLLOWER]: Advancing to term 66
I20251211 09:11:30.794930 9719 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.795085 9719 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 66 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.795291 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 66 candidate_status { last_received { term: 65 index: 14761 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.795301 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 66 candidate_status { last_received { term: 65 index: 14761 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.795405 9571 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 66 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 66: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:30.795595 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 66 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.795694 9719 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 66 FOLLOWER]: Leader election lost for term 66. Reason: could not achieve majority
I20251211 09:11:30.798843 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 66 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 65. Current term is 66. Ops: []
I20251211 09:11:30.799057 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 65.14761, Next index: 14762, Last known committed idx: 14761, Time since last communication: 0.000s
I20251211 09:11:30.809922 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 66 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 65. Current term is 66. Ops: []
I20251211 09:11:30.810190 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 65.14761, Next index: 14762, Last known committed idx: 14761, Time since last communication: 0.000s
I20251211 09:11:30.814980 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 66 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.815044 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 66 FOLLOWER]: Advancing to term 67
I20251211 09:11:30.815640 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.815778 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 67 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.815932 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 67 candidate_status { last_received { term: 65 index: 14761 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.815949 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 67 candidate_status { last_received { term: 65 index: 14761 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.816040 9494 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 66 FOLLOWER]: Advancing to term 67
I20251211 09:11:30.816520 9494 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 67 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 67.
I20251211 09:11:30.816699 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 67 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678
I20251211 09:11:30.816787 9711 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 67 FOLLOWER]: Leader election won for term 67
I20251211 09:11:30.816838 9711 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 67 LEADER]: Becoming Leader. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:30.816900 9711 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14761, Committed index: 14761, Last appended: 65.14761, Last appended by leader: 14761, Current term: 67, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.817325 9313 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e reported cstate change: term changed from 65 to 67, leader changed from 2da53b301e274e63968e16c177efa678 (127.0.119.193) to b546844397f6426994e641f568e0c32e (127.0.119.195). New cstate: current_term: 67 leader_uuid: "b546844397f6426994e641f568e0c32e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:30.827994 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 67 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 65. Current term is 67. Ops: []
I20251211 09:11:30.828280 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 65.14761, Next index: 14762, Last known committed idx: 14761, Time since last communication: 0.000s
I20251211 09:11:30.836839 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 67 LEADER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 65. Current term is 67. Ops: []
I20251211 09:11:30.837054 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 65.14761, Next index: 14762, Last known committed idx: 14761, Time since last communication: 0.000s
I20251211 09:11:30.837154 9740 consensus_queue.cc:1243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer b546844397f6426994e641f568e0c32e log is divergent from this leader: its last log entry 67.14762 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14761
I20251211 09:11:30.852562 9419 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 65 LEADER]: Stepping down as leader of term 65
I20251211 09:11:30.852639 9419 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 65 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:30.852690 9419 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14761, Committed index: 14761, Last appended: 65.14761, Last appended by leader: 14761, Current term: 65, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.852789 9419 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 65 FOLLOWER]: Advancing to term 67
I20251211 09:11:30.853418 9419 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 67 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 65 index: 14761. Preceding OpId from leader: term: 67 index: 14762. (index mismatch)
I20251211 09:11:30.853581 9494 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 67 FOLLOWER]: Refusing update from remote peer b546844397f6426994e641f568e0c32e: Log matching property violated. Preceding OpId in replica: term: 65 index: 14761. Preceding OpId from leader: term: 67 index: 14762. (index mismatch)
I20251211 09:11:30.853655 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14762, Last known committed idx: 14761, Time since last communication: 0.000s
I20251211 09:11:30.853819 9711 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14762, Last known committed idx: 14761, Time since last communication: 0.000s
I20251211 09:11:30.885128 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 67 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:30.885216 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 67 FOLLOWER]: Advancing to term 68
I20251211 09:11:30.885872 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.885995 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 68 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.886179 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 68 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.886188 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 68 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.886458 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 68 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.886580 9703 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 68 FOLLOWER]: Leader election lost for term 68. Reason: could not achieve majority
I20251211 09:11:30.889799 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 68 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 67. Current term is 68. Ops: []
I20251211 09:11:30.890053 9711 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 67.14762, Next index: 14763, Last known committed idx: 14762, Time since last communication: 0.000s
I20251211 09:11:30.923081 9419 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 68 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 67. Current term is 68. Ops: []
I20251211 09:11:30.923341 9742 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 }, Status: INVALID_TERM, Last received: 67.14762, Next index: 14763, Last known committed idx: 14762, Time since last communication: 0.000s
I20251211 09:11:30.925395 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 68 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.925439 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 68 FOLLOWER]: Advancing to term 69
I20251211 09:11:30.926088 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.926229 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 69 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.926430 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 69 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.926431 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 69 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.926705 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 69 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:30.926795 9703 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 69 FOLLOWER]: Leader election lost for term 69. Reason: could not achieve majority
I20251211 09:11:30.937777 9719 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 67 FOLLOWER]: Starting leader election (detected failure of leader b546844397f6426994e641f568e0c32e)
I20251211 09:11:30.937882 9719 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 67 FOLLOWER]: Advancing to term 68
I20251211 09:11:30.938668 9719 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.938827 9719 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 68 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.938978 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 68 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.938982 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 68 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.939105 9419 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 69 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 68. Current term is 69.
I20251211 09:11:30.939244 9459 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 68 election: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 69 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 68. Current term is 69.
I20251211 09:11:30.939301 9459 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 68 election: Cancelling election due to peer responding with higher term
I20251211 09:11:30.939366 9719 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 68 FOLLOWER]: Advancing to term 69
I20251211 09:11:30.939831 9667 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 67 LEADER]: Stepping down as leader of term 67
I20251211 09:11:30.939868 9719 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 69 FOLLOWER]: Leader election lost for term 68. Reason: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 69 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 68. Current term is 69.
I20251211 09:11:30.939877 9667 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 67 LEADER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Running, Role: LEADER
I20251211 09:11:30.940009 9667 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14762, Committed index: 14762, Last appended: 67.14762, Last appended by leader: 14762, Current term: 67, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.940054 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 69 FOLLOWER]: Rejecting Update request from peer b546844397f6426994e641f568e0c32e for earlier term 67. Current term is 69. Ops: []
I20251211 09:11:30.940088 9667 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 67 FOLLOWER]: Advancing to term 68
I20251211 09:11:30.963238 9703 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 69 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.963339 9711 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 68 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:30.963339 9703 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 69 FOLLOWER]: Advancing to term 70
I20251211 09:11:30.963428 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 68 FOLLOWER]: Advancing to term 69
I20251211 09:11:30.964012 9703 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.964013 9711 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.964179 9703 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 70 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:30.964293 9711 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 69 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:30.964359 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 69 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:30.964386 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 69 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.964444 9419 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 69. Current term is 70.
I20251211 09:11:30.964617 9536 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 69 election: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 69. Current term is 70.
I20251211 09:11:30.964669 9536 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 69 election: Cancelling election due to peer responding with higher term
I20251211 09:11:30.964656 9495 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 70 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:30.964735 9711 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 69 FOLLOWER]: Advancing to term 70
I20251211 09:11:30.964970 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "2da53b301e274e63968e16c177efa678" candidate_term: 70 candidate_status { last_received { term: 67 index: 14762 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:30.965142 9494 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b546844397f6426994e641f568e0c32e in term 69.
I20251211 09:11:30.965399 9711 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 70 FOLLOWER]: Leader election lost for term 69. Reason: Vote denied by peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e for earlier term 69. Current term is 70.
I20251211 09:11:30.965983 9571 raft_consensus.cc:2468] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 70 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2da53b301e274e63968e16c177efa678 in term 70.
I20251211 09:11:30.966164 9384 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 70 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e; no voters: 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:30.966254 9703 raft_consensus.cc:2804] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 FOLLOWER]: Leader election won for term 70
I20251211 09:11:30.966312 9703 raft_consensus.cc:697] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 LEADER]: Becoming Leader. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:30.966367 9703 consensus_queue.cc:237] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14762, Committed index: 14762, Last appended: 67.14762, Last appended by leader: 14762, Current term: 70, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:30.966785 9315 catalog_manager.cc:5654] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 reported cstate change: term changed from 67 to 70, leader changed from b546844397f6426994e641f568e0c32e (127.0.119.195) to 2da53b301e274e63968e16c177efa678 (127.0.119.193). New cstate: current_term: 70 leader_uuid: "2da53b301e274e63968e16c177efa678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:30.996250 9571 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 70 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 67 index: 14762. Preceding OpId from leader: term: 70 index: 14763. (index mismatch)
I20251211 09:11:30.996549 9703 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14763, Last known committed idx: 14762, Time since last communication: 0.000s
I20251211 09:11:30.997835 9494 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 69 FOLLOWER]: Advancing to term 70
I20251211 09:11:30.998464 9494 raft_consensus.cc:1275] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 70 FOLLOWER]: Refusing update from remote peer 2da53b301e274e63968e16c177efa678: Log matching property violated. Preceding OpId in replica: term: 67 index: 14762. Preceding OpId from leader: term: 70 index: 14763. (index mismatch)
I20251211 09:11:30.998703 9703 consensus_queue.cc:1048] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14763, Last known committed idx: 14762, Time since last communication: 0.000s
W20251211 09:11:31.018102 9741 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 67 current term: 70 is higher.
W20251211 09:11:31.033406 9741 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 67 current term: 70 is higher.
I20251211 09:11:31.057538 9667 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 70 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:31.057627 9667 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 70 FOLLOWER]: Advancing to term 71
I20251211 09:11:31.058256 9667 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:31.058415 9667 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 71 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:31.058611 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 71 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:31.058611 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 71 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:31.058862 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 71 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:31.058974 9667 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 71 FOLLOWER]: Leader election lost for term 71. Reason: could not achieve majority
I20251211 09:11:31.063318 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 71 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 70. Current term is 71. Ops: []
I20251211 09:11:31.063540 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 70.14763, Next index: 14764, Last known committed idx: 14763, Time since last communication: 0.000s
I20251211 09:11:31.094689 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 71 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 70. Current term is 71. Ops: []
I20251211 09:11:31.094956 9741 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 70.14763, Next index: 14764, Last known committed idx: 14763, Time since last communication: 0.000s
I20251211 09:11:31.099380 9667 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 71 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:31.099465 9667 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 71 FOLLOWER]: Advancing to term 72
I20251211 09:11:31.100288 9667 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:31.100450 9667 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 72 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:31.100591 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 72 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:31.100598 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 72 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:31.100840 9537 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 72 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:31.100935 9667 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Leader election lost for term 72. Reason: could not achieve majority
I20251211 09:11:31.106490 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 70 FOLLOWER]: Starting leader election (detected failure of leader 2da53b301e274e63968e16c177efa678)
I20251211 09:11:31.106551 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 70 FOLLOWER]: Advancing to term 71
I20251211 09:11:31.107210 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:31.107343 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 71 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:31.107542 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 71 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:31.107522 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 71 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:31.107534 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 71 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 70. Current term is 71. Ops: []
I20251211 09:11:31.107642 9571 raft_consensus.cc:2368] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 71. Current term is 72.
I20251211 09:11:31.107767 9460 leader_election.cc:400] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 71 election: Vote denied by peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 71. Current term is 72.
I20251211 09:11:31.107805 9741 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 70.14763, Next index: 14764, Last known committed idx: 14763, Time since last communication: 0.000s
I20251211 09:11:31.107800 9460 leader_election.cc:403] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 71 election: Cancelling election due to peer responding with higher term
I20251211 09:11:31.107939 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 71 FOLLOWER]: Advancing to term 72
I20251211 09:11:31.108476 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 72 FOLLOWER]: Leader election lost for term 71. Reason: Vote denied by peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889) with higher term. Message: Invalid argument: T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 for earlier term 71. Current term is 72.
I20251211 09:11:31.131420 9571 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 70. Current term is 72. Ops: []
I20251211 09:11:31.131665 9703 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 }, Status: INVALID_TERM, Last received: 70.14763, Next index: 14764, Last known committed idx: 14763, Time since last communication: 0.000s
I20251211 09:11:31.138793 9674 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 72 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:31.138890 9674 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 72 FOLLOWER]: Advancing to term 73
I20251211 09:11:31.139269 9667 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:31.139329 9667 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 72 FOLLOWER]: Advancing to term 73
I20251211 09:11:31.139582 9674 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:31.139731 9674 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 73 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
I20251211 09:11:31.139900 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 73 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:31.139918 9667 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:31.139981 9571 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "4268dfc39c6846ff9862641870b507d0" candidate_term: 73 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "b546844397f6426994e641f568e0c32e"
I20251211 09:11:31.140130 9571 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 73 FOLLOWER]: Leader election vote request: Denying vote to candidate 4268dfc39c6846ff9862641870b507d0 in current term 73: Already voted for candidate b546844397f6426994e641f568e0c32e in this term.
I20251211 09:11:31.140163 9667 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 73 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
I20251211 09:11:31.140273 9494 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 73 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "4268dfc39c6846ff9862641870b507d0"
I20251211 09:11:31.140300 9460 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 73 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:31.140358 9494 raft_consensus.cc:2393] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Leader election vote request: Denying vote to candidate b546844397f6426994e641f568e0c32e in current term 73: Already voted for candidate 4268dfc39c6846ff9862641870b507d0 in this term.
I20251211 09:11:31.140285 9419 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b1f2f134e3145e0a4662c29d28c2408" candidate_uuid: "b546844397f6426994e641f568e0c32e" candidate_term: 73 candidate_status { last_received { term: 70 index: 14763 } } ignore_live_leader: false dest_uuid: "2da53b301e274e63968e16c177efa678"
I20251211 09:11:31.140450 9674 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Leader election lost for term 73. Reason: could not achieve majority
I20251211 09:11:31.140559 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 73 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:31.140643 9667 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 73 FOLLOWER]: Leader election lost for term 73. Reason: could not achieve majority
I20251211 09:11:31.141347 9494 raft_consensus.cc:1240] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Rejecting Update request from peer 2da53b301e274e63968e16c177efa678 for earlier term 70. Current term is 73. Ops: []
I20251211 09:11:31.141542 9740 consensus_queue.cc:1059] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 }, Status: INVALID_TERM, Last received: 70.14763, Next index: 14764, Last known committed idx: 14763, Time since last communication: 0.000s
I20251211 09:11:31.143229 9741 raft_consensus.cc:3055] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 LEADER]: Stepping down as leader of term 70
I20251211 09:11:31.143265 9741 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 LEADER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Running, Role: LEADER
I20251211 09:11:31.143323 9741 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14763, Committed index: 14763, Last appended: 70.14763, Last appended by leader: 14763, Current term: 70, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:31.143414 9741 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 70 FOLLOWER]: Advancing to term 71
W20251211 09:11:31.149420 9633 lock_manager.cc:494] Txn 2 has not acquired the partition lock after 1000ms
I20251211 09:11:31.154866 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:11:31.157305 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:31.157433 479 tablet_replica.cc:333] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: stopping tablet replica
I20251211 09:11:31.157483 479 raft_consensus.cc:2243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 71 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:31.162122 479 raft_consensus.cc:2272] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 71 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:31.166047 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:11:31.166837 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:11:31.169391 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:31.169492 479 tablet_replica.cc:333] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: stopping tablet replica
I20251211 09:11:31.169546 479 raft_consensus.cc:2243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:31.169585 479 raft_consensus.cc:2272] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:31.178929 9667 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 73 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:31.178997 9667 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 73 FOLLOWER]: Advancing to term 74
I20251211 09:11:31.179790 9667 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:31.179925 9667 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 74 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
W20251211 09:11:31.180189 9536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20251211 09:11:31.180558 9537 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 74 election: RPC error from VoteRequest() call to peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497): Network error: Client connection negotiation failed: client connection to 127.0.119.194:44497: connect: Connection refused (error 111)
I20251211 09:11:31.180616 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
W20251211 09:11:31.180634 9536 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 74 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
I20251211 09:11:31.180691 9536 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:31.180773 9667 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20251211 09:11:31.181681 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:11:31.184947 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:31.185060 479 tablet_replica.cc:333] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: stopping tablet replica
I20251211 09:11:31.185127 479 raft_consensus.cc:2243] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:31.185158 479 raft_consensus.cc:2272] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:31.208487 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:11:31.209434 479 master.cc:561] Master@127.0.119.254:35381 shutting down...
I20251211 09:11:31.211964 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:11:31.212035 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:31.212054 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: stopping tablet replica
I20251211 09:11:31.223769 479 master.cc:583] Master@127.0.119.254:35381 shutdown complete.
I20251211 09:11:31.225059 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:31.226255 9868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:31.226310 9865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:31.226397 479 server_base.cc:1047] running on GCE node
W20251211 09:11:31.226310 9866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:31.226644 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:31.226686 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:31.226704 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444291226704 us; error 0 us; skew 500 ppm
I20251211 09:11:31.227243 479 webserver.cc:492] Webserver started at http://127.0.119.254:40225/ using document root <none> and password file <none>
I20251211 09:11:31.227320 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:31.227355 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:11:31.227883 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:31.228266 9873 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.228402 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.228449 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "1005346adddc4367a3a98b0ce0f97b46"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:31.228518 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:31.235932 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:31.236120 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:31.238621 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:35381
I20251211 09:11:31.239172 9926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:35381 every 8 connection(s)
I20251211 09:11:31.242035 9927 sys_catalog.cc:263] Verifying existing consensus state
I20251211 09:11:31.242383 9927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: Bootstrap starting.
I20251211 09:11:31.245139 9927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: Bootstrap replayed 1/1 log segments. Stats: ops{read=39 overwritten=0 applied=39 ignored=0} inserts{seen=5 ignored=0} mutations{seen=34 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:11:31.245431 9927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: Bootstrap complete.
I20251211 09:11:31.245635 9927 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:31.245692 9927 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1005346adddc4367a3a98b0ce0f97b46, State: Initialized, Role: FOLLOWER
I20251211 09:11:31.245748 9927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 39, Last appended: 1.39, Last appended by leader: 39, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:31.245786 9927 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:11:31.245824 9927 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:11:31.245851 9927 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:31.246343 9927 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:31.246395 9927 leader_election.cc:304] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1005346adddc4367a3a98b0ce0f97b46; no voters:
I20251211 09:11:31.246500 9927 leader_election.cc:290] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [CANDIDATE]: Term 2 election: Requested vote from peers
I20251211 09:11:31.246548 9930 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 2 FOLLOWER]: Leader election won for term 2
I20251211 09:11:31.246639 9927 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:11:31.246697 9930 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 2 LEADER]: Becoming Leader. State: Replica: 1005346adddc4367a3a98b0ce0f97b46, State: Running, Role: LEADER
I20251211 09:11:31.246755 9930 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 39, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER }
I20251211 09:11:31.246954 9931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1005346adddc4367a3a98b0ce0f97b46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER } }
I20251211 09:11:31.246954 9932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1005346adddc4367a3a98b0ce0f97b46. Latest consensus state: current_term: 2 leader_uuid: "1005346adddc4367a3a98b0ce0f97b46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1005346adddc4367a3a98b0ce0f97b46" member_type: VOTER } }
I20251211 09:11:31.247035 9931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:31.247051 9932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:31.247188 9936 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:11:31.247442 9936 catalog_manager.cc:679] Loaded metadata for table test-workload [id=9544c98fb7684a99920798da05be6e14]
I20251211 09:11:31.247561 9936 tablet_loader.cc:96] loaded metadata for tablet 7b1f2f134e3145e0a4662c29d28c2408 (table test-workload [id=9544c98fb7684a99920798da05be6e14])
I20251211 09:11:31.247611 9936 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:11:31.247710 9936 catalog_manager.cc:1269] Loaded cluster ID: f7079280d4d849cb9861e12dbe980292
I20251211 09:11:31.247750 9936 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:11:31.247776 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:11:31.248448 9936 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:11:31.248569 9936 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46: Loaded TSK: 0
I20251211 09:11:31.248673 9936 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:11:31.249006 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:31.250195 9947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:31.250252 9949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:31.250337 479 server_base.cc:1047] running on GCE node
W20251211 09:11:31.250204 9946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:31.250499 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:31.250535 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:31.250559 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444291250558 us; error 0 us; skew 500 ppm
I20251211 09:11:31.251098 479 webserver.cc:492] Webserver started at http://127.0.119.193:45319/ using document root <none> and password file <none>
I20251211 09:11:31.251187 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:31.251222 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:11:31.251693 479 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20251211 09:11:31.252106 9954 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.252239 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.252280 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "2da53b301e274e63968e16c177efa678"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:31.252333 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:31.277678 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:31.277910 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:31.278134 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:31.278431 9962 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20251211 09:11:31.279053 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:11:31.279109 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:11:31.279151 479 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20251211 09:11:31.279521 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:11:31.279548 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.279559 9962 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Bootstrap starting.
I20251211 09:11:31.283105 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:43629
I20251211 09:11:31.283504 10021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:43629 every 8 connection(s)
I20251211 09:11:31.283617 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:31.284797 10026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:31.284878 10029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:31.285107 10027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:31.285358 479 server_base.cc:1047] running on GCE node
I20251211 09:11:31.285447 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:31.285480 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:31.285495 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444291285496 us; error 0 us; skew 500 ppm
I20251211 09:11:31.286324 479 webserver.cc:492] Webserver started at http://127.0.119.194:37991/ using document root <none> and password file <none>
I20251211 09:11:31.286423 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:31.286459 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:11:31.287510 479 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20251211 09:11:31.287846 10022 heartbeater.cc:344] Connected to a master server at 127.0.119.254:35381
I20251211 09:11:31.287912 10022 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:31.288017 10022 heartbeater.cc:507] Master 127.0.119.254:35381 requested a full tablet report, sending...
I20251211 09:11:31.288234 10034 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.288290 9891 ts_manager.cc:194] Registered new tserver with Master: 2da53b301e274e63968e16c177efa678 (127.0.119.193:43629)
I20251211 09:11:31.288483 479 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20251211 09:11:31.288533 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "4268dfc39c6846ff9862641870b507d0"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:31.288583 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:31.289201 9891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58416
I20251211 09:11:31.299309 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:31.299474 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:31.299609 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:31.300489 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:11:31.300522 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:11:31.300874 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:11:31.300902 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.300943 10041 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Bootstrap starting.
I20251211 09:11:31.304307 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:38941
I20251211 09:11:31.304354 10099 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:38941 every 8 connection(s)
I20251211 09:11:31.304622 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:31.306561 10104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:31.306600 10106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:31.307320 10103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:31.307435 479 server_base.cc:1047] running on GCE node
I20251211 09:11:31.307548 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:31.307581 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:31.307600 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444291307599 us; error 0 us; skew 500 ppm
I20251211 09:11:31.308218 10100 heartbeater.cc:344] Connected to a master server at 127.0.119.254:35381
I20251211 09:11:31.308276 10100 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:31.308408 10100 heartbeater.cc:507] Master 127.0.119.254:35381 requested a full tablet report, sending...
I20251211 09:11:31.308712 9891 ts_manager.cc:194] Registered new tserver with Master: 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:38941)
I20251211 09:11:31.309175 9891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58418
I20251211 09:11:31.313383 479 webserver.cc:492] Webserver started at http://127.0.119.195:46129/ using document root <none> and password file <none>
I20251211 09:11:31.313472 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:31.313529 479 fs_manager.cc:365] Using existing metadata directory in first data directory
I20251211 09:11:31.314244 479 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:31.314854 10111 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:31.314971 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251211 09:11:31.315011 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "b546844397f6426994e641f568e0c32e"
format_stamp: "Formatted at 2025-12-11 09:11:17 on dist-test-slave-hb70"
I20251211 09:11:31.315059 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:31.348007 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:31.348273 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:31.348446 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:31.349552 479 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20251211 09:11:31.349606 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20251211 09:11:31.350113 479 ts_tablet_manager.cc:616] Registered 1 tablets
I20251211 09:11:31.350180 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20251211 09:11:31.350267 10118 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Bootstrap starting.
I20251211 09:11:31.354159 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:37963
I20251211 09:11:31.357635 10177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:37963 every 8 connection(s)
I20251211 09:11:31.361475 10178 heartbeater.cc:344] Connected to a master server at 127.0.119.254:35381
I20251211 09:11:31.361541 10178 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:31.361634 10178 heartbeater.cc:507] Master 127.0.119.254:35381 requested a full tablet report, sending...
I20251211 09:11:31.361964 9891 ts_manager.cc:194] Registered new tserver with Master: b546844397f6426994e641f568e0c32e (127.0.119.195:37963)
I20251211 09:11:31.362445 9891 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58430
I20251211 09:11:31.362811 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.008482891s
I20251211 09:11:32.003036 10041 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Bootstrap replayed 1/3 log segments. Stats: ops{read=4953 overwritten=0 applied=4953 ignored=0} inserts{seen=247600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:11:32.289758 10022 heartbeater.cc:499] Master 127.0.119.254:35381 was elected leader, sending a full tablet report...
I20251211 09:11:32.309813 10100 heartbeater.cc:499] Master 127.0.119.254:35381 was elected leader, sending a full tablet report...
I20251211 09:11:32.363588 10178 heartbeater.cc:499] Master 127.0.119.254:35381 was elected leader, sending a full tablet report...
I20251211 09:11:32.466403 9962 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Bootstrap replayed 1/3 log segments. Stats: ops{read=4961 overwritten=0 applied=4960 ignored=0} inserts{seen=247950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:11:32.501961 10118 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Bootstrap replayed 1/4 log segments. Stats: ops{read=4633 overwritten=0 applied=4629 ignored=0} inserts{seen=231400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20251211 09:11:32.699177 10041 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Bootstrap replayed 2/3 log segments. Stats: ops{read=9903 overwritten=0 applied=9900 ignored=0} inserts{seen=494950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20251211 09:11:33.380517 10041 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Bootstrap replayed 3/3 log segments. Stats: ops{read=14764 overwritten=1 applied=14763 ignored=0} inserts{seen=736203 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:11:33.380947 10041 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Bootstrap complete.
I20251211 09:11:33.385846 10041 ts_tablet_manager.cc:1403] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Time spent bootstrapping tablet: real 2.085s user 1.744s sys 0.339s
I20251211 09:11:33.385998 10041 raft_consensus.cc:359] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.386063 10041 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4268dfc39c6846ff9862641870b507d0, State: Initialized, Role: FOLLOWER
I20251211 09:11:33.386124 10041 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14763, Last appended: 70.14763, Last appended by leader: 14763, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.386310 10041 ts_tablet_manager.cc:1434] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:33.409483 10187 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:33.409569 10187 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 73 FOLLOWER]: Advancing to term 74
I20251211 09:11:33.410243 10187 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.410804 10187 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 74 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:33.411067 10037 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 74 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
W20251211 09:11:33.411312 10036 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 74 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
I20251211 09:11:33.411350 10036 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:33.411438 10187 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20251211 09:11:33.446826 10187 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:33.446919 10187 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 74 FOLLOWER]: Advancing to term 75
I20251211 09:11:33.447777 10187 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.447942 10187 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 75 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:33.448522 10036 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 75 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
W20251211 09:11:33.448580 10037 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 75 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
I20251211 09:11:33.448627 10037 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 75 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:33.448719 10187 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 75 FOLLOWER]: Leader election lost for term 75. Reason: could not achieve majority
I20251211 09:11:33.506358 10187 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 75 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:33.506454 10187 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 75 FOLLOWER]: Advancing to term 76
I20251211 09:11:33.507345 10187 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.507500 10187 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 76 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:33.508136 10036 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 76 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
W20251211 09:11:33.508209 10037 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 76 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
I20251211 09:11:33.508239 10037 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 76 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:33.508308 10187 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 76 FOLLOWER]: Leader election lost for term 76. Reason: could not achieve majority
I20251211 09:11:33.562023 10118 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Bootstrap replayed 2/4 log segments. Stats: ops{read=9264 overwritten=0 applied=9262 ignored=0} inserts{seen=463050 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20251211 09:11:33.585744 9962 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Bootstrap replayed 2/3 log segments. Stats: ops{read=9928 overwritten=0 applied=9927 ignored=0} inserts{seen=496300 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251211 09:11:33.588904 10187 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 76 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:33.588982 10187 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 76 FOLLOWER]: Advancing to term 77
I20251211 09:11:33.589836 10187 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.589991 10187 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 77 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:33.590615 10037 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 77 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
W20251211 09:11:33.590672 10036 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 77 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
I20251211 09:11:33.590723 10036 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 77 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:33.590816 10187 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 77 FOLLOWER]: Leader election lost for term 77. Reason: could not achieve majority
I20251211 09:11:33.632208 10187 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 77 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:33.632308 10187 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 77 FOLLOWER]: Advancing to term 78
I20251211 09:11:33.633132 10187 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.633348 10187 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 78 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:33.633831 10036 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 78 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
W20251211 09:11:33.634399 10037 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 78 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
I20251211 09:11:33.634455 10037 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 78 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:33.634553 10187 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 78 FOLLOWER]: Leader election lost for term 78. Reason: could not achieve majority
I20251211 09:11:33.847072 10187 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 78 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:33.847208 10187 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 78 FOLLOWER]: Advancing to term 79
I20251211 09:11:33.848066 10187 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:33.848443 10187 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 79 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:33.848820 10036 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 79 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
W20251211 09:11:33.848934 10037 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 79 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
I20251211 09:11:33.848999 10037 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 79 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:33.849100 10187 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 79 FOLLOWER]: Leader election lost for term 79. Reason: could not achieve majority
I20251211 09:11:34.014289 10187 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 79 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:34.014386 10187 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 79 FOLLOWER]: Advancing to term 80
I20251211 09:11:34.015183 10187 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.015527 10187 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 80 election: Requested vote from peers 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:34.016001 10036 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 80 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
W20251211 09:11:34.016212 10037 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 80 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
I20251211 09:11:34.016269 10037 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [CANDIDATE]: Term 80 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4268dfc39c6846ff9862641870b507d0; no voters: 2da53b301e274e63968e16c177efa678, b546844397f6426994e641f568e0c32e
I20251211 09:11:34.016371 10187 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 80 FOLLOWER]: Leader election lost for term 80. Reason: could not achieve majority
I20251211 09:11:34.204365 10118 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Bootstrap replayed 3/4 log segments. Stats: ops{read=13896 overwritten=0 applied=13894 ignored=0} inserts{seen=694650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20251211 09:11:34.246768 9962 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Bootstrap replayed 3/3 log segments. Stats: ops{read=14764 overwritten=1 applied=14763 ignored=0} inserts{seen=736203 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:11:34.247255 9962 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Bootstrap complete.
I20251211 09:11:34.252251 9962 ts_tablet_manager.cc:1403] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Time spent bootstrapping tablet: real 2.973s user 2.568s sys 0.400s
I20251211 09:11:34.252401 9962 raft_consensus.cc:359] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 71 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.252463 9962 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 71 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da53b301e274e63968e16c177efa678, State: Initialized, Role: FOLLOWER
I20251211 09:11:34.252522 9962 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14763, Last appended: 70.14763, Last appended by leader: 14763, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.252700 9962 ts_tablet_manager.cc:1434] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678: Time spent starting tablet: real 0.000s user 0.003s sys 0.000s
I20251211 09:11:34.280797 10195 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 71 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:34.280906 10195 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 71 FOLLOWER]: Advancing to term 72
I20251211 09:11:34.281849 10195 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.282038 10195 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 72 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:34.282873 9957 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 72 election: RPC error from VoteRequest() call to peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497): Network error: Client connection negotiation failed: client connection to 127.0.119.194:44497: connect: Connection refused (error 111)
W20251211 09:11:34.282946 9957 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 72 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
I20251211 09:11:34.282967 9957 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 72 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:34.283047 10195 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 72 FOLLOWER]: Leader election lost for term 72. Reason: could not achieve majority
I20251211 09:11:34.316336 10195 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 72 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:34.316413 10195 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 72 FOLLOWER]: Advancing to term 73
I20251211 09:11:34.317118 10195 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.317273 10195 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 73 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), b546844397f6426994e641f568e0c32e (127.0.119.195:33889)
W20251211 09:11:34.317837 9957 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 73 election: RPC error from VoteRequest() call to peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497): Network error: Client connection negotiation failed: client connection to 127.0.119.194:44497: connect: Connection refused (error 111)
W20251211 09:11:34.317902 9957 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 73 election: RPC error from VoteRequest() call to peer b546844397f6426994e641f568e0c32e (127.0.119.195:33889): Network error: Client connection negotiation failed: client connection to 127.0.119.195:33889: connect: Connection refused (error 111)
I20251211 09:11:34.317917 9957 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [CANDIDATE]: Term 73 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2da53b301e274e63968e16c177efa678; no voters: 4268dfc39c6846ff9862641870b507d0, b546844397f6426994e641f568e0c32e
I20251211 09:11:34.318009 10195 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 73 FOLLOWER]: Leader election lost for term 73. Reason: could not achieve majority
I20251211 09:11:34.322403 10118 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Bootstrap replayed 4/4 log segments. Stats: ops{read=14763 overwritten=0 applied=14763 ignored=0} inserts{seen=736203 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251211 09:11:34.322767 10118 tablet_bootstrap.cc:492] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Bootstrap complete.
I20251211 09:11:34.327869 10118 ts_tablet_manager.cc:1403] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Time spent bootstrapping tablet: real 2.978s user 2.625s sys 0.348s
I20251211 09:11:34.328008 10118 raft_consensus.cc:359] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.328064 10118 raft_consensus.cc:740] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Becoming Follower/Learner. State: Replica: b546844397f6426994e641f568e0c32e, State: Initialized, Role: FOLLOWER
I20251211 09:11:34.328110 10118 consensus_queue.cc:260] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14763, Last appended: 70.14763, Last appended by leader: 14763, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.328292 10118 ts_tablet_manager.cc:1434] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e: Time spent starting tablet: real 0.000s user 0.003s sys 0.000s
I20251211 09:11:34.328500 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:11:34.330875 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:34.331035 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:11:34.331115 479 raft_consensus.cc:2243] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 73 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:34.331171 479 raft_consensus.cc:2272] T 7b1f2f134e3145e0a4662c29d28c2408 P 2da53b301e274e63968e16c177efa678 [term 73 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:34.345038 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:11:34.345856 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:11:34.348341 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:34.348452 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:11:34.348501 479 raft_consensus.cc:2243] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 80 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:34.348547 479 raft_consensus.cc:2272] T 7b1f2f134e3145e0a4662c29d28c2408 P 4268dfc39c6846ff9862641870b507d0 [term 80 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:34.351366 10199 raft_consensus.cc:493] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:34.351459 10199 raft_consensus.cc:3060] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 74 FOLLOWER]: Advancing to term 75
I20251211 09:11:34.352615 10199 raft_consensus.cc:515] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4268dfc39c6846ff9862641870b507d0" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 44497 } } peers { permanent_uuid: "2da53b301e274e63968e16c177efa678" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 45019 } } peers { permanent_uuid: "b546844397f6426994e641f568e0c32e" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 33889 } }
I20251211 09:11:34.358331 10199 leader_election.cc:290] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 75 election: Requested vote from peers 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497), 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019)
W20251211 09:11:34.359717 10114 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 75 election: RPC error from VoteRequest() call to peer 4268dfc39c6846ff9862641870b507d0 (127.0.119.194:44497): Network error: Client connection negotiation failed: client connection to 127.0.119.194:44497: connect: Connection refused (error 111)
W20251211 09:11:34.359803 10113 leader_election.cc:336] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 75 election: RPC error from VoteRequest() call to peer 2da53b301e274e63968e16c177efa678 (127.0.119.193:45019): Network error: Client connection negotiation failed: client connection to 127.0.119.193:45019: connect: Connection refused (error 111)
I20251211 09:11:34.359865 10113 leader_election.cc:304] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [CANDIDATE]: Term 75 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b546844397f6426994e641f568e0c32e; no voters: 2da53b301e274e63968e16c177efa678, 4268dfc39c6846ff9862641870b507d0
I20251211 09:11:34.359953 10199 raft_consensus.cc:2749] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 75 FOLLOWER]: Leader election lost for term 75. Reason: could not achieve majority
I20251211 09:11:34.371244 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:11:34.372012 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:11:34.374699 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:34.374830 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:11:34.374888 479 raft_consensus.cc:2243] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 75 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:34.374955 479 raft_consensus.cc:2272] T 7b1f2f134e3145e0a4662c29d28c2408 P b546844397f6426994e641f568e0c32e [term 75 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:34.398579 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:11:34.399427 479 master.cc:561] Master@127.0.119.254:35381 shutting down...
I20251211 09:11:34.401386 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 2 LEADER]: Raft consensus shutting down.
I20251211 09:11:34.401451 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1005346adddc4367a3a98b0ce0f97b46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:34.401487 479 tablet_replica.cc:333] stopping tablet replica
I20251211 09:11:34.412793 479 master.cc:583] Master@127.0.119.254:35381 shutdown complete.
[ OK ] TxnParticipantElectionStormITest.TestFrequentElections (17201 ms)
[ RUN ] TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm
I20251211 09:11:34.434419 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:38637
I20251211 09:11:34.434587 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:34.435652 10204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:34.435671 10203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:34.435742 10206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:34.435990 479 server_base.cc:1047] running on GCE node
I20251211 09:11:34.436095 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:34.436128 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:34.436141 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444294436141 us; error 0 us; skew 500 ppm
I20251211 09:11:34.436648 479 webserver.cc:492] Webserver started at http://127.0.119.254:36295/ using document root <none> and password file <none>
I20251211 09:11:34.436715 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:34.436756 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:34.436805 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:34.437054 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "583d3ebd1e6f4aea83a129e552747b73"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.437958 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:34.438395 10211 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.438513 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.438572 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "583d3ebd1e6f4aea83a129e552747b73"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.438608 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:34.454558 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:34.454717 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:34.457134 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:38637
I20251211 09:11:34.459856 10263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:38637 every 8 connection(s)
I20251211 09:11:34.460009 10264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:34.461009 10264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73: Bootstrap starting.
I20251211 09:11:34.461323 10264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:34.461781 10264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73: No bootstrap required, opened a new log
I20251211 09:11:34.461899 10264 raft_consensus.cc:359] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "583d3ebd1e6f4aea83a129e552747b73" member_type: VOTER }
I20251211 09:11:34.461948 10264 raft_consensus.cc:385] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:34.461971 10264 raft_consensus.cc:740] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583d3ebd1e6f4aea83a129e552747b73, State: Initialized, Role: FOLLOWER
I20251211 09:11:34.462074 10264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "583d3ebd1e6f4aea83a129e552747b73" member_type: VOTER }
I20251211 09:11:34.462127 10267 raft_consensus.cc:493] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:34.462218 10267 raft_consensus.cc:515] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "583d3ebd1e6f4aea83a129e552747b73" member_type: VOTER }
I20251211 09:11:34.462113 10264 raft_consensus.cc:399] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:11:34.462291 10267 leader_election.cc:304] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 583d3ebd1e6f4aea83a129e552747b73; no voters:
I20251211 09:11:34.462335 10264 raft_consensus.cc:493] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:11:34.462371 10264 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:34.462422 10267 leader_election.cc:290] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20251211 09:11:34.462859 10264 raft_consensus.cc:515] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "583d3ebd1e6f4aea83a129e552747b73" member_type: VOTER }
I20251211 09:11:34.462925 10264 leader_election.cc:304] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 583d3ebd1e6f4aea83a129e552747b73; no voters:
I20251211 09:11:34.462939 10267 raft_consensus.cc:2764] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251211 09:11:34.462975 10264 leader_election.cc:290] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:11:34.463007 10267 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:34.463057 10264 sys_catalog.cc:565] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:11:34.463101 10267 raft_consensus.cc:697] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 1 LEADER]: Becoming Leader. State: Replica: 583d3ebd1e6f4aea83a129e552747b73, State: Running, Role: LEADER
I20251211 09:11:34.463150 10267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "583d3ebd1e6f4aea83a129e552747b73" member_type: VOTER }
I20251211 09:11:34.463320 10267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "583d3ebd1e6f4aea83a129e552747b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "583d3ebd1e6f4aea83a129e552747b73" member_type: VOTER } }
I20251211 09:11:34.463382 10267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:34.463487 10267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 583d3ebd1e6f4aea83a129e552747b73. Latest consensus state: current_term: 1 leader_uuid: "583d3ebd1e6f4aea83a129e552747b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "583d3ebd1e6f4aea83a129e552747b73" member_type: VOTER } }
I20251211 09:11:34.463542 10267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:34.463560 10272 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:11:34.463691 10272 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:11:34.464243 10272 catalog_manager.cc:1357] Generated new cluster ID: 9adc01f0859a47558965052c5b9687a1
I20251211 09:11:34.464295 10272 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:11:34.464283 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:11:34.474498 10272 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:11:34.474953 10272 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:11:34.479264 10272 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73: Generated new TSK 0
I20251211 09:11:34.479334 10272 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:11:34.479933 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:34.481151 10286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:34.481276 10288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:34.481374 479 server_base.cc:1047] running on GCE node
W20251211 09:11:34.481407 10285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:34.481554 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:34.481590 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:34.481603 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444294481604 us; error 0 us; skew 500 ppm
I20251211 09:11:34.482211 479 webserver.cc:492] Webserver started at http://127.0.119.193:38405/ using document root <none> and password file <none>
I20251211 09:11:34.482293 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:34.482347 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:34.482400 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:34.482650 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "f6763afe5b56401ca43c3e40cc60bbda"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.483566 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:34.484005 10293 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.484129 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:34.484172 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "f6763afe5b56401ca43c3e40cc60bbda"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.484205 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:34.494457 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:34.494635 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:34.494743 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:34.494885 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:34.494907 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.494926 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:34.494943 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.497507 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:38127
I20251211 09:11:34.497548 10357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:38127 every 8 connection(s)
I20251211 09:11:34.497833 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:34.498868 10363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:34.498965 10362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:34.498914 10365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:34.499153 479 server_base.cc:1047] running on GCE node
I20251211 09:11:34.499295 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:34.499337 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:34.499354 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444294499355 us; error 0 us; skew 500 ppm
I20251211 09:11:34.501507 10358 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38637
I20251211 09:11:34.501571 10358 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:34.501655 479 webserver.cc:492] Webserver started at http://127.0.119.194:37491/ using document root <none> and password file <none>
I20251211 09:11:34.501685 10358 heartbeater.cc:507] Master 127.0.119.254:38637 requested a full tablet report, sending...
I20251211 09:11:34.501766 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:34.501833 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:34.501891 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:34.501926 10228 ts_manager.cc:194] Registered new tserver with Master: f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:34.502177 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.502759 10228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59606
I20251211 09:11:34.503235 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:34.503639 10370 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.503759 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.503798 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.503842 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:34.518532 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:34.518736 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:34.518901 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:34.519107 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:34.519140 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.519179 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:34.519207 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.522053 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:45855
I20251211 09:11:34.522111 10434 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:45855 every 8 connection(s)
I20251211 09:11:34.522418 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:34.523604 10438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:34.523627 10439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:34.523844 10441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:34.524034 479 server_base.cc:1047] running on GCE node
I20251211 09:11:34.524127 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:34.524152 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:34.524168 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444294524167 us; error 0 us; skew 500 ppm
I20251211 09:11:34.524789 479 webserver.cc:492] Webserver started at http://127.0.119.195:45061/ using document root <none> and password file <none>
I20251211 09:11:34.524884 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:34.524917 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:34.524952 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:34.525274 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "308a7bd702b94ee3b83a579292b3a657"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.525631 10435 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38637
I20251211 09:11:34.525687 10435 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:34.525799 10435 heartbeater.cc:507] Master 127.0.119.254:38637 requested a full tablet report, sending...
I20251211 09:11:34.526014 10228 ts_manager.cc:194] Registered new tserver with Master: 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855)
I20251211 09:11:34.526384 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:34.526476 10228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59622
I20251211 09:11:34.526928 10446 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.527038 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20251211 09:11:34.527096 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "308a7bd702b94ee3b83a579292b3a657"
format_stamp: "Formatted at 2025-12-11 09:11:34 on dist-test-slave-hb70"
I20251211 09:11:34.527140 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:34.543892 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:34.544108 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:34.544255 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:34.544436 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:34.544462 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.544484 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:34.544499 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:34.547662 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:36537
I20251211 09:11:34.547732 10509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:36537 every 8 connection(s)
I20251211 09:11:34.550727 10510 heartbeater.cc:344] Connected to a master server at 127.0.119.254:38637
I20251211 09:11:34.550786 10510 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:34.550884 10510 heartbeater.cc:507] Master 127.0.119.254:38637 requested a full tablet report, sending...
I20251211 09:11:34.551203 10228 ts_manager.cc:194] Registered new tserver with Master: 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:34.551527 10228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59624
I20251211 09:11:34.552260 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004432844s
I20251211 09:11:34.552618 479 test_util.cc:276] Using random seed: -2012468182
I20251211 09:11:34.556967 10228 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59634:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:11:34.557096 10228 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:11:34.561183 10398 tablet_service.cc:1505] Processing CreateTablet for tablet 44e9993e1ff645deb5ce9f17c6593acc (DEFAULT_TABLE table=test-workload [id=715757c4e1ef4127a6c4797602f7bdaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:34.561389 10398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e9993e1ff645deb5ce9f17c6593acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:34.561826 10322 tablet_service.cc:1505] Processing CreateTablet for tablet 44e9993e1ff645deb5ce9f17c6593acc (DEFAULT_TABLE table=test-workload [id=715757c4e1ef4127a6c4797602f7bdaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:34.561928 10322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e9993e1ff645deb5ce9f17c6593acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:34.561950 10474 tablet_service.cc:1505] Processing CreateTablet for tablet 44e9993e1ff645deb5ce9f17c6593acc (DEFAULT_TABLE table=test-workload [id=715757c4e1ef4127a6c4797602f7bdaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:34.562023 10474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e9993e1ff645deb5ce9f17c6593acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:34.562700 10525 tablet_bootstrap.cc:492] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: Bootstrap starting.
I20251211 09:11:34.563177 10525 tablet_bootstrap.cc:654] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:34.563519 10527 tablet_bootstrap.cc:492] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657: Bootstrap starting.
I20251211 09:11:34.563759 10525 tablet_bootstrap.cc:492] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: No bootstrap required, opened a new log
I20251211 09:11:34.563813 10525 ts_tablet_manager.cc:1403] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:34.563884 10527 tablet_bootstrap.cc:654] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:34.563971 10525 raft_consensus.cc:359] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.564034 10525 raft_consensus.cc:385] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:34.564050 10525 raft_consensus.cc:740] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d6135bfcd4b4d27aa24e961f8ea84b3, State: Initialized, Role: FOLLOWER
I20251211 09:11:34.564092 10525 consensus_queue.cc:260] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.564200 10526 tablet_bootstrap.cc:492] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda: Bootstrap starting.
I20251211 09:11:34.564245 10525 ts_tablet_manager.cc:1434] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:34.564327 10435 heartbeater.cc:499] Master 127.0.119.254:38637 was elected leader, sending a full tablet report...
I20251211 09:11:34.564518 10527 tablet_bootstrap.cc:492] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657: No bootstrap required, opened a new log
I20251211 09:11:34.564570 10527 ts_tablet_manager.cc:1403] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:34.564715 10527 raft_consensus.cc:359] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.564777 10527 raft_consensus.cc:385] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:34.564811 10527 raft_consensus.cc:740] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308a7bd702b94ee3b83a579292b3a657, State: Initialized, Role: FOLLOWER
I20251211 09:11:34.564898 10527 consensus_queue.cc:260] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.564946 10526 tablet_bootstrap.cc:654] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:34.565054 10527 ts_tablet_manager.cc:1434] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:34.565092 10510 heartbeater.cc:499] Master 127.0.119.254:38637 was elected leader, sending a full tablet report...
I20251211 09:11:34.565606 10526 tablet_bootstrap.cc:492] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda: No bootstrap required, opened a new log
I20251211 09:11:34.565663 10526 ts_tablet_manager.cc:1403] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:34.565795 10526 raft_consensus.cc:359] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.565855 10526 raft_consensus.cc:385] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:34.565874 10526 raft_consensus.cc:740] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6763afe5b56401ca43c3e40cc60bbda, State: Initialized, Role: FOLLOWER
I20251211 09:11:34.565913 10526 consensus_queue.cc:260] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.566056 10526 ts_tablet_manager.cc:1434] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20251211 09:11:34.566104 10358 heartbeater.cc:499] Master 127.0.119.254:38637 was elected leader, sending a full tablet report...
I20251211 09:11:34.567466 10530 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:34.567513 10530 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.567620 10530 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:34.570044 10332 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda" is_pre_election: true
I20251211 09:11:34.570111 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657" is_pre_election: true
I20251211 09:11:34.570129 10332 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in term 0.
I20251211 09:11:34.570173 10484 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in term 0.
I20251211 09:11:34.570307 10371 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657, 8d6135bfcd4b4d27aa24e961f8ea84b3; no voters:
I20251211 09:11:34.570401 10530 raft_consensus.cc:2804] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:11:34.570443 10530 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:34.570461 10530 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:34.570979 10530 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.571074 10530 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 1 election: Requested vote from peers f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:34.571218 10332 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:34.571252 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:34.571282 10332 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:34.571295 10484 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:34.572014 10484 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in term 1.
I20251211 09:11:34.572094 10332 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in term 1.
I20251211 09:11:34.572155 10371 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657, 8d6135bfcd4b4d27aa24e961f8ea84b3; no voters:
I20251211 09:11:34.572229 10530 raft_consensus.cc:2804] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:34.572338 10530 raft_consensus.cc:697] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 1 LEADER]: Becoming Leader. State: Replica: 8d6135bfcd4b4d27aa24e961f8ea84b3, State: Running, Role: LEADER
I20251211 09:11:34.572378 10530 consensus_queue.cc:237] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:34.572819 10227 catalog_manager.cc:5654] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194). New cstate: current_term: 1 leader_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:34.588096 10484 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 1 FOLLOWER]: Refusing update from remote peer 8d6135bfcd4b4d27aa24e961f8ea84b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:34.588104 10332 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 1 FOLLOWER]: Refusing update from remote peer 8d6135bfcd4b4d27aa24e961f8ea84b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:34.588341 10530 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:34.588456 10535 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:44.609580 10581 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8d6135bfcd4b4d27aa24e961f8ea84b3)
I20251211 09:11:44.609658 10581 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:44.610312 10581 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.610471 10581 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [CANDIDATE]: Term 2 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:44.612936 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "f6763afe5b56401ca43c3e40cc60bbda" candidate_term: 2 candidate_status { last_received { term: 1 index: 14776 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:44.612960 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "f6763afe5b56401ca43c3e40cc60bbda" candidate_term: 2 candidate_status { last_received { term: 1 index: 14776 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:44.613229 10297 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6763afe5b56401ca43c3e40cc60bbda; no voters: 308a7bd702b94ee3b83a579292b3a657, 8d6135bfcd4b4d27aa24e961f8ea84b3
I20251211 09:11:44.613365 10581 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251211 09:11:44.613716 10331 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 1. Current term is 2. Ops: []
I20251211 09:11:44.613938 10560 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 }, Status: INVALID_TERM, Last received: 1.14776, Next index: 14777, Last known committed idx: 14776, Time since last communication: 0.000s
I20251211 09:11:44.637720 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8d6135bfcd4b4d27aa24e961f8ea84b3)
I20251211 09:11:44.637792 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:44.638523 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.638648 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 2 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 1. Current term is 2. Ops: []
I20251211 09:11:44.638736 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 2 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:44.639135 10535 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 1.14776, Next index: 14777, Last known committed idx: 14776, Time since last communication: 0.000s
I20251211 09:11:44.641275 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 2 candidate_status { last_received { term: 1 index: 14776 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:44.641326 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 2 candidate_status { last_received { term: 1 index: 14776 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:44.641367 10331 raft_consensus.cc:2393] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 308a7bd702b94ee3b83a579292b3a657 in current term 2: Already voted for candidate f6763afe5b56401ca43c3e40cc60bbda in this term.
I20251211 09:11:44.641577 10447 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:44.641696 10586 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251211 09:11:44.641752 10331 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 1. Current term is 2. Ops: []
I20251211 09:11:44.641930 10547 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 }, Status: INVALID_TERM, Last received: 1.14776, Next index: 14777, Last known committed idx: 14776, Time since last communication: 0.000s
I20251211 09:11:44.645108 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 2 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 1. Current term is 2. Ops: [1.14777-1.14777]
I20251211 09:11:44.645123 10331 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 1. Current term is 2. Ops: [1.14777-1.14777]
I20251211 09:11:44.645344 10535 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 1.14776, Next index: 14777, Last known committed idx: 14776, Time since last communication: 0.000s
I20251211 09:11:44.645470 10547 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 }, Status: INVALID_TERM, Last received: 1.14776, Next index: 14777, Last known committed idx: 14776, Time since last communication: 0.000s
I20251211 09:11:44.652664 10581 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:44.652714 10581 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:44.653374 10581 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.653499 10581 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [CANDIDATE]: Term 3 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:44.653609 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "f6763afe5b56401ca43c3e40cc60bbda" candidate_term: 3 candidate_status { last_received { term: 1 index: 14776 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:44.653671 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "f6763afe5b56401ca43c3e40cc60bbda" candidate_term: 3 candidate_status { last_received { term: 1 index: 14776 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:44.653728 10484 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:44.654263 10484 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6763afe5b56401ca43c3e40cc60bbda in term 3.
I20251211 09:11:44.654448 10294 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657, f6763afe5b56401ca43c3e40cc60bbda; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3
I20251211 09:11:44.654560 10581 raft_consensus.cc:2804] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 3 FOLLOWER]: Leader election won for term 3
I20251211 09:11:44.654706 10581 raft_consensus.cc:697] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 3 LEADER]: Becoming Leader. State: Replica: f6763afe5b56401ca43c3e40cc60bbda, State: Running, Role: LEADER
I20251211 09:11:44.654748 10581 consensus_queue.cc:237] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14776, Committed index: 14776, Last appended: 1.14776, Last appended by leader: 14776, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.655189 10219 catalog_manager.cc:5654] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda reported cstate change: term changed from 1 to 3, leader changed from 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194) to f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193). New cstate: current_term: 3 leader_uuid: "f6763afe5b56401ca43c3e40cc60bbda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:44.656147 10560 raft_consensus.cc:3055] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 1 LEADER]: Stepping down as leader of term 1
I20251211 09:11:44.656186 10560 raft_consensus.cc:740] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d6135bfcd4b4d27aa24e961f8ea84b3, State: Running, Role: LEADER
I20251211 09:11:44.656232 10560 consensus_queue.cc:260] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14776, Committed index: 14776, Last appended: 1.14777, Last appended by leader: 14777, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.656308 10560 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 1 FOLLOWER]: Advancing to term 2
I20251211 09:11:44.682667 10484 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 3 FOLLOWER]: Refusing update from remote peer f6763afe5b56401ca43c3e40cc60bbda: Log matching property violated. Preceding OpId in replica: term: 1 index: 14776. Preceding OpId from leader: term: 3 index: 14777. (index mismatch)
I20251211 09:11:44.682941 10581 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14777, Last known committed idx: 14776, Time since last communication: 0.000s
I20251211 09:11:44.685277 10408 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 2 FOLLOWER]: Advancing to term 3
I20251211 09:11:44.685982 10408 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 3 FOLLOWER]: Refusing update from remote peer f6763afe5b56401ca43c3e40cc60bbda: Log matching property violated. Preceding OpId in replica: term: 1 index: 14777. Preceding OpId from leader: term: 3 index: 14777. (term mismatch)
I20251211 09:11:44.686021 10408 pending_rounds.cc:85] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: Aborting all ops after (but not including) 14776
I20251211 09:11:44.686041 10408 pending_rounds.cc:107] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: Aborting uncommitted PARTICIPANT_OP operation due to leader change: 1.14777
W20251211 09:11:44.686085 10408 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50296: Aborted: Op aborted by new leader
I20251211 09:11:44.686321 10581 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14777, Last known committed idx: 14776, Time since last communication: 0.000s
I20251211 09:11:44.800873 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6763afe5b56401ca43c3e40cc60bbda)
I20251211 09:11:44.800956 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:11:44.801731 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.801863 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 4 FOLLOWER]: Rejecting Update request from peer f6763afe5b56401ca43c3e40cc60bbda for earlier term 3. Current term is 4. Ops: []
I20251211 09:11:44.801895 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 4 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:44.802047 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 4 candidate_status { last_received { term: 3 index: 14779 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:44.802083 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 4 candidate_status { last_received { term: 3 index: 14779 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:44.802134 10596 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 3.14779, Next index: 14780, Last known committed idx: 14779, Time since last communication: 0.000s
I20251211 09:11:44.802310 10447 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:44.802392 10586 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20251211 09:11:44.811896 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 4 FOLLOWER]: Rejecting Update request from peer f6763afe5b56401ca43c3e40cc60bbda for earlier term 3. Current term is 4. Ops: [3.14780-3.14780]
I20251211 09:11:44.812140 10591 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 3.14779, Next index: 14780, Last known committed idx: 14779, Time since last communication: 0.000s
I20251211 09:11:44.842109 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:44.842202 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 4 FOLLOWER]: Advancing to term 5
I20251211 09:11:44.842809 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.842945 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 5 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:44.843140 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 5 candidate_status { last_received { term: 3 index: 14779 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:44.843175 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 5 candidate_status { last_received { term: 3 index: 14779 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:44.843358 10447 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:44.843454 10586 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20251211 09:11:44.843590 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Rejecting Update request from peer f6763afe5b56401ca43c3e40cc60bbda for earlier term 3. Current term is 5. Ops: [3.14780-3.14780]
I20251211 09:11:44.843849 10596 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 3.14779, Next index: 14780, Last known committed idx: 14779, Time since last communication: 0.000s
I20251211 09:11:44.847168 10581 raft_consensus.cc:3055] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 3 LEADER]: Stepping down as leader of term 3
I20251211 09:11:44.847200 10581 raft_consensus.cc:740] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6763afe5b56401ca43c3e40cc60bbda, State: Running, Role: LEADER
I20251211 09:11:44.847263 10581 consensus_queue.cc:260] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14780, Committed index: 14780, Last appended: 3.14780, Last appended by leader: 14780, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.847339 10581 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:11:44.866540 10560 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6763afe5b56401ca43c3e40cc60bbda)
I20251211 09:11:44.866632 10560 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 3 FOLLOWER]: Advancing to term 4
I20251211 09:11:44.867204 10560 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.867326 10560 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 4 election: Requested vote from peers f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:44.867552 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 4 candidate_status { last_received { term: 3 index: 14780 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:44.867552 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 4 candidate_status { last_received { term: 3 index: 14780 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:44.867663 10484 raft_consensus.cc:2368] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 4. Current term is 5.
I20251211 09:11:44.867832 10371 leader_election.cc:400] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 4 election: Vote denied by peer 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537) with higher term. Message: Invalid argument: T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 4. Current term is 5.
I20251211 09:11:44.867892 10371 leader_election.cc:403] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20251211 09:11:44.867969 10560 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 4 FOLLOWER]: Advancing to term 5
I20251211 09:11:44.868280 10331 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in term 4.
I20251211 09:11:44.868597 10560 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537) with higher term. Message: Invalid argument: T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 4. Current term is 5.
I20251211 09:11:44.877776 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:44.877846 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 5 FOLLOWER]: Advancing to term 6
I20251211 09:11:44.878443 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.878594 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 6 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:44.878768 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 6 candidate_status { last_received { term: 3 index: 14779 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:44.878844 10408 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 5 FOLLOWER]: Advancing to term 6
I20251211 09:11:44.878769 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 6 candidate_status { last_received { term: 3 index: 14779 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:44.878883 10331 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 4 FOLLOWER]: Advancing to term 6
I20251211 09:11:44.879388 10331 raft_consensus.cc:2410] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 308a7bd702b94ee3b83a579292b3a657 for term 6 because replica has last-logged OpId of term: 3 index: 14780, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 14779.
I20251211 09:11:44.879446 10408 raft_consensus.cc:2410] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 308a7bd702b94ee3b83a579292b3a657 for term 6 because replica has last-logged OpId of term: 3 index: 14780, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 14779.
I20251211 09:11:44.879612 10450 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:44.879711 10586 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20251211 09:11:44.903959 10560 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:44.904044 10560 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 6 FOLLOWER]: Advancing to term 7
I20251211 09:11:44.904686 10560 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.904825 10560 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 7 election: Requested vote from peers f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:44.905040 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 7 candidate_status { last_received { term: 3 index: 14780 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:44.905104 10484 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 6 FOLLOWER]: Advancing to term 7
I20251211 09:11:44.905057 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 7 candidate_status { last_received { term: 3 index: 14780 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:44.905138 10331 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 6 FOLLOWER]: Advancing to term 7
I20251211 09:11:44.905680 10484 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in term 7.
I20251211 09:11:44.905745 10331 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in term 7.
I20251211 09:11:44.905851 10371 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657, 8d6135bfcd4b4d27aa24e961f8ea84b3; no voters:
I20251211 09:11:44.905972 10560 raft_consensus.cc:2804] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 7 FOLLOWER]: Leader election won for term 7
I20251211 09:11:44.906042 10560 raft_consensus.cc:697] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 7 LEADER]: Becoming Leader. State: Replica: 8d6135bfcd4b4d27aa24e961f8ea84b3, State: Running, Role: LEADER
I20251211 09:11:44.906100 10560 consensus_queue.cc:237] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14780, Committed index: 14780, Last appended: 3.14780, Last appended by leader: 14780, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.906519 10219 catalog_manager.cc:5654] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 reported cstate change: term changed from 3 to 7, leader changed from f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193) to 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194). New cstate: current_term: 7 leader_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:44.933166 10484 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 7 FOLLOWER]: Refusing update from remote peer 8d6135bfcd4b4d27aa24e961f8ea84b3: Log matching property violated. Preceding OpId in replica: term: 3 index: 14779. Preceding OpId from leader: term: 7 index: 14781. (index mismatch)
I20251211 09:11:44.933426 10560 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14781, Last known committed idx: 14779, Time since last communication: 0.000s
I20251211 09:11:44.934599 10331 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 7 FOLLOWER]: Refusing update from remote peer 8d6135bfcd4b4d27aa24e961f8ea84b3: Log matching property violated. Preceding OpId in replica: term: 3 index: 14780. Preceding OpId from leader: term: 7 index: 14781. (index mismatch)
I20251211 09:11:44.934762 10560 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14781, Last known committed idx: 14780, Time since last communication: 0.000s
W20251211 09:11:44.935544 10322 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:45474: Illegal state: replica f6763afe5b56401ca43c3e40cc60bbda is not leader of this config: current role FOLLOWER
I20251211 09:11:44.972415 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8d6135bfcd4b4d27aa24e961f8ea84b3)
I20251211 09:11:44.972492 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 7 FOLLOWER]: Advancing to term 8
I20251211 09:11:44.973119 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:44.973291 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 8 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:44.973413 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 8 candidate_status { last_received { term: 7 index: 14782 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:44.973471 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 8 candidate_status { last_received { term: 7 index: 14782 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:44.973659 10447 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:44.973742 10586 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20251211 09:11:44.976423 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 8 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 7. Current term is 8. Ops: []
I20251211 09:11:44.976629 10530 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 7.14782, Next index: 14783, Last known committed idx: 14782, Time since last communication: 0.000s
I20251211 09:11:44.987815 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 8 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 7. Current term is 8. Ops: [7.14783-7.14783]
I20251211 09:11:44.988018 10560 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 7.14782, Next index: 14783, Last known committed idx: 14782, Time since last communication: 0.000s
I20251211 09:11:45.017369 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:45.017460 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 8 FOLLOWER]: Advancing to term 9
I20251211 09:11:45.018092 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.018245 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 9 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:45.018483 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 9 candidate_status { last_received { term: 7 index: 14782 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:45.018468 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 9 candidate_status { last_received { term: 7 index: 14782 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:45.018622 10331 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 7 FOLLOWER]: Advancing to term 9
I20251211 09:11:45.019196 10331 raft_consensus.cc:2410] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 308a7bd702b94ee3b83a579292b3a657 for term 9 because replica has last-logged OpId of term: 7 index: 14783, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 14782.
I20251211 09:11:45.019268 10581 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:45.019330 10581 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 9 FOLLOWER]: Advancing to term 10
I20251211 09:11:45.019426 10447 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:45.019553 10586 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20251211 09:11:45.019971 10581 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.020102 10581 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [CANDIDATE]: Term 10 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:45.020205 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "f6763afe5b56401ca43c3e40cc60bbda" candidate_term: 10 candidate_status { last_received { term: 7 index: 14783 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:45.020251 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "f6763afe5b56401ca43c3e40cc60bbda" candidate_term: 10 candidate_status { last_received { term: 7 index: 14783 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:45.020337 10484 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 9 FOLLOWER]: Advancing to term 10
I20251211 09:11:45.020807 10484 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6763afe5b56401ca43c3e40cc60bbda in term 10.
I20251211 09:11:45.020949 10294 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657, f6763afe5b56401ca43c3e40cc60bbda; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3
I20251211 09:11:45.021034 10581 raft_consensus.cc:2804] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 10 FOLLOWER]: Leader election won for term 10
I20251211 09:11:45.021109 10581 raft_consensus.cc:697] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 10 LEADER]: Becoming Leader. State: Replica: f6763afe5b56401ca43c3e40cc60bbda, State: Running, Role: LEADER
I20251211 09:11:45.021165 10581 consensus_queue.cc:237] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14783, Committed index: 14783, Last appended: 7.14783, Last appended by leader: 14783, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.021620 10219 catalog_manager.cc:5654] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda reported cstate change: term changed from 7 to 10, leader changed from 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194) to f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193). New cstate: current_term: 10 leader_uuid: "f6763afe5b56401ca43c3e40cc60bbda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:45.022656 10331 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 10 LEADER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 7. Current term is 10. Ops: []
I20251211 09:11:45.022838 10547 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 }, Status: INVALID_TERM, Last received: 7.14783, Next index: 14784, Last known committed idx: 14783, Time since last communication: 0.000s
I20251211 09:11:45.022945 10547 consensus_queue.cc:1243] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [LEADER]: Peer f6763afe5b56401ca43c3e40cc60bbda log is divergent from this leader: its last log entry 10.14784 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14783
I20251211 09:11:45.023159 10530 raft_consensus.cc:3055] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 7 LEADER]: Stepping down as leader of term 7
I20251211 09:11:45.023176 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 10 FOLLOWER]: Rejecting Update request from peer 8d6135bfcd4b4d27aa24e961f8ea84b3 for earlier term 7. Current term is 10. Ops: [7.14783-7.14783]
I20251211 09:11:45.023198 10530 raft_consensus.cc:740] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8d6135bfcd4b4d27aa24e961f8ea84b3, State: Running, Role: LEADER
I20251211 09:11:45.023239 10530 consensus_queue.cc:260] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14783, Committed index: 14783, Last appended: 7.14783, Last appended by leader: 14783, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.023321 10530 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 7 FOLLOWER]: Advancing to term 8
I20251211 09:11:45.051488 10535 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:45.051591 10535 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 8 FOLLOWER]: Advancing to term 9
I20251211 09:11:45.051895 10484 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 10 FOLLOWER]: Refusing update from remote peer f6763afe5b56401ca43c3e40cc60bbda: Log matching property violated. Preceding OpId in replica: term: 7 index: 14782. Preceding OpId from leader: term: 10 index: 14784. (index mismatch)
I20251211 09:11:45.052152 10581 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14784, Last known committed idx: 14782, Time since last communication: 0.000s
I20251211 09:11:45.052407 10535 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.052532 10535 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 9 election: Requested vote from peers f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:45.052651 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 9 candidate_status { last_received { term: 7 index: 14783 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:45.052683 10483 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 9 candidate_status { last_received { term: 7 index: 14783 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:45.052922 10371 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6135bfcd4b4d27aa24e961f8ea84b3; no voters: 308a7bd702b94ee3b83a579292b3a657, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:45.052997 10535 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20251211 09:11:45.055224 10408 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 9 FOLLOWER]: Advancing to term 10
I20251211 09:11:45.055781 10408 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 10 FOLLOWER]: Refusing update from remote peer f6763afe5b56401ca43c3e40cc60bbda: Log matching property violated. Preceding OpId in replica: term: 7 index: 14783. Preceding OpId from leader: term: 10 index: 14784. (index mismatch)
I20251211 09:11:45.056005 10596 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14784, Last known committed idx: 14783, Time since last communication: 0.000s
W20251211 09:11:45.056722 10398 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50296: Illegal state: replica 8d6135bfcd4b4d27aa24e961f8ea84b3 is not leader of this config: current role FOLLOWER
I20251211 09:11:45.114118 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6763afe5b56401ca43c3e40cc60bbda)
I20251211 09:11:45.114202 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 10 FOLLOWER]: Advancing to term 11
I20251211 09:11:45.114776 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.114909 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 11 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:45.115097 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 11 candidate_status { last_received { term: 10 index: 14785 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:45.115097 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 11 candidate_status { last_received { term: 10 index: 14785 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:45.115357 10447 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657; no voters: 8d6135bfcd4b4d27aa24e961f8ea84b3, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:45.115496 10586 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20251211 09:11:45.116804 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 11 FOLLOWER]: Rejecting Update request from peer f6763afe5b56401ca43c3e40cc60bbda for earlier term 10. Current term is 11. Ops: []
I20251211 09:11:45.116969 10581 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 10.14785, Next index: 14786, Last known committed idx: 14785, Time since last communication: 0.000s
I20251211 09:11:45.119719 10530 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6763afe5b56401ca43c3e40cc60bbda)
I20251211 09:11:45.119767 10530 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 10 FOLLOWER]: Advancing to term 11
I20251211 09:11:45.120357 10530 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.120450 10530 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 11 election: Requested vote from peers f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:45.120611 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 11 candidate_status { last_received { term: 10 index: 14785 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:45.120611 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 11 candidate_status { last_received { term: 10 index: 14785 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
I20251211 09:11:45.120734 10484 raft_consensus.cc:2393] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8d6135bfcd4b4d27aa24e961f8ea84b3 in current term 11: Already voted for candidate 308a7bd702b94ee3b83a579292b3a657 in this term.
I20251211 09:11:45.120847 10371 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6135bfcd4b4d27aa24e961f8ea84b3; no voters: 308a7bd702b94ee3b83a579292b3a657, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:45.120945 10530 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20251211 09:11:45.122102 10408 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 11 FOLLOWER]: Rejecting Update request from peer f6763afe5b56401ca43c3e40cc60bbda for earlier term 10. Current term is 11. Ops: []
I20251211 09:11:45.122308 10591 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 }, Status: INVALID_TERM, Last received: 10.14785, Next index: 14786, Last known committed idx: 14785, Time since last communication: 0.000s
I20251211 09:11:45.146139 10484 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 11 FOLLOWER]: Rejecting Update request from peer f6763afe5b56401ca43c3e40cc60bbda for earlier term 10. Current term is 11. Ops: []
I20251211 09:11:45.146395 10581 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 }, Status: INVALID_TERM, Last received: 10.14785, Next index: 14786, Last known committed idx: 14785, Time since last communication: 0.000s
I20251211 09:11:45.148726 10408 raft_consensus.cc:1240] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 11 FOLLOWER]: Rejecting Update request from peer f6763afe5b56401ca43c3e40cc60bbda for earlier term 10. Current term is 11. Ops: []
I20251211 09:11:45.148953 10581 consensus_queue.cc:1059] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 }, Status: INVALID_TERM, Last received: 10.14785, Next index: 14786, Last known committed idx: 14785, Time since last communication: 0.000s
I20251211 09:11:45.150280 10586 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:45.150332 10586 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 11 FOLLOWER]: Advancing to term 12
I20251211 09:11:45.150895 10586 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.151062 10586 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 12 election: Requested vote from peers 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855), f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127)
I20251211 09:11:45.151186 10408 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 12 candidate_status { last_received { term: 10 index: 14785 } } ignore_live_leader: false dest_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3"
I20251211 09:11:45.151216 10331 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "308a7bd702b94ee3b83a579292b3a657" candidate_term: 12 candidate_status { last_received { term: 10 index: 14785 } } ignore_live_leader: false dest_uuid: "f6763afe5b56401ca43c3e40cc60bbda"
I20251211 09:11:45.151273 10408 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 11 FOLLOWER]: Advancing to term 12
I20251211 09:11:45.151795 10408 raft_consensus.cc:2468] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308a7bd702b94ee3b83a579292b3a657 in term 12.
I20251211 09:11:45.151943 10450 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308a7bd702b94ee3b83a579292b3a657, 8d6135bfcd4b4d27aa24e961f8ea84b3; no voters: f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:45.152021 10586 raft_consensus.cc:2804] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 12 FOLLOWER]: Leader election won for term 12
I20251211 09:11:45.152118 10586 raft_consensus.cc:697] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 12 LEADER]: Becoming Leader. State: Replica: 308a7bd702b94ee3b83a579292b3a657, State: Running, Role: LEADER
I20251211 09:11:45.152159 10586 consensus_queue.cc:237] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14785, Committed index: 14785, Last appended: 10.14785, Last appended by leader: 14785, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.152565 10228 catalog_manager.cc:5654] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 reported cstate change: term changed from 10 to 12, leader changed from f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193) to 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195). New cstate: current_term: 12 leader_uuid: "308a7bd702b94ee3b83a579292b3a657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } health_report { overall_health: HEALTHY } } }
I20251211 09:11:45.163177 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:11:45.165941 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:45.166051 479 tablet_replica.cc:333] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda: stopping tablet replica
I20251211 09:11:45.166100 479 raft_consensus.cc:2243] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 10 LEADER]: Raft consensus shutting down.
W20251211 09:11:45.176967 10447 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 21 similar messages]
W20251211 09:11:45.177345 10447 consensus_peers.cc:597] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 -> Peer f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127): Couldn't send request to peer f6763afe5b56401ca43c3e40cc60bbda. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251211 09:11:45.187901 10408 raft_consensus.cc:1275] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 12 FOLLOWER]: Refusing update from remote peer 308a7bd702b94ee3b83a579292b3a657: Log matching property violated. Preceding OpId in replica: term: 10 index: 14785. Preceding OpId from leader: term: 12 index: 14786. (index mismatch)
I20251211 09:11:45.188139 10586 consensus_queue.cc:1048] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14786, Last known committed idx: 14785, Time since last communication: 0.000s
W20251211 09:11:45.200827 10581 raft_consensus.cc:932] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 10 LEADER]: Unable to handle notification of new term (11): Illegal state: RaftConsensus is not running: State = Stopping
I20251211 09:11:45.200963 479 raft_consensus.cc:2272] T 44e9993e1ff645deb5ce9f17c6593acc P f6763afe5b56401ca43c3e40cc60bbda [term 10 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:45.219604 10530 raft_consensus.cc:493] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 308a7bd702b94ee3b83a579292b3a657)
I20251211 09:11:45.219709 10530 raft_consensus.cc:3060] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 12 FOLLOWER]: Advancing to term 13
I20251211 09:11:45.220259 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:11:45.220417 10530 raft_consensus.cc:515] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 45855 } } peers { permanent_uuid: "f6763afe5b56401ca43c3e40cc60bbda" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 38127 } } peers { permanent_uuid: "308a7bd702b94ee3b83a579292b3a657" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 36537 } }
I20251211 09:11:45.220569 10530 leader_election.cc:290] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 13 election: Requested vote from peers f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127), 308a7bd702b94ee3b83a579292b3a657 (127.0.119.195:36537)
I20251211 09:11:45.221007 10484 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44e9993e1ff645deb5ce9f17c6593acc" candidate_uuid: "8d6135bfcd4b4d27aa24e961f8ea84b3" candidate_term: 13 candidate_status { last_received { term: 12 index: 14786 } } ignore_live_leader: false dest_uuid: "308a7bd702b94ee3b83a579292b3a657"
W20251211 09:11:45.221302 10371 leader_election.cc:336] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f6763afe5b56401ca43c3e40cc60bbda (127.0.119.193:38127): Network error: Client connection negotiation failed: client connection to 127.0.119.193:38127: connect: Connection refused (error 111)
I20251211 09:11:45.221362 10371 leader_election.cc:304] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d6135bfcd4b4d27aa24e961f8ea84b3; no voters: 308a7bd702b94ee3b83a579292b3a657, f6763afe5b56401ca43c3e40cc60bbda
I20251211 09:11:45.221423 10530 raft_consensus.cc:2749] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20251211 09:11:45.221607 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
W20251211 09:11:45.223203 10450 consensus_peers.cc:597] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 -> Peer 8d6135bfcd4b4d27aa24e961f8ea84b3 (127.0.119.194:45855): Couldn't send request to peer 8d6135bfcd4b4d27aa24e961f8ea84b3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20251211 09:11:45.224870 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:45.224959 479 tablet_replica.cc:333] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3: stopping tablet replica
I20251211 09:11:45.225025 479 raft_consensus.cc:2243] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20251211 09:11:45.225072 479 raft_consensus.cc:2272] T 44e9993e1ff645deb5ce9f17c6593acc P 8d6135bfcd4b4d27aa24e961f8ea84b3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:45.238992 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:11:45.239853 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:11:45.242880 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:11:45.243017 479 tablet_replica.cc:333] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657: stopping tablet replica
I20251211 09:11:45.243084 479 raft_consensus.cc:2243] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 12 LEADER]: Raft consensus shutting down.
I20251211 09:11:45.243147 479 raft_consensus.cc:2272] T 44e9993e1ff645deb5ce9f17c6593acc P 308a7bd702b94ee3b83a579292b3a657 [term 12 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:45.266539 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:11:45.267300 479 master.cc:561] Master@127.0.119.254:38637 shutting down...
I20251211 09:11:45.269361 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:11:45.269439 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:11:45.269459 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 583d3ebd1e6f4aea83a129e552747b73: stopping tablet replica
I20251211 09:11:45.281111 479 master.cc:583] Master@127.0.119.254:38637 shutdown complete.
[ OK ] TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm (10865 ms)
[----------] 2 tests from TxnParticipantElectionStormITest (28067 ms total)
[----------] 2 tests from ShouldGCWals/ParticipantCopyITest
[ RUN ] ShouldGCWals/ParticipantCopyITest.TestCopyParticipantOps/0
I20251211 09:11:45.300089 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:46505
I20251211 09:11:45.300232 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:11:45.301518 479 server_base.cc:1047] running on GCE node
W20251211 09:11:45.301579 10602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:45.301632 10603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:45.301630 10605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:45.301777 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:45.301808 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:45.301823 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444305301824 us; error 0 us; skew 500 ppm
I20251211 09:11:45.302356 479 webserver.cc:492] Webserver started at http://127.0.119.254:34949/ using document root <none> and password file <none>
I20251211 09:11:45.302448 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:45.302495 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:45.302546 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:45.302785 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "91a1f46df3034a81a40c0aa762634cef"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.303620 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:45.304019 10610 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.304147 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.304199 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "91a1f46df3034a81a40c0aa762634cef"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.304252 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:45.324278 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:45.324446 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:45.326951 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:46505
I20251211 09:11:45.332055 10662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:46505 every 8 connection(s)
I20251211 09:11:45.332207 10663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:45.333182 10663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef: Bootstrap starting.
I20251211 09:11:45.333484 10663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:45.333938 10663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef: No bootstrap required, opened a new log
I20251211 09:11:45.334062 10663 raft_consensus.cc:359] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a1f46df3034a81a40c0aa762634cef" member_type: VOTER }
I20251211 09:11:45.334121 10663 raft_consensus.cc:385] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:45.334146 10663 raft_consensus.cc:740] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91a1f46df3034a81a40c0aa762634cef, State: Initialized, Role: FOLLOWER
I20251211 09:11:45.334201 10663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a1f46df3034a81a40c0aa762634cef" member_type: VOTER }
I20251211 09:11:45.334241 10663 raft_consensus.cc:399] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:11:45.334265 10663 raft_consensus.cc:493] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:11:45.334295 10663 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:45.334728 10663 raft_consensus.cc:515] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a1f46df3034a81a40c0aa762634cef" member_type: VOTER }
I20251211 09:11:45.334780 10663 leader_election.cc:304] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91a1f46df3034a81a40c0aa762634cef; no voters:
I20251211 09:11:45.334873 10663 leader_election.cc:290] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:11:45.334924 10666 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:45.334996 10663 sys_catalog.cc:565] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:11:45.335052 10666 raft_consensus.cc:697] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 1 LEADER]: Becoming Leader. State: Replica: 91a1f46df3034a81a40c0aa762634cef, State: Running, Role: LEADER
I20251211 09:11:45.335101 10666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a1f46df3034a81a40c0aa762634cef" member_type: VOTER }
I20251211 09:11:45.335281 10667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91a1f46df3034a81a40c0aa762634cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a1f46df3034a81a40c0aa762634cef" member_type: VOTER } }
I20251211 09:11:45.335340 10667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:45.335462 10668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91a1f46df3034a81a40c0aa762634cef. Latest consensus state: current_term: 1 leader_uuid: "91a1f46df3034a81a40c0aa762634cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91a1f46df3034a81a40c0aa762634cef" member_type: VOTER } }
I20251211 09:11:45.335520 10668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [sys.catalog]: This master's current role is: LEADER
I20251211 09:11:45.335601 10670 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:11:45.335745 10670 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:11:45.336246 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:11:45.336259 10670 catalog_manager.cc:1357] Generated new cluster ID: 8fc4a794410c4c9fac507e7e532700dc
I20251211 09:11:45.336309 10670 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:11:45.347443 10670 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:11:45.347836 10670 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:11:45.361001 10670 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef: Generated new TSK 0
I20251211 09:11:45.361083 10670 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:11:45.368098 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:45.369364 10687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:45.369364 10685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:45.369526 479 server_base.cc:1047] running on GCE node
W20251211 09:11:45.369561 10684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:45.369678 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:45.369710 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:45.369731 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444305369731 us; error 0 us; skew 500 ppm
I20251211 09:11:45.370270 479 webserver.cc:492] Webserver started at http://127.0.119.193:39663/ using document root <none> and password file <none>
I20251211 09:11:45.370355 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:45.370398 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:45.370446 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:45.370682 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "5e829aedbeb240b0a75e81982c601f04"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.371461 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:45.371850 10692 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.371963 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.371999 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "5e829aedbeb240b0a75e81982c601f04"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.372052 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:45.375425 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:45.375604 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:45.375720 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:45.375888 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:45.375913 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.375943 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:45.375968 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.378509 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:36689
I20251211 09:11:45.378537 10755 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:36689 every 8 connection(s)
I20251211 09:11:45.378805 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:45.379810 10761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:45.379875 10760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:45.379978 10763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:45.380179 479 server_base.cc:1047] running on GCE node
I20251211 09:11:45.380296 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:45.380326 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:45.380354 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444305380354 us; error 0 us; skew 500 ppm
I20251211 09:11:45.380959 479 webserver.cc:492] Webserver started at http://127.0.119.194:36429/ using document root <none> and password file <none>
I20251211 09:11:45.381047 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:45.381086 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:45.381127 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:45.381474 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "0746569747b045f2ae635513af494c62"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.382146 10756 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46505
I20251211 09:11:45.382205 10756 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:45.382299 10756 heartbeater.cc:507] Master 127.0.119.254:46505 requested a full tablet report, sending...
I20251211 09:11:45.382390 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:45.382511 10627 ts_manager.cc:194] Registered new tserver with Master: 5e829aedbeb240b0a75e81982c601f04 (127.0.119.193:36689)
I20251211 09:11:45.382843 10768 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.382964 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.383009 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "0746569747b045f2ae635513af494c62"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.383057 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:45.383075 10627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34564
I20251211 09:11:45.399624 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:45.399765 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:45.399871 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:45.400030 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:45.400064 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.400084 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:45.400111 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.402662 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:39597
I20251211 09:11:45.402698 10831 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:39597 every 8 connection(s)
I20251211 09:11:45.403026 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:11:45.404071 10835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:45.404147 10838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:11:45.404181 10836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:11:45.404347 479 server_base.cc:1047] running on GCE node
I20251211 09:11:45.404469 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:11:45.404500 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:11:45.404515 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444305404515 us; error 0 us; skew 500 ppm
I20251211 09:11:45.405077 479 webserver.cc:492] Webserver started at http://127.0.119.195:33323/ using document root <none> and password file <none>
I20251211 09:11:45.405154 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:11:45.405201 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:11:45.405274 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:11:45.405555 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "5d155cbee4fb47dc9016503144988821"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.406416 10832 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46505
I20251211 09:11:45.406492 10832 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:45.406595 10832 heartbeater.cc:507] Master 127.0.119.254:46505 requested a full tablet report, sending...
I20251211 09:11:45.406602 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:45.406858 10627 ts_manager.cc:194] Registered new tserver with Master: 0746569747b045f2ae635513af494c62 (127.0.119.194:39597)
I20251211 09:11:45.407161 10843 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.407269 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.407300 10627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34572
I20251211 09:11:45.407315 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "5d155cbee4fb47dc9016503144988821"
format_stamp: "Formatted at 2025-12-11 09:11:45 on dist-test-slave-hb70"
I20251211 09:11:45.407374 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:11:45.418120 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:11:45.418272 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:11:45.418401 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:11:45.418555 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:11:45.418578 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.418602 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:11:45.418620 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.421613 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:39045
I20251211 09:11:45.421674 10906 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:39045 every 8 connection(s)
I20251211 09:11:45.424350 10907 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46505
I20251211 09:11:45.424399 10907 heartbeater.cc:461] Registering TS with master...
I20251211 09:11:45.424470 10907 heartbeater.cc:507] Master 127.0.119.254:46505 requested a full tablet report, sending...
I20251211 09:11:45.424675 10627 ts_manager.cc:194] Registered new tserver with Master: 5d155cbee4fb47dc9016503144988821 (127.0.119.195:39045)
I20251211 09:11:45.424980 10627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34580
I20251211 09:11:45.425163 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003385368s
I20251211 09:11:45.425522 479 test_util.cc:276] Using random seed: -2001595278
I20251211 09:11:45.429579 10627 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34596:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:11:45.429708 10627 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:11:45.434098 10720 tablet_service.cc:1505] Processing CreateTablet for tablet 4f79787fcc1e447bbbda048ceb8174f6 (DEFAULT_TABLE table=test-workload [id=2f487eb1ee2d4b35a16c31d7f671ec0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:45.434202 10871 tablet_service.cc:1505] Processing CreateTablet for tablet 4f79787fcc1e447bbbda048ceb8174f6 (DEFAULT_TABLE table=test-workload [id=2f487eb1ee2d4b35a16c31d7f671ec0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:45.434252 10720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f79787fcc1e447bbbda048ceb8174f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:45.434316 10871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f79787fcc1e447bbbda048ceb8174f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:45.435408 10922 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Bootstrap starting.
I20251211 09:11:45.435464 10796 tablet_service.cc:1505] Processing CreateTablet for tablet 4f79787fcc1e447bbbda048ceb8174f6 (DEFAULT_TABLE table=test-workload [id=2f487eb1ee2d4b35a16c31d7f671ec0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:11:45.435540 10923 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Bootstrap starting.
I20251211 09:11:45.435559 10796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f79787fcc1e447bbbda048ceb8174f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:11:45.435889 10922 tablet_bootstrap.cc:654] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:45.435930 10923 tablet_bootstrap.cc:654] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:45.436537 10922 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: No bootstrap required, opened a new log
I20251211 09:11:45.436580 10922 ts_tablet_manager.cc:1403] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:45.436646 10923 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: No bootstrap required, opened a new log
I20251211 09:11:45.436704 10923 ts_tablet_manager.cc:1403] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:11:45.436722 10922 raft_consensus.cc:359] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.436784 10922 raft_consensus.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:45.436806 10922 raft_consensus.cc:740] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e829aedbeb240b0a75e81982c601f04, State: Initialized, Role: FOLLOWER
I20251211 09:11:45.436856 10923 raft_consensus.cc:359] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.436862 10922 consensus_queue.cc:260] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.436916 10926 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Bootstrap starting.
I20251211 09:11:45.436929 10923 raft_consensus.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:45.437004 10923 raft_consensus.cc:740] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d155cbee4fb47dc9016503144988821, State: Initialized, Role: FOLLOWER
I20251211 09:11:45.437029 10922 ts_tablet_manager.cc:1434] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:45.437054 10923 consensus_queue.cc:260] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.437099 10756 heartbeater.cc:499] Master 127.0.119.254:46505 was elected leader, sending a full tablet report...
I20251211 09:11:45.437196 10923 ts_tablet_manager.cc:1434] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:11:45.437271 10907 heartbeater.cc:499] Master 127.0.119.254:46505 was elected leader, sending a full tablet report...
I20251211 09:11:45.437556 10926 tablet_bootstrap.cc:654] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Neither blocks nor log segments found. Creating new log.
I20251211 09:11:45.438063 10926 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: No bootstrap required, opened a new log
I20251211 09:11:45.438105 10926 ts_tablet_manager.cc:1403] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20251211 09:11:45.438197 10926 raft_consensus.cc:359] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.438235 10926 raft_consensus.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:11:45.438247 10926 raft_consensus.cc:740] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0746569747b045f2ae635513af494c62, State: Initialized, Role: FOLLOWER
I20251211 09:11:45.438279 10926 consensus_queue.cc:260] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.438428 10926 ts_tablet_manager.cc:1434] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20251211 09:11:45.438476 10832 heartbeater.cc:499] Master 127.0.119.254:46505 was elected leader, sending a full tablet report...
W20251211 09:11:45.439302 10757 tablet.cc:2378] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 09:11:45.475172 10927 raft_consensus.cc:493] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:11:45.475258 10927 raft_consensus.cc:515] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.475461 10927 leader_election.cc:290] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d155cbee4fb47dc9016503144988821 (127.0.119.195:39045), 0746569747b045f2ae635513af494c62 (127.0.119.194:39597)
I20251211 09:11:45.477798 10881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f79787fcc1e447bbbda048ceb8174f6" candidate_uuid: "5e829aedbeb240b0a75e81982c601f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d155cbee4fb47dc9016503144988821" is_pre_election: true
I20251211 09:11:45.477880 10881 raft_consensus.cc:2468] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e829aedbeb240b0a75e81982c601f04 in term 0.
I20251211 09:11:45.477918 10806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f79787fcc1e447bbbda048ceb8174f6" candidate_uuid: "5e829aedbeb240b0a75e81982c601f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0746569747b045f2ae635513af494c62" is_pre_election: true
I20251211 09:11:45.478014 10806 raft_consensus.cc:2468] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e829aedbeb240b0a75e81982c601f04 in term 0.
I20251211 09:11:45.478025 10694 leader_election.cc:304] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d155cbee4fb47dc9016503144988821, 5e829aedbeb240b0a75e81982c601f04; no voters:
I20251211 09:11:45.478125 10927 raft_consensus.cc:2804] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:11:45.478166 10927 raft_consensus.cc:493] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:11:45.478219 10927 raft_consensus.cc:3060] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:45.478857 10927 raft_consensus.cc:515] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.478962 10927 leader_election.cc:290] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [CANDIDATE]: Term 1 election: Requested vote from peers 5d155cbee4fb47dc9016503144988821 (127.0.119.195:39045), 0746569747b045f2ae635513af494c62 (127.0.119.194:39597)
I20251211 09:11:45.479118 10881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f79787fcc1e447bbbda048ceb8174f6" candidate_uuid: "5e829aedbeb240b0a75e81982c601f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d155cbee4fb47dc9016503144988821"
I20251211 09:11:45.479174 10881 raft_consensus.cc:3060] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:45.479710 10881 raft_consensus.cc:2468] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e829aedbeb240b0a75e81982c601f04 in term 1.
I20251211 09:11:45.479820 10806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f79787fcc1e447bbbda048ceb8174f6" candidate_uuid: "5e829aedbeb240b0a75e81982c601f04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0746569747b045f2ae635513af494c62"
I20251211 09:11:45.479868 10806 raft_consensus.cc:3060] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:11:45.479879 10694 leader_election.cc:304] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d155cbee4fb47dc9016503144988821, 5e829aedbeb240b0a75e81982c601f04; no voters:
I20251211 09:11:45.479944 10927 raft_consensus.cc:2804] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:11:45.480078 10927 raft_consensus.cc:697] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 1 LEADER]: Becoming Leader. State: Replica: 5e829aedbeb240b0a75e81982c601f04, State: Running, Role: LEADER
I20251211 09:11:45.480136 10927 consensus_queue.cc:237] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } }
I20251211 09:11:45.480511 10806 raft_consensus.cc:2468] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e829aedbeb240b0a75e81982c601f04 in term 1.
I20251211 09:11:45.480605 10627 catalog_manager.cc:5654] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e829aedbeb240b0a75e81982c601f04 (127.0.119.193). New cstate: current_term: 1 leader_uuid: "5e829aedbeb240b0a75e81982c601f04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } health_report { overall_health: UNKNOWN } } }
I20251211 09:11:45.497866 10806 raft_consensus.cc:1275] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 1 FOLLOWER]: Refusing update from remote peer 5e829aedbeb240b0a75e81982c601f04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:45.497874 10881 raft_consensus.cc:1275] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 1 FOLLOWER]: Refusing update from remote peer 5e829aedbeb240b0a75e81982c601f04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:11:45.498106 10932 consensus_queue.cc:1048] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:45.498198 10927 consensus_queue.cc:1048] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:11:45.499503 10939 mvcc.cc:204] Tried to move back new op lower bound from 7231259875319144448 to 7231259875247042560. Current Snapshot: MvccSnapshot[applied={T|T < 7231259875318120448}]
I20251211 09:11:45.614104 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.615136 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.621333 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.630915 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.017s user 0.014s sys 0.000s Metrics: {"bytes_written":272371,"cfile_init":1,"compiler_manager_pool.queue_time_us":3471,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":750,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":581,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450,"thread_start_us":103,"threads_started":1}
I20251211 09:11:45.631202 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 87123 bytes on disk
I20251211 09:11:45.631429 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.633842 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.019s user 0.009s sys 0.004s Metrics: {"bytes_written":272371,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":493,"drs_written":1,"lbm_read_time_us":10,"lbm_reads_lt_1ms":4,"lbm_write_time_us":545,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20251211 09:11:45.634130 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 87123 bytes on disk
I20251211 09:11:45.634565 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.639775 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.018s user 0.014s sys 0.000s Metrics: {"bytes_written":275058,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":667,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1237,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:11:45.639956 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 88112 bytes on disk
I20251211 09:11:45.640091 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.786863 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.792431 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.793929 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.800578 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.014s user 0.009s sys 0.003s Metrics: {"bytes_written":273710,"cfile_init":1,"dirs.queue_time_us":605,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":736,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":578,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20251211 09:11:45.800796 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 87507 bytes on disk
I20251211 09:11:45.806512 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.809132 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014726
I20251211 09:11:45.806780 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.013s user 0.012s sys 0.000s Metrics: {"bytes_written":276516,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":596,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":494,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:11:45.816138 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014725
I20251211 09:11:45.807189 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.015s user 0.013s sys 0.000s Metrics: {"bytes_written":277816,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":71,"dirs.run_wall_time_us":501,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":704,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650,"spinlock_wait_cycles":140544}
I20251211 09:11:45.816388 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014696
I20251211 09:11:45.862421 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.046s user 0.021s sys 0.004s Metrics: {"bytes_written":544874,"cfile_cache_hit":14,"cfile_cache_hit_bytes":477871,"cfile_cache_miss":38,"cfile_cache_miss_bytes":870613,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":57,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":765,"drs_written":1,"lbm_read_time_us":488,"lbm_reads_lt_1ms":62,"lbm_write_time_us":940,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":290344,"rows_written":19050,"thread_start_us":195,"threads_started":5}
I20251211 09:11:45.862696 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 180655 bytes on disk
I20251211 09:11:45.863937 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.055s user 0.026s sys 0.000s Metrics: {"bytes_written":542378,"cfile_cache_hit":14,"cfile_cache_hit_bytes":475174,"cfile_cache_miss":38,"cfile_cache_miss_bytes":865830,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":290,"dirs.run_cpu_time_us":126,"dirs.run_wall_time_us":620,"drs_written":1,"lbm_read_time_us":458,"lbm_reads_lt_1ms":58,"lbm_write_time_us":1135,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":288819,"rows_written":18950,"thread_start_us":265,"threads_started":5}
I20251211 09:11:45.864182 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.864308 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 179786 bytes on disk
I20251211 09:11:45.864488 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.872159 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.054s user 0.029s sys 0.000s Metrics: {"bytes_written":548858,"cfile_cache_hit":14,"cfile_cache_hit_bytes":481967,"cfile_cache_miss":38,"cfile_cache_miss_bytes":877405,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":374,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":597,"drs_written":1,"lbm_read_time_us":904,"lbm_reads_lt_1ms":62,"lbm_write_time_us":3095,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":42,"num_input_rowsets":2,"peak_mem_usage":290979,"rows_written":19200,"spinlock_wait_cycles":384,"thread_start_us":299,"threads_started":5}
I20251211 09:11:45.872284 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 182122 bytes on disk
I20251211 09:11:45.872381 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.955627 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.955890 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.964284 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:45.980777 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.016s user 0.013s sys 0.000s Metrics: {"bytes_written":281626,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":70,"dirs.run_wall_time_us":704,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":646,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:11:45.981102 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.013s sys 0.000s Metrics: {"bytes_written":276391,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":69,"dirs.run_wall_time_us":457,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6341,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:11:45.981115 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.010s sys 0.004s Metrics: {"bytes_written":274974,"cfile_init":1,"dirs.queue_time_us":61,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":1792,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1024,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:11:45.981204 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014574
I20251211 09:11:45.981371 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 87929 bytes on disk
I20251211 09:11:45.981290 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 88408 bytes on disk
I20251211 09:11:45.981488 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.981623 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014599
I20251211 09:11:45.983096 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20251211 09:11:45.983260 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014600
I20251211 09:11:46.027247 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.045s user 0.034s sys 0.004s Metrics: {"bytes_written":813154,"cfile_cache_hit":12,"cfile_cache_hit_bytes":529262,"cfile_cache_miss":50,"cfile_cache_miss_bytes":1497744,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":130,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":694,"drs_written":1,"lbm_read_time_us":1047,"lbm_reads_lt_1ms":70,"lbm_write_time_us":1869,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":434311,"rows_written":28600}
I20251211 09:11:46.027428 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 276486 bytes on disk
I20251211 09:11:46.027549 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.059069 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.078s user 0.031s sys 0.008s Metrics: {"bytes_written":823398,"cfile_cache_hit":13,"cfile_cache_hit_bytes":592975,"cfile_cache_miss":49,"cfile_cache_miss_bytes":1463111,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1370,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":704,"drs_written":1,"lbm_read_time_us":9053,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":72,"lbm_write_time_us":1757,"lbm_writes_lt_1ms":54,"mutex_wait_us":18,"num_input_rowsets":2,"peak_mem_usage":443716,"rows_written":29000,"spinlock_wait_cycles":768}
I20251211 09:11:46.059247 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 280446 bytes on disk
I20251211 09:11:46.059386 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.061510 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.078s user 0.037s sys 0.000s Metrics: {"bytes_written":812120,"cfile_cache_hit":12,"cfile_cache_hit_bytes":530217,"cfile_cache_miss":50,"cfile_cache_miss_bytes":1493849,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":867,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":679,"drs_written":1,"lbm_read_time_us":838,"lbm_reads_lt_1ms":70,"lbm_write_time_us":1683,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":435201,"rows_written":28550}
I20251211 09:11:46.061751 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 276059 bytes on disk
I20251211 09:11:46.061944 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.118566 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.120376 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.122716 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.132793 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.014s user 0.010s sys 0.000s Metrics: {"bytes_written":279028,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":741,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":552,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20251211 09:11:46.133006 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1054264 bytes of WAL
I20251211 09:11:46.133139 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:46.133205 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000001 (ops 1-639)
I20251211 09:11:46.133659 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:46.133774 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 89386 bytes on disk
I20251211 09:11:46.133802 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.013s user 0.011s sys 0.000s Metrics: {"bytes_written":274983,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":579,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":847,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:11:46.133950 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1063421 bytes of WAL
I20251211 09:11:46.134034 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:46.133934 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.134081 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000001 (ops 1-587)
I20251211 09:11:46.134186 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014527
I20251211 09:11:46.134440 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:46.134527 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014525
I20251211 09:11:46.137917 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.015s user 0.012s sys 0.000s Metrics: {"bytes_written":281588,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":84,"dirs.run_wall_time_us":507,"drs_written":1,"lbm_read_time_us":10,"lbm_reads_lt_1ms":4,"lbm_write_time_us":508,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:11:46.138113 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1060511 bytes of WAL
I20251211 09:11:46.138226 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:46.138288 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000001 (ops 1-638)
I20251211 09:11:46.139145 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:46.139647 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 90357 bytes on disk
I20251211 09:11:46.139818 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.139946 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014527
I20251211 09:11:46.183966 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.050s user 0.036s sys 0.012s Metrics: {"bytes_written":1087261,"cfile_cache_hit":13,"cfile_cache_hit_bytes":642534,"cfile_cache_miss":61,"cfile_cache_miss_bytes":2082528,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":673,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":790,"drs_written":1,"lbm_read_time_us":1108,"lbm_reads_lt_1ms":81,"lbm_write_time_us":1922,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":585516,"rows_written":38300}
I20251211 09:11:46.184131 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 374851 bytes on disk
I20251211 09:11:46.184327 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.200605 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.061s user 0.042s sys 0.003s Metrics: {"bytes_written":1088646,"cfile_cache_hit":12,"cfile_cache_hit_bytes":614404,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2114802,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1405,"dirs.run_cpu_time_us":67,"dirs.run_wall_time_us":630,"drs_written":1,"lbm_read_time_us":1642,"lbm_reads_lt_1ms":82,"lbm_write_time_us":2327,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":584631,"rows_written":38350}
I20251211 09:11:46.200750 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 375389 bytes on disk
I20251211 09:11:46.200841 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.205842 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.071s user 0.039s sys 0.005s Metrics: {"bytes_written":1093648,"cfile_cache_hit":13,"cfile_cache_hit_bytes":641912,"cfile_cache_miss":61,"cfile_cache_miss_bytes":2100610,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":84,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":498,"drs_written":1,"lbm_read_time_us":1018,"lbm_reads_lt_1ms":85,"lbm_write_time_us":2087,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":587676,"rows_written":38550}
I20251211 09:11:46.206032 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 377281 bytes on disk
I20251211 09:11:46.206146 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.285535 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.297312 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.302103 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.310714 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.013s user 0.008s sys 0.003s Metrics: {"bytes_written":284324,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":831,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":625,"lbm_writes_lt_1ms":32,"mutex_wait_us":2,"peak_mem_usage":0,"rows_written":9900}
I20251211 09:11:46.310714 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.013s sys 0.000s Metrics: {"bytes_written":271064,"cfile_init":1,"dirs.queue_time_us":31,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":825,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":709,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20251211 09:11:46.310879 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 91168 bytes on disk
I20251211 09:11:46.310906 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014464
I20251211 09:11:46.310982 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.311086 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014457
I20251211 09:11:46.323791 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.022s user 0.010s sys 0.000s Metrics: {"bytes_written":300505,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":532,"drs_written":1,"lbm_read_time_us":6081,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":1642,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10350}
I20251211 09:11:46.323940 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 95438 bytes on disk
I20251211 09:11:46.326174 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.326296 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014454
I20251211 09:11:46.337936 10616 maintenance_manager.cc:419] P 91a1f46df3034a81a40c0aa762634cef: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.003577
I20251211 09:11:46.340972 10615 maintenance_manager.cc:643] P 91a1f46df3034a81a40c0aa762634cef: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"bytes_written":6634,"cfile_init":1,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":169,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":5,"thread_start_us":58,"threads_started":1}
I20251211 09:11:46.341099 10616 maintenance_manager.cc:419] P 91a1f46df3034a81a40c0aa762634cef: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 485 bytes on disk
I20251211 09:11:46.341218 10615 maintenance_manager.cc:643] P 91a1f46df3034a81a40c0aa762634cef: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.388859 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.078s user 0.049s sys 0.009s Metrics: {"bytes_written":1370940,"cfile_cache_hit":12,"cfile_cache_hit_bytes":591058,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2861316,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":379,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":823,"drs_written":1,"lbm_read_time_us":2451,"lbm_reads_lt_1ms":90,"lbm_write_time_us":3855,"lbm_writes_lt_1ms":76,"num_input_rowsets":2,"peak_mem_usage":738638,"rows_written":48450}
I20251211 09:11:46.389045 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 479161 bytes on disk
I20251211 09:11:46.389151 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.432267 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.121s user 0.043s sys 0.014s Metrics: {"bytes_written":1347171,"cfile_cache_hit":12,"cfile_cache_hit_bytes":660281,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2738663,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":9621,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":690,"drs_written":1,"lbm_read_time_us":2520,"lbm_reads_lt_1ms":94,"lbm_write_time_us":9625,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":72,"num_input_rowsets":2,"peak_mem_usage":728848,"rows_written":47700}
I20251211 09:11:46.432466 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 471405 bytes on disk
I20251211 09:11:46.432704 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.439457 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.113s user 0.057s sys 0.001s Metrics: {"bytes_written":1377422,"cfile_cache_hit":12,"cfile_cache_hit_bytes":679046,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2792208,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":5876,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":551,"drs_written":1,"lbm_read_time_us":3150,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":89,"lbm_write_time_us":2262,"lbm_writes_lt_1ms":76,"num_input_rowsets":2,"peak_mem_usage":740798,"rows_written":48700}
I20251211 09:11:46.439625 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 481812 bytes on disk
I20251211 09:11:46.439734 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.473299 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.480355 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.490375 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.493499 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.013s user 0.006s sys 0.004s Metrics: {"bytes_written":275080,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":762,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":652,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:11:46.493654 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014318
I20251211 09:11:46.501157 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.028s user 0.012s sys 0.001s Metrics: {"bytes_written":281591,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":710,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1022,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:11:46.501338 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 91287 bytes on disk
I20251211 09:11:46.501446 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.501523 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014324
I20251211 09:11:46.507472 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.017s user 0.012s sys 0.000s Metrics: {"bytes_written":275047,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":456,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":593,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:11:46.507608 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014315
I20251211 09:11:46.577378 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.076s user 0.066s sys 0.004s Metrics: {"bytes_written":1624070,"cfile_cache_hit":10,"cfile_cache_hit_bytes":447504,"cfile_cache_miss":84,"cfile_cache_miss_bytes":3653740,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":151,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":732,"drs_written":1,"lbm_read_time_us":2107,"lbm_reads_lt_1ms":104,"lbm_write_time_us":2782,"lbm_writes_lt_1ms":86,"num_input_rowsets":2,"peak_mem_usage":878278,"rows_written":57500}
I20251211 09:11:46.577553 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 578778 bytes on disk
I20251211 09:11:46.577715 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.583884 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.076s user 0.070s sys 0.000s Metrics: {"bytes_written":1646446,"cfile_cache_hit":10,"cfile_cache_hit_bytes":442691,"cfile_cache_miss":84,"cfile_cache_miss_bytes":3712965,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":450,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":678,"drs_written":1,"lbm_read_time_us":1741,"lbm_reads_lt_1ms":108,"lbm_write_time_us":3148,"lbm_writes_lt_1ms":88,"num_input_rowsets":2,"peak_mem_usage":888063,"rows_written":58250,"spinlock_wait_cycles":1414400}
I20251211 09:11:46.584048 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 587144 bytes on disk
I20251211 09:11:46.584184 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.603840 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.110s user 0.065s sys 0.008s Metrics: {"bytes_written":1636356,"cfile_cache_hit":12,"cfile_cache_hit_bytes":716995,"cfile_cache_miss":82,"cfile_cache_miss_bytes":3420825,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":681,"dirs.run_cpu_time_us":69,"dirs.run_wall_time_us":388,"drs_written":1,"lbm_read_time_us":3091,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":105,"lbm_write_time_us":4534,"lbm_writes_lt_1ms":86,"num_input_rowsets":2,"peak_mem_usage":882598,"rows_written":58000}
I20251211 09:11:46.603991 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 584500 bytes on disk
I20251211 09:11:46.604101 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.679476 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.685551 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.694972 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.015s user 0.010s sys 0.000s Metrics: {"bytes_written":283083,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":808,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":589,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20251211 09:11:46.695290 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1050181 bytes of WAL
I20251211 09:11:46.696136 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.705454 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:46.705559 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000002 (ops 640-1263)
I20251211 09:11:46.705982 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:46.707631 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 90693 bytes on disk
I20251211 09:11:46.707803 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.708583 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014219
I20251211 09:11:46.719090 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.033s user 0.014s sys 0.000s Metrics: {"bytes_written":272486,"cfile_init":1,"dirs.queue_time_us":883,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":705,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1967,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9450}
I20251211 09:11:46.719980 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.024s user 0.012s sys 0.000s Metrics: {"bytes_written":276392,"cfile_init":1,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":630,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":646,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:11:46.724632 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1046879 bytes of WAL
I20251211 09:11:46.724738 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049692 bytes of WAL
I20251211 09:11:46.725868 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:46.725965 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000002 (ops 588-1165)
I20251211 09:11:46.726490 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:46.726611 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014217
I20251211 09:11:46.728826 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:46.729017 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000002 (ops 639-1260)
I20251211 09:11:46.729589 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:46.729862 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 88304 bytes on disk
I20251211 09:11:46.730257 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.730412 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014213
I20251211 09:11:46.815528 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.107s user 0.074s sys 0.002s Metrics: {"bytes_written":1901494,"cfile_cache_hit":14,"cfile_cache_hit_bytes":832586,"cfile_cache_miss":90,"cfile_cache_miss_bytes":3989576,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":147,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":755,"drs_written":1,"lbm_read_time_us":2793,"lbm_reads_lt_1ms":110,"lbm_write_time_us":3275,"lbm_writes_lt_1ms":99,"num_input_rowsets":2,"peak_mem_usage":1026820,"rows_written":67350}
I20251211 09:11:46.815711 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 689078 bytes on disk
I20251211 09:11:46.816205 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.868044 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.141s user 0.075s sys 0.006s Metrics: {"bytes_written":1904113,"cfile_cache_hit":12,"cfile_cache_hit_bytes":765725,"cfile_cache_miss":92,"cfile_cache_miss_bytes":4063669,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":225,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":828,"drs_written":1,"lbm_read_time_us":2041,"lbm_reads_lt_1ms":116,"lbm_write_time_us":6287,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":98,"num_input_rowsets":2,"peak_mem_usage":1028345,"rows_written":67450}
I20251211 09:11:46.868659 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 690012 bytes on disk
I20251211 09:11:46.868988 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.879248 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.887246 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.895999 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.016s user 0.009s sys 0.003s Metrics: {"bytes_written":271110,"cfile_init":1,"dirs.queue_time_us":17,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":567,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1220,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20251211 09:11:46.896131 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 86757 bytes on disk
I20251211 09:11:46.896229 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.896299 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013965
I20251211 09:11:46.900142 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.013s user 0.009s sys 0.000s Metrics: {"bytes_written":280365,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":69,"dirs.run_wall_time_us":504,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":535,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:11:46.900265 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 90129 bytes on disk
I20251211 09:11:46.900447 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:11:46.900591 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013964
I20251211 09:11:46.903908 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.173s user 0.068s sys 0.012s Metrics: {"bytes_written":1914578,"cfile_cache_hit":13,"cfile_cache_hit_bytes":799354,"cfile_cache_miss":93,"cfile_cache_miss_bytes":4057910,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":149,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":644,"drs_written":1,"lbm_read_time_us":2719,"lbm_reads_lt_1ms":113,"lbm_write_time_us":6180,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":98,"num_input_rowsets":2,"peak_mem_usage":1034443,"rows_written":67850,"spinlock_wait_cycles":1046912}
I20251211 09:11:46.904032 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:46.920756 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":279125,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":571,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":619,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20251211 09:11:46.920915 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 784232 bytes on disk
I20251211 09:11:46.921087 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20251211 09:11:46.921182 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013959
I20251211 09:11:47.023312 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.127s user 0.075s sys 0.012s Metrics: {"bytes_written":2163774,"cfile_cache_hit":12,"cfile_cache_hit_bytes":651000,"cfile_cache_miss":106,"cfile_cache_miss_bytes":4872442,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":133,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":691,"drs_written":1,"lbm_read_time_us":2639,"lbm_reads_lt_1ms":126,"lbm_write_time_us":5288,"lbm_writes_lt_1ms":109,"num_input_rowsets":2,"peak_mem_usage":1171675,"rows_written":76850}
I20251211 09:11:47.023491 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 795452 bytes on disk
I20251211 09:11:47.023548 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.102s user 0.090s sys 0.000s Metrics: {"bytes_written":2185939,"cfile_cache_hit":12,"cfile_cache_hit_bytes":657800,"cfile_cache_miss":106,"cfile_cache_miss_bytes":4917540,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":144,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":528,"drs_written":1,"lbm_read_time_us":2422,"lbm_reads_lt_1ms":126,"lbm_write_time_us":3955,"lbm_writes_lt_1ms":111,"num_input_rowsets":2,"peak_mem_usage":1182376,"rows_written":77550}
I20251211 09:11:47.023605 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.023655 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 803513 bytes on disk
I20251211 09:11:47.023751 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.074949 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.095189 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.099359 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.199s user 0.093s sys 0.000s Metrics: {"bytes_written":2174507,"cfile_cache_hit":12,"cfile_cache_hit_bytes":658846,"cfile_cache_miss":106,"cfile_cache_miss_bytes":4882742,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":126,"dirs.run_cpu_time_us":147,"dirs.run_wall_time_us":802,"drs_written":1,"lbm_read_time_us":2322,"lbm_reads_lt_1ms":126,"lbm_write_time_us":6329,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":110,"num_input_rowsets":2,"peak_mem_usage":1173835,"rows_written":77100,"spinlock_wait_cycles":768}
I20251211 09:11:47.099514 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.108515 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.033s user 0.013s sys 0.000s Metrics: {"bytes_written":276346,"cfile_init":1,"dirs.queue_time_us":1149,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":585,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":619,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:11:47.108662 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014099
I20251211 09:11:47.118291 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.023s user 0.012s sys 0.000s Metrics: {"bytes_written":288176,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":72,"dirs.run_wall_time_us":484,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":643,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10050}
I20251211 09:11:47.118331 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.019s user 0.014s sys 0.000s Metrics: {"bytes_written":306870,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":84,"dirs.run_wall_time_us":448,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":698,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10600}
I20251211 09:11:47.118441 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014087
I20251211 09:11:47.118498 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 896097 bytes on disk
I20251211 09:11:47.118661 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":27,"lbm_reads_lt_1ms":8}
I20251211 09:11:47.118744 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.014085
I20251211 09:11:47.247748 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.129s user 0.101s sys 0.001s Metrics: {"bytes_written":2468981,"cfile_cache_hit":10,"cfile_cache_hit_bytes":463263,"cfile_cache_miss":120,"cfile_cache_miss_bytes":5853493,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":1641,"drs_written":1,"lbm_read_time_us":3102,"lbm_reads_lt_1ms":140,"lbm_write_time_us":5809,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":122,"num_input_rowsets":2,"peak_mem_usage":1348051,"rows_written":87700}
I20251211 09:11:47.247901 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 915178 bytes on disk
I20251211 09:11:47.248003 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.255838 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.137s user 0.099s sys 0.003s Metrics: {"bytes_written":2466236,"cfile_cache_hit":13,"cfile_cache_hit_bytes":844309,"cfile_cache_miss":117,"cfile_cache_miss_bytes":5466375,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":977,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":723,"drs_written":1,"lbm_read_time_us":2501,"lbm_reads_lt_1ms":141,"lbm_write_time_us":5781,"lbm_writes_lt_1ms":123,"num_input_rowsets":2,"peak_mem_usage":1343671,"rows_written":87600}
I20251211 09:11:47.255998 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 914463 bytes on disk
I20251211 09:11:47.256119 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.296813 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.299052 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.301957 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.193s user 0.078s sys 0.022s Metrics: {"bytes_written":2432771,"cfile_cache_hit":10,"cfile_cache_hit_bytes":443990,"cfile_cache_miss":118,"cfile_cache_miss_bytes":5782410,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":183,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":581,"drs_written":1,"lbm_read_time_us":3031,"lbm_reads_lt_1ms":142,"lbm_write_time_us":6809,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":120,"num_input_rowsets":2,"peak_mem_usage":1327087,"rows_written":86450}
I20251211 09:11:47.302299 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.323415 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.023s user 0.013s sys 0.000s Metrics: {"bytes_written":285589,"cfile_init":1,"dirs.queue_time_us":879,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":544,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":835,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9950}
I20251211 09:11:47.323596 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1064423 bytes of WAL
I20251211 09:11:47.323671 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:47.323702 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000003 (ops 1264-1897)
I20251211 09:11:47.323729 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.019s user 0.014s sys 0.000s Metrics: {"bytes_written":327868,"cfile_init":1,"dirs.queue_time_us":57,"dirs.run_cpu_time_us":70,"dirs.run_wall_time_us":393,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":638,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11400}
I20251211 09:11:47.323462 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.026s user 0.014s sys 0.000s Metrics: {"bytes_written":283015,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":582,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1151,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20251211 09:11:47.323863 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1068011 bytes of WAL
I20251211 09:11:47.323975 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1066624 bytes of WAL
I20251211 09:11:47.324044 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:47.324066 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000003 (ops 1261-1895)
I20251211 09:11:47.324113 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:47.324193 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 91669 bytes on disk
I20251211 09:11:47.324301 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.324395 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013843
I20251211 09:11:47.324455 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:47.324545 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013845
I20251211 09:11:47.324600 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:47.324630 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000003 (ops 1166-1753)
I20251211 09:11:47.324909 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:47.324985 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013844
I20251211 09:11:47.449563 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.125s user 0.101s sys 0.009s Metrics: {"bytes_written":2754291,"cfile_cache_hit":12,"cfile_cache_hit_bytes":714454,"cfile_cache_miss":130,"cfile_cache_miss_bytes":6342212,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":1191,"drs_written":1,"lbm_read_time_us":2840,"lbm_reads_lt_1ms":158,"lbm_write_time_us":6500,"lbm_writes_lt_1ms":135,"num_input_rowsets":2,"peak_mem_usage":1510520,"rows_written":97850}
I20251211 09:11:47.449733 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1027686 bytes on disk
I20251211 09:11:47.449851 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.500233 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.175s user 0.102s sys 0.003s Metrics: {"bytes_written":2739728,"cfile_cache_hit":13,"cfile_cache_hit_bytes":689034,"cfile_cache_miss":129,"cfile_cache_miss_bytes":6340772,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":556,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":914,"drs_written":1,"lbm_read_time_us":6183,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":152,"lbm_write_time_us":8405,"lbm_writes_lt_1ms":134,"num_input_rowsets":2,"peak_mem_usage":1505571,"rows_written":97450}
I20251211 09:11:47.500670 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1022889 bytes on disk
I20251211 09:11:47.500855 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.501329 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.501438 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.522310 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.198s user 0.104s sys 0.010s Metrics: {"bytes_written":2748930,"cfile_cache_hit":13,"cfile_cache_hit_bytes":691877,"cfile_cache_miss":129,"cfile_cache_miss_bytes":6351577,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":184,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":666,"drs_written":1,"lbm_read_time_us":3155,"lbm_reads_lt_1ms":149,"lbm_write_time_us":9482,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":133,"num_input_rowsets":2,"peak_mem_usage":1508721,"rows_written":97650,"spinlock_wait_cycles":384}
I20251211 09:11:47.522506 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1025270 bytes on disk
I20251211 09:11:47.522629 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.522713 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.526983 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.010s sys 0.003s Metrics: {"bytes_written":276406,"cfile_init":1,"dirs.queue_time_us":23,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":748,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:11:47.527230 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013320
I20251211 09:11:47.540231 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.017s user 0.013s sys 0.002s Metrics: {"bytes_written":305625,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":441,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":724,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10550}
I20251211 09:11:47.540416 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013317
I20251211 09:11:47.541334 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.030s user 0.011s sys 0.004s Metrics: {"bytes_written":293559,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":673,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":695,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10250}
I20251211 09:11:47.541580 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 96206 bytes on disk
I20251211 09:11:47.541743 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.541893 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013323
I20251211 09:11:47.684846 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.144s user 0.127s sys 0.001s Metrics: {"bytes_written":3042803,"cfile_cache_hit":13,"cfile_cache_hit_bytes":849356,"cfile_cache_miss":141,"cfile_cache_miss_bytes":6971156,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":148,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":866,"drs_written":1,"lbm_read_time_us":3687,"lbm_reads_lt_1ms":165,"lbm_write_time_us":6644,"lbm_writes_lt_1ms":146,"num_input_rowsets":2,"peak_mem_usage":1676251,"rows_written":108200,"spinlock_wait_cycles":1280}
I20251211 09:11:47.685034 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1144649 bytes on disk
I20251211 09:11:47.685176 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.693895 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.152s user 0.121s sys 0.008s Metrics: {"bytes_written":3025580,"cfile_cache_hit":14,"cfile_cache_hit_bytes":838230,"cfile_cache_miss":140,"cfile_cache_miss_bytes":6945958,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":389,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":698,"drs_written":1,"lbm_read_time_us":4117,"lbm_reads_lt_1ms":160,"lbm_write_time_us":6763,"lbm_writes_lt_1ms":145,"num_input_rowsets":2,"peak_mem_usage":1668426,"rows_written":107700,"spinlock_wait_cycles":384}
I20251211 09:11:47.694242 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1138772 bytes on disk
I20251211 09:11:47.694439 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.725131 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.735952 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.761337 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.036s user 0.014s sys 0.000s Metrics: {"bytes_written":277757,"cfile_init":1,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":692,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":713,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20251211 09:11:47.761519 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.014s sys 0.000s Metrics: {"bytes_written":272542,"cfile_init":1,"dirs.queue_time_us":2174,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":544,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":707,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20251211 09:11:47.761569 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013296
I20251211 09:11:47.761673 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013294
I20251211 09:11:47.776132 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.249s user 0.105s sys 0.021s Metrics: {"bytes_written":3019120,"cfile_cache_hit":12,"cfile_cache_hit_bytes":798673,"cfile_cache_miss":142,"cfile_cache_miss_bytes":6969295,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":177,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":1040,"drs_written":1,"lbm_read_time_us":6346,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":165,"lbm_write_time_us":10119,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":144,"num_input_rowsets":2,"peak_mem_usage":1666666,"rows_written":107450}
I20251211 09:11:47.776407 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1135779 bytes on disk
I20251211 09:11:47.776538 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.776623 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.803335 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.027s user 0.010s sys 0.007s Metrics: {"bytes_written":355825,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":682,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":792,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12300}
I20251211 09:11:47.803972 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1047928 bytes of WAL
I20251211 09:11:47.804195 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:47.804244 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000004 (ops 1754-2330)
I20251211 09:11:47.806298 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:47.806411 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 114257 bytes on disk
I20251211 09:11:47.807607 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.807734 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013285
I20251211 09:11:47.949129 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.187s user 0.120s sys 0.016s Metrics: {"bytes_written":3302409,"cfile_cache_hit":14,"cfile_cache_hit_bytes":876605,"cfile_cache_miss":150,"cfile_cache_miss_bytes":7638939,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":690,"drs_written":1,"lbm_read_time_us":4555,"lbm_reads_lt_1ms":174,"lbm_write_time_us":9943,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":156,"num_input_rowsets":2,"peak_mem_usage":1834201,"rows_written":117650,"spinlock_wait_cycles":768}
I20251211 09:11:47.949304 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1253091 bytes on disk
I20251211 09:11:47.949419 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.949491 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.971861 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.208s user 0.125s sys 0.013s Metrics: {"bytes_written":3294641,"cfile_cache_hit":11,"cfile_cache_hit_bytes":475459,"cfile_cache_miss":153,"cfile_cache_miss_bytes":8016323,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":197,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":706,"drs_written":1,"lbm_read_time_us":6083,"lbm_reads_lt_1ms":177,"lbm_write_time_us":7642,"lbm_writes_lt_1ms":157,"num_input_rowsets":2,"peak_mem_usage":1829126,"rows_written":117350}
I20251211 09:11:47.972172 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1248945 bytes on disk
I20251211 09:11:47.972343 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:47.972435 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:47.979825 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.030s user 0.012s sys 0.003s Metrics: {"bytes_written":304170,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":699,"drs_written":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4,"lbm_write_time_us":668,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10500}
I20251211 09:11:47.980049 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1065762 bytes of WAL
I20251211 09:11:47.980180 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:47.980654 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000004 (ops 1898-2552)
I20251211 09:11:47.981503 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:47.981638 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013491
I20251211 09:11:47.998296 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.026s user 0.017s sys 0.000s Metrics: {"bytes_written":338209,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":563,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":758,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11800}
I20251211 09:11:47.998441 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1056724 bytes of WAL
I20251211 09:11:47.998500 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:47.998520 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000004 (ops 1896-2544)
I20251211 09:11:47.998857 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:47.998947 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013483
I20251211 09:11:48.095867 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.288s user 0.132s sys 0.008s Metrics: {"bytes_written":3364991,"cfile_cache_hit":14,"cfile_cache_hit_bytes":935392,"cfile_cache_miss":152,"cfile_cache_miss_bytes":7728096,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":239,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":675,"drs_written":1,"lbm_read_time_us":7403,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":170,"lbm_write_time_us":9352,"lbm_writes_lt_1ms":160,"num_input_rowsets":2,"peak_mem_usage":1865469,"rows_written":119750,"spinlock_wait_cycles":384}
I20251211 09:11:48.096055 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.123029 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.027s user 0.017s sys 0.002s Metrics: {"bytes_written":418431,"cfile_init":1,"dirs.queue_time_us":124,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":600,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":863,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14550,"spinlock_wait_cycles":3840}
I20251211 09:11:48.123201 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013484
I20251211 09:11:48.188081 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.206s user 0.134s sys 0.012s Metrics: {"bytes_written":3594219,"cfile_cache_hit":11,"cfile_cache_hit_bytes":494430,"cfile_cache_miss":165,"cfile_cache_miss_bytes":8790830,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":138,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":693,"drs_written":1,"lbm_read_time_us":7326,"lbm_reads_lt_1ms":189,"lbm_write_time_us":8187,"lbm_writes_lt_1ms":169,"num_input_rowsets":2,"peak_mem_usage":2003766,"rows_written":128150,"spinlock_wait_cycles":384,"thread_start_us":54,"threads_started":1}
I20251211 09:11:48.188967 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.204744 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.206s user 0.142s sys 0.004s Metrics: {"bytes_written":3623239,"cfile_cache_hit":12,"cfile_cache_hit_bytes":698036,"cfile_cache_miss":166,"cfile_cache_miss_bytes":8657172,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":915,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":636,"drs_written":1,"lbm_read_time_us":4506,"lbm_reads_lt_1ms":190,"lbm_write_time_us":8230,"lbm_writes_lt_1ms":170,"num_input_rowsets":2,"peak_mem_usage":2018709,"rows_written":129150}
I20251211 09:11:48.204895 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.210553 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.021s user 0.010s sys 0.004s Metrics: {"bytes_written":288286,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":74,"dirs.run_wall_time_us":2025,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3657,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":10050}
I20251211 09:11:48.210799 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1464720 bytes on disk
I20251211 09:11:48.211023 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20251211 09:11:48.211896 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013466
I20251211 09:11:48.226097 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.021s user 0.014s sys 0.000s Metrics: {"bytes_written":277791,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":577,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1162,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20251211 09:11:48.226325 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013459
I20251211 09:11:48.316346 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.193s user 0.124s sys 0.030s Metrics: {"bytes_written":3768565,"cfile_cache_hit":12,"cfile_cache_hit_bytes":614657,"cfile_cache_miss":172,"cfile_cache_miss_bytes":9116985,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":612,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":673,"drs_written":1,"lbm_read_time_us":5016,"lbm_reads_lt_1ms":200,"lbm_write_time_us":8258,"lbm_writes_lt_1ms":178,"num_input_rowsets":2,"peak_mem_usage":2097991,"rows_written":134300,"spinlock_wait_cycles":384}
I20251211 09:11:48.316514 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1441687 bytes on disk
I20251211 09:11:48.316614 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.337159 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.365123 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.028s user 0.015s sys 0.000s Metrics: {"bytes_written":280229,"cfile_init":1,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":731,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":644,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:11:48.365306 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 89967 bytes on disk
I20251211 09:11:48.365433 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.365521 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013308
I20251211 09:11:48.393185 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.180s user 0.141s sys 0.016s Metrics: {"bytes_written":3877224,"cfile_cache_hit":12,"cfile_cache_hit_bytes":786285,"cfile_cache_miss":176,"cfile_cache_miss_bytes":9239273,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":578,"drs_written":1,"lbm_read_time_us":5043,"lbm_reads_lt_1ms":196,"lbm_write_time_us":8266,"lbm_writes_lt_1ms":182,"num_input_rowsets":2,"peak_mem_usage":2165866,"rows_written":138200}
I20251211 09:11:48.393568 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1485441 bytes on disk
I20251211 09:11:48.393816 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.424618 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.441514 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.215s user 0.148s sys 0.007s Metrics: {"bytes_written":3896068,"cfile_cache_hit":11,"cfile_cache_hit_bytes":475723,"cfile_cache_miss":177,"cfile_cache_miss_bytes":9592757,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":156,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":5102,"drs_written":1,"lbm_read_time_us":7977,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":203,"lbm_write_time_us":12089,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":181,"num_input_rowsets":2,"peak_mem_usage":2176016,"rows_written":138800}
I20251211 09:11:48.441687 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1492262 bytes on disk
I20251211 09:11:48.441789 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.441860 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.458762 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.034s user 0.015s sys 0.000s Metrics: {"bytes_written":276399,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":79,"dirs.run_wall_time_us":556,"drs_written":1,"lbm_read_time_us":675,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4599,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:11:48.459089 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013416
I20251211 09:11:48.461210 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.019s user 0.013s sys 0.000s Metrics: {"bytes_written":280346,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":650,"drs_written":1,"lbm_read_time_us":11,"lbm_reads_lt_1ms":4,"lbm_write_time_us":543,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:11:48.461356 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 89996 bytes on disk
I20251211 09:11:48.461462 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.461534 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013408
I20251211 09:11:48.589756 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.224s user 0.152s sys 0.008s Metrics: {"bytes_written":4040500,"cfile_cache_hit":13,"cfile_cache_hit_bytes":824821,"cfile_cache_miss":185,"cfile_cache_miss_bytes":9634225,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":952,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":636,"drs_written":1,"lbm_read_time_us":5766,"lbm_reads_lt_1ms":205,"lbm_write_time_us":7960,"lbm_writes_lt_1ms":190,"num_input_rowsets":2,"peak_mem_usage":2262873,"rows_written":144050,"spinlock_wait_cycles":1280}
I20251211 09:11:48.589923 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.616814 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.027s user 0.015s sys 0.000s Metrics: {"bytes_written":319895,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":843,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":709,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11100}
I20251211 09:11:48.616981 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1055338 bytes of WAL
I20251211 09:11:48.617046 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:48.617065 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000005 (ops 2331-2911)
I20251211 09:11:48.617455 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:48.617532 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013306
I20251211 09:11:48.671528 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.210s user 0.151s sys 0.016s Metrics: {"bytes_written":4164850,"cfile_cache_hit":11,"cfile_cache_hit_bytes":478123,"cfile_cache_miss":193,"cfile_cache_miss_bytes":10312649,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1087,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":2091,"drs_written":1,"lbm_read_time_us":4874,"lbm_reads_lt_1ms":213,"lbm_write_time_us":7517,"lbm_writes_lt_1ms":194,"num_input_rowsets":2,"peak_mem_usage":2335991,"rows_written":148550}
I20251211 09:11:48.672719 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1602081 bytes on disk
I20251211 09:11:48.673167 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":211,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.673301 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.702440 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.029s user 0.011s sys 0.004s Metrics: {"bytes_written":299030,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":1186,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1230,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10300}
I20251211 09:11:48.702594 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013307
I20251211 09:11:48.860780 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.402s user 0.155s sys 0.016s Metrics: {"bytes_written":4145068,"cfile_cache_hit":14,"cfile_cache_hit_bytes":685766,"cfile_cache_miss":188,"cfile_cache_miss_bytes":10051032,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":174,"dirs.run_cpu_time_us":817,"dirs.run_wall_time_us":9927,"drs_written":1,"lbm_read_time_us":10586,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":211,"lbm_write_time_us":16947,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":191,"num_input_rowsets":2,"peak_mem_usage":2325606,"rows_written":147800}
I20251211 09:11:48.861042 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1593677 bytes on disk
I20251211 09:11:48.861308 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.861449 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:48.870174 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.253s user 0.154s sys 0.019s Metrics: {"bytes_written":4347652,"cfile_cache_hit":15,"cfile_cache_hit_bytes":922149,"cfile_cache_miss":197,"cfile_cache_miss_bytes":10351139,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":657,"drs_written":1,"lbm_read_time_us":8234,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":224,"lbm_write_time_us":13594,"lbm_writes_lt_1ms":202,"num_input_rowsets":2,"peak_mem_usage":2441881,"rows_written":155150,"spinlock_wait_cycles":3497984}
I20251211 09:11:48.870357 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.903034 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.042s user 0.018s sys 0.007s Metrics: {"bytes_written":548785,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":584,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1102,"lbm_writes_lt_1ms":43,"peak_mem_usage":0,"rows_written":19200}
I20251211 09:11:48.903898 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1065160 bytes of WAL
I20251211 09:11:48.903983 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:48.904013 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000005 (ops 2553-3210)
I20251211 09:11:48.904438 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:48.904528 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013226
I20251211 09:11:48.906603 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.036s user 0.013s sys 0.004s Metrics: {"bytes_written":354132,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":557,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3220,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":12250}
I20251211 09:11:48.906728 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1792211 bytes on disk
I20251211 09:11:48.906852 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":33,"lbm_reads_lt_1ms":8}
I20251211 09:11:48.906924 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013115
I20251211 09:11:48.928093 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.225s user 0.160s sys 0.015s Metrics: {"bytes_written":4450283,"cfile_cache_hit":14,"cfile_cache_hit_bytes":895113,"cfile_cache_miss":200,"cfile_cache_miss_bytes":10650501,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1176,"dirs.run_cpu_time_us":84,"dirs.run_wall_time_us":11172,"drs_written":1,"lbm_read_time_us":6703,"lbm_reads_lt_1ms":224,"lbm_write_time_us":9176,"lbm_writes_lt_1ms":206,"num_input_rowsets":2,"peak_mem_usage":2502806,"rows_written":158850}
I20251211 09:11:48.928258 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1721329 bytes on disk
I20251211 09:11:48.928362 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:48.928438 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:48.953609 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.015s sys 0.000s Metrics: {"bytes_written":313667,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":599,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":642,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10850}
I20251211 09:11:48.953855 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1051969 bytes of WAL
I20251211 09:11:48.953969 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:48.954041 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000005 (ops 2545-3189)
I20251211 09:11:48.954602 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:48.954717 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013060
I20251211 09:11:49.150653 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.244s user 0.176s sys 0.016s Metrics: {"bytes_written":4688984,"cfile_cache_hit":13,"cfile_cache_hit_bytes":876972,"cfile_cache_miss":211,"cfile_cache_miss_bytes":11293826,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":276,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":833,"drs_written":1,"lbm_read_time_us":7041,"lbm_reads_lt_1ms":231,"lbm_write_time_us":10617,"lbm_writes_lt_1ms":216,"num_input_rowsets":2,"peak_mem_usage":2638136,"rows_written":167400,"spinlock_wait_cycles":871040}
I20251211 09:11:49.150843 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:49.180750 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.030s user 0.016s sys 0.002s Metrics: {"bytes_written":357310,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":1054,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1594,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12350}
I20251211 09:11:49.183591 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1065920 bytes of WAL
I20251211 09:11:49.183699 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:49.183741 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000006 (ops 2912-3498)
I20251211 09:11:49.184737 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:49.184839 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.013034
I20251211 09:11:49.292691 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.338s user 0.176s sys 0.016s Metrics: {"bytes_written":4753984,"cfile_cache_hit":12,"cfile_cache_hit_bytes":674544,"cfile_cache_miss":214,"cfile_cache_miss_bytes":11671102,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":161,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":621,"drs_written":1,"lbm_read_time_us":9065,"lbm_reads_lt_1ms":238,"lbm_write_time_us":15564,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":218,"num_input_rowsets":2,"peak_mem_usage":2676906,"rows_written":169700,"spinlock_wait_cycles":768}
I20251211 09:11:49.293021 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 1845711 bytes on disk
I20251211 09:11:49.293211 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:49.293992 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:49.322587 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.028s user 0.021s sys 0.000s Metrics: {"bytes_written":462805,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":632,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":913,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16150}
I20251211 09:11:49.322858 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012973
I20251211 09:11:49.377277 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.473s user 0.174s sys 0.015s Metrics: {"bytes_written":4678689,"cfile_cache_hit":12,"cfile_cache_hit_bytes":756529,"cfile_cache_miss":212,"cfile_cache_miss_bytes":11365935,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":789,"drs_written":1,"lbm_read_time_us":7960,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":235,"lbm_write_time_us":19975,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":213,"num_input_rowsets":2,"peak_mem_usage":2627978,"rows_written":167000,"spinlock_wait_cycles":22528,"thread_start_us":218,"threads_started":5}
I20251211 09:11:49.377470 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:49.422930 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.045s user 0.017s sys 0.008s Metrics: {"bytes_written":622069,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":686,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1226,"lbm_writes_lt_1ms":46,"peak_mem_usage":0,"rows_written":21850,"spinlock_wait_cycles":3840}
I20251211 09:11:49.423483 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2024142 bytes on disk
I20251211 09:11:49.425626 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20251211 09:11:49.425789 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012947
I20251211 09:11:49.487216 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.301s user 0.172s sys 0.016s Metrics: {"bytes_written":5035916,"cfile_cache_hit":12,"cfile_cache_hit_bytes":707128,"cfile_cache_miss":226,"cfile_cache_miss_bytes":12379476,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":319,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":646,"drs_written":1,"lbm_read_time_us":6171,"lbm_reads_lt_1ms":254,"lbm_write_time_us":9671,"lbm_writes_lt_1ms":230,"num_input_rowsets":2,"peak_mem_usage":2840360,"rows_written":179750}
I20251211 09:11:49.487380 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:49.509846 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.022s user 0.017s sys 0.001s Metrics: {"bytes_written":362462,"cfile_init":1,"dirs.queue_time_us":172,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":646,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1231,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12550}
I20251211 09:11:49.510021 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2077602 bytes on disk
I20251211 09:11:49.510231 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":31,"lbm_reads_lt_1ms":8}
I20251211 09:11:49.510363 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012752
I20251211 09:11:49.533835 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.211s user 0.190s sys 0.015s Metrics: {"bytes_written":5200707,"cfile_cache_hit":13,"cfile_cache_hit_bytes":917266,"cfile_cache_miss":233,"cfile_cache_miss_bytes":12604292,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":173,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":5737,"drs_written":1,"lbm_read_time_us":6149,"lbm_reads_lt_1ms":257,"lbm_write_time_us":10039,"lbm_writes_lt_1ms":237,"num_input_rowsets":2,"peak_mem_usage":2935670,"rows_written":185850}
I20251211 09:11:49.534163 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2030150 bytes on disk
I20251211 09:11:49.534430 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:49.565260 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:49.576890 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.011s user 0.009s sys 0.000s Metrics: {"bytes_written":271151,"cfile_init":1,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":140,"dirs.run_wall_time_us":750,"drs_written":1,"lbm_read_time_us":11,"lbm_reads_lt_1ms":4,"lbm_write_time_us":559,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20251211 09:11:49.577608 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049895 bytes of WAL
I20251211 09:11:49.577875 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:49.578029 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000006 (ops 3190-3794)
I20251211 09:11:49.579032 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:49.579214 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012725
I20251211 09:11:49.735728 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.225s user 0.190s sys 0.019s Metrics: {"bytes_written":5382451,"cfile_cache_hit":12,"cfile_cache_hit_bytes":710772,"cfile_cache_miss":238,"cfile_cache_miss_bytes":13300446,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1247,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":699,"drs_written":1,"lbm_read_time_us":5944,"lbm_reads_lt_1ms":258,"lbm_write_time_us":9190,"lbm_writes_lt_1ms":245,"num_input_rowsets":2,"peak_mem_usage":3042434,"rows_written":192300,"spinlock_wait_cycles":384}
I20251211 09:11:49.735916 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2103325 bytes on disk
I20251211 09:11:49.736059 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:49.776655 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:49.790462 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.364s user 0.202s sys 0.009s Metrics: {"bytes_written":5285714,"cfile_cache_hit":13,"cfile_cache_hit_bytes":933731,"cfile_cache_miss":237,"cfile_cache_miss_bytes":12800027,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1741,"dirs.run_cpu_time_us":221,"dirs.run_wall_time_us":7792,"drs_written":1,"lbm_read_time_us":6036,"lbm_reads_lt_1ms":257,"lbm_write_time_us":16786,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":240,"num_input_rowsets":2,"peak_mem_usage":2978710,"rows_written":188850,"spinlock_wait_cycles":1152}
I20251211 09:11:49.790781 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2064329 bytes on disk
I20251211 09:11:49.790942 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:49.791141 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:49.791265 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.014s user 0.013s sys 0.000s Metrics: {"bytes_written":279101,"cfile_init":1,"dirs.queue_time_us":31,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":523,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":683,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20251211 09:11:49.791508 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012678
I20251211 09:11:49.815781 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.024s user 0.015s sys 0.004s Metrics: {"bytes_written":396755,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":628,"drs_written":1,"lbm_read_time_us":29,"lbm_reads_lt_1ms":4,"lbm_write_time_us":931,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":13700}
I20251211 09:11:49.815974 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1059675 bytes of WAL
I20251211 09:11:49.816846 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:49.816903 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000006 (ops 3211-3843)
I20251211 09:11:49.817376 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:49.817492 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 129667 bytes on disk
I20251211 09:11:49.817627 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:11:49.817746 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012676
I20251211 09:11:49.879808 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.300s user 0.201s sys 0.018s Metrics: {"bytes_written":5464825,"cfile_cache_hit":13,"cfile_cache_hit_bytes":810197,"cfile_cache_miss":243,"cfile_cache_miss_bytes":13420207,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":154,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":578,"drs_written":1,"lbm_read_time_us":9466,"lbm_reads_lt_1ms":267,"lbm_write_time_us":14266,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":248,"num_input_rowsets":2,"peak_mem_usage":3095168,"rows_written":195250,"spinlock_wait_cycles":768}
I20251211 09:11:49.880156 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:49.903235 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.023s user 0.011s sys 0.003s Metrics: {"bytes_written":299020,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":557,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1376,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10300}
I20251211 09:11:49.903618 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2232643 bytes on disk
I20251211 09:11:49.903849 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":30,"lbm_reads_lt_1ms":8}
I20251211 09:11:49.904042 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012675
I20251211 09:11:50.113202 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.322s user 0.207s sys 0.017s Metrics: {"bytes_written":5652048,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1123476,"cfile_cache_miss":250,"cfile_cache_miss_bytes":13602930,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":704,"drs_written":1,"lbm_read_time_us":8172,"lbm_reads_lt_1ms":274,"lbm_write_time_us":17830,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":256,"num_input_rowsets":2,"peak_mem_usage":3206194,"rows_written":202000,"spinlock_wait_cycles":2516608}
I20251211 09:11:50.113610 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.141675 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.324s user 0.203s sys 0.023s Metrics: {"bytes_written":5666024,"cfile_cache_hit":13,"cfile_cache_hit_bytes":1032333,"cfile_cache_miss":251,"cfile_cache_miss_bytes":13730427,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":145,"dirs.run_cpu_time_us":207,"dirs.run_wall_time_us":1533,"drs_written":1,"lbm_read_time_us":9668,"lbm_reads_lt_1ms":271,"lbm_write_time_us":15587,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":258,"num_input_rowsets":2,"peak_mem_usage":3209477,"rows_written":202550,"spinlock_wait_cycles":2922496}
I20251211 09:11:50.141999 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2222819 bytes on disk
I20251211 09:11:50.142305 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.029s user 0.016s sys 0.000s Metrics: {"bytes_written":335903,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":518,"drs_written":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1187,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11700}
I20251211 09:11:50.142328 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:11:50.142477 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1062520 bytes of WAL
I20251211 09:11:50.142581 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.142805 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:50.142869 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000007 (ops 3499-4083)
I20251211 09:11:50.145004 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:50.145197 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012525
I20251211 09:11:50.165194 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.022s user 0.016s sys 0.000s Metrics: {"bytes_written":342394,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":778,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":764,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11950}
I20251211 09:11:50.165515 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012517
I20251211 09:11:50.194437 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.290s user 0.195s sys 0.030s Metrics: {"bytes_written":5751069,"cfile_cache_hit":13,"cfile_cache_hit_bytes":828692,"cfile_cache_miss":255,"cfile_cache_miss_bytes":14157620,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1295,"dirs.run_cpu_time_us":553,"dirs.run_wall_time_us":3761,"drs_written":1,"lbm_read_time_us":8207,"lbm_reads_lt_1ms":275,"lbm_write_time_us":12564,"lbm_writes_lt_1ms":262,"num_input_rowsets":2,"peak_mem_usage":3261633,"rows_written":205550}
I20251211 09:11:50.195151 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.217289 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.022s user 0.015s sys 0.000s Metrics: {"bytes_written":298947,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":491,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1005,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10300}
I20251211 09:11:50.217561 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012620
I20251211 09:11:50.464681 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.299s user 0.202s sys 0.030s Metrics: {"bytes_written":5998107,"cfile_cache_hit":12,"cfile_cache_hit_bytes":695964,"cfile_cache_miss":270,"cfile_cache_miss_bytes":14949012,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1397,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":1254,"drs_written":1,"lbm_read_time_us":7380,"lbm_reads_lt_1ms":294,"lbm_write_time_us":13947,"lbm_writes_lt_1ms":273,"num_input_rowsets":2,"peak_mem_usage":3405407,"rows_written":214500,"spinlock_wait_cycles":768}
I20251211 09:11:50.464865 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2360958 bytes on disk
I20251211 09:11:50.465426 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:50.465612 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.472280 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.327s user 0.228s sys 0.008s Metrics: {"bytes_written":5973535,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1195761,"cfile_cache_miss":265,"cfile_cache_miss_bytes":14390597,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":738,"drs_written":1,"lbm_read_time_us":8951,"lbm_reads_lt_1ms":293,"lbm_write_time_us":14712,"lbm_writes_lt_1ms":271,"num_input_rowsets":2,"peak_mem_usage":3397603,"rows_written":213700,"spinlock_wait_cycles":768}
I20251211 09:11:50.472591 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.484668 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.019s user 0.011s sys 0.004s Metrics: {"bytes_written":300446,"cfile_init":1,"dirs.queue_time_us":19,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":721,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10350}
I20251211 09:11:50.484913 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1052577 bytes of WAL
I20251211 09:11:50.485060 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:50.485162 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000007 (ops 3844-4457)
I20251211 09:11:50.485703 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:50.485855 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 95505 bytes on disk
I20251211 09:11:50.486042 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20251211 09:11:50.486195 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012524
I20251211 09:11:50.507261 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.034s user 0.011s sys 0.004s Metrics: {"bytes_written":326574,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":854,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1278,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11350}
I20251211 09:11:50.507582 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012524
I20251211 09:11:50.528429 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.311s user 0.221s sys 0.014s Metrics: {"bytes_written":6036233,"cfile_cache_hit":11,"cfile_cache_hit_bytes":626977,"cfile_cache_miss":271,"cfile_cache_miss_bytes":15121459,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":147,"dirs.run_cpu_time_us":68,"dirs.run_wall_time_us":9953,"drs_written":1,"lbm_read_time_us":7965,"lbm_reads_lt_1ms":299,"lbm_write_time_us":14918,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":273,"num_input_rowsets":2,"peak_mem_usage":3432293,"rows_written":215850}
I20251211 09:11:50.529191 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.551246 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.022s user 0.012s sys 0.003s Metrics: {"bytes_written":306914,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":504,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":848,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10600}
I20251211 09:11:50.551507 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1062117 bytes of WAL
I20251211 09:11:50.551617 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:50.551683 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000007 (ops 3795-4413)
I20251211 09:11:50.552111 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:50.552243 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012580
I20251211 09:11:50.778473 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.292s user 0.227s sys 0.016s Metrics: {"bytes_written":6284964,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1164121,"cfile_cache_miss":279,"cfile_cache_miss_bytes":15248601,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":891,"drs_written":1,"lbm_read_time_us":9327,"lbm_reads_lt_1ms":299,"lbm_write_time_us":16652,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":281,"mutex_wait_us":2,"num_input_rowsets":2,"peak_mem_usage":3578483,"rows_written":224850,"spinlock_wait_cycles":384}
I20251211 09:11:50.778756 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2479552 bytes on disk
I20251211 09:11:50.781738 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:50.781929 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.801537 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.019s user 0.014s sys 0.000s Metrics: {"bytes_written":289755,"cfile_init":1,"dirs.queue_time_us":417,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":611,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":936,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10100}
I20251211 09:11:50.801846 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012509
I20251211 09:11:50.882865 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.375s user 0.222s sys 0.028s Metrics: {"bytes_written":6289319,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1018813,"cfile_cache_miss":280,"cfile_cache_miss_bytes":15405537,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":978,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":633,"drs_written":1,"lbm_read_time_us":9607,"lbm_reads_lt_1ms":308,"lbm_write_time_us":13804,"lbm_writes_lt_1ms":285,"num_input_rowsets":2,"peak_mem_usage":3580732,"rows_written":225050}
I20251211 09:11:50.883296 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2481822 bytes on disk
I20251211 09:11:50.883507 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:50.883671 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.914697 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.030s user 0.015s sys 0.004s Metrics: {"bytes_written":415920,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":591,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":967,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14450}
I20251211 09:11:50.915231 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049727 bytes of WAL
I20251211 09:11:50.916023 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:50.916100 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000008 (ops 4084-4661)
I20251211 09:11:50.916503 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:50.916680 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012463
I20251211 09:11:50.948518 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.396s user 0.217s sys 0.031s Metrics: {"bytes_written":6329066,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1303221,"cfile_cache_miss":279,"cfile_cache_miss_bytes":15225481,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":493,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":831,"drs_written":1,"lbm_read_time_us":10222,"lbm_reads_lt_1ms":307,"lbm_write_time_us":16359,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":285,"num_input_rowsets":2,"peak_mem_usage":3604233,"rows_written":226450,"spinlock_wait_cycles":1280}
I20251211 09:11:50.948817 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:50.987682 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.039s user 0.018s sys 0.003s Metrics: {"bytes_written":446523,"cfile_init":1,"dirs.queue_time_us":171,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":654,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2957,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":39,"peak_mem_usage":0,"rows_written":15500}
I20251211 09:11:50.988307 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2643472 bytes on disk
I20251211 09:11:50.989943 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":35,"lbm_reads_lt_1ms":8}
I20251211 09:11:50.990134 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012433
I20251211 09:11:51.083485 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.281s user 0.251s sys 0.000s Metrics: {"bytes_written":6567625,"cfile_cache_hit":12,"cfile_cache_hit_bytes":790439,"cfile_cache_miss":294,"cfile_cache_miss_bytes":16367291,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":645,"drs_written":1,"lbm_read_time_us":7846,"lbm_reads_lt_1ms":318,"lbm_write_time_us":12157,"lbm_writes_lt_1ms":296,"num_input_rowsets":2,"peak_mem_usage":3742848,"rows_written":234950,"spinlock_wait_cycles":7296}
I20251211 09:11:51.084273 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2596108 bytes on disk
I20251211 09:11:51.084486 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:51.084646 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:51.102555 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.018s user 0.012s sys 0.003s Metrics: {"bytes_written":357229,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":760,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":729,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12350}
I20251211 09:11:51.102818 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012323
I20251211 09:11:51.278404 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.362s user 0.253s sys 0.015s Metrics: {"bytes_written":6692586,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1197098,"cfile_cache_miss":298,"cfile_cache_miss_bytes":16285500,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":183,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":754,"drs_written":1,"lbm_read_time_us":8794,"lbm_reads_lt_1ms":322,"lbm_write_time_us":15665,"lbm_writes_lt_1ms":302,"num_input_rowsets":2,"peak_mem_usage":3810774,"rows_written":239500,"spinlock_wait_cycles":1536}
I20251211 09:11:51.278769 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:51.403081 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.300s user 0.261s sys 0.020s Metrics: {"bytes_written":6908932,"cfile_cache_hit":12,"cfile_cache_hit_bytes":832802,"cfile_cache_miss":306,"cfile_cache_miss_bytes":17234198,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":841,"dirs.run_cpu_time_us":174,"dirs.run_wall_time_us":854,"drs_written":1,"lbm_read_time_us":8406,"lbm_reads_lt_1ms":330,"lbm_write_time_us":14546,"lbm_writes_lt_1ms":310,"num_input_rowsets":2,"peak_mem_usage":3939621,"rows_written":247300,"spinlock_wait_cycles":768}
I20251211 09:11:51.403625 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2738781 bytes on disk
I20251211 09:11:51.404196 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":339,"lbm_reads_lt_1ms":4}
I20251211 09:11:51.404485 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:51.425576 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.147s user 0.015s sys 0.007s Metrics: {"bytes_written":391447,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":130,"dirs.run_wall_time_us":6774,"drs_written":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3045,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":13650}
I20251211 09:11:51.426350 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012231
I20251211 09:11:51.435156 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.030s user 0.012s sys 0.004s Metrics: {"bytes_written":289521,"cfile_init":1,"dirs.queue_time_us":112,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":639,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1000,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10100}
I20251211 09:11:51.435416 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1050644 bytes of WAL
I20251211 09:11:51.435633 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:51.435700 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000008 (ops 4458-5096)
I20251211 09:11:51.436322 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:51.436733 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 92997 bytes on disk
I20251211 09:11:51.437493 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4}
I20251211 09:11:51.437958 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012227
I20251211 09:11:51.451879 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.462s user 0.261s sys 0.020s Metrics: {"bytes_written":6758881,"cfile_cache_hit":12,"cfile_cache_hit_bytes":741685,"cfile_cache_miss":304,"cfile_cache_miss_bytes":16916749,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":384,"dirs.run_cpu_time_us":143,"dirs.run_wall_time_us":1534,"drs_written":1,"lbm_read_time_us":15475,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":321,"lbm_write_time_us":21108,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":303,"num_input_rowsets":2,"peak_mem_usage":3851181,"rows_written":241950,"spinlock_wait_cycles":2176,"thread_start_us":88,"threads_started":2}
I20251211 09:11:51.452214 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:51.483826 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.031s user 0.022s sys 0.001s Metrics: {"bytes_written":482775,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":725,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":974,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16950}
I20251211 09:11:51.484208 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1053913 bytes of WAL
I20251211 09:11:51.484404 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:51.484488 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000008 (ops 4414-5056)
I20251211 09:11:51.485039 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:51.485270 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012234
I20251211 09:11:51.799465 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.361s user 0.277s sys 0.016s Metrics: {"bytes_written":7187933,"cfile_cache_hit":11,"cfile_cache_hit_bytes":621910,"cfile_cache_miss":319,"cfile_cache_miss_bytes":18192966,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":78,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":564,"drs_written":1,"lbm_read_time_us":11285,"lbm_reads_lt_1ms":339,"lbm_write_time_us":17513,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":321,"num_input_rowsets":2,"peak_mem_usage":4109287,"rows_written":257400,"spinlock_wait_cycles":768}
I20251211 09:11:51.799789 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:51.805203 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.378s user 0.260s sys 0.032s Metrics: {"bytes_written":7070979,"cfile_cache_hit":11,"cfile_cache_hit_bytes":565704,"cfile_cache_miss":315,"cfile_cache_miss_bytes":17926274,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":892,"drs_written":1,"lbm_read_time_us":13336,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":342,"lbm_write_time_us":13965,"lbm_writes_lt_1ms":318,"num_input_rowsets":2,"peak_mem_usage":4035022,"rows_written":253150,"thread_start_us":255,"threads_started":5}
I20251211 09:11:51.805472 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2805823 bytes on disk
I20251211 09:11:51.805661 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:51.805785 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:51.817754 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.018s user 0.016s sys 0.000s Metrics: {"bytes_written":302907,"cfile_init":1,"dirs.queue_time_us":28,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":775,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10450}
I20251211 09:11:51.818374 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2952941 bytes on disk
I20251211 09:11:51.818574 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":40,"lbm_reads_lt_1ms":8}
I20251211 09:11:51.818754 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012166
I20251211 09:11:51.839852 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.034s user 0.023s sys 0.000s Metrics: {"bytes_written":426076,"cfile_init":1,"dirs.queue_time_us":122,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":3728,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1227,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14850}
I20251211 09:11:51.840273 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1053491 bytes of WAL
I20251211 09:11:51.841359 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:51.841545 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000009 (ops 4662-5241)
I20251211 09:11:51.842011 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:51.843087 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 141199 bytes on disk
I20251211 09:11:51.843281 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:11:51.844798 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012170
I20251211 09:11:51.914912 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.429s user 0.280s sys 0.015s Metrics: {"bytes_written":7231281,"cfile_cache_hit":11,"cfile_cache_hit_bytes":693633,"cfile_cache_miss":321,"cfile_cache_miss_bytes":18208137,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":116,"dirs.run_cpu_time_us":70,"dirs.run_wall_time_us":15095,"drs_written":1,"lbm_read_time_us":11101,"lbm_reads_lt_1ms":349,"lbm_write_time_us":17657,"lbm_writes_lt_1ms":324,"num_input_rowsets":2,"peak_mem_usage":4123504,"rows_written":258900,"spinlock_wait_cycles":768}
I20251211 09:11:51.915238 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:51.978969 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.064s user 0.015s sys 0.004s Metrics: {"bytes_written":361251,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":975,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3200,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":12500}
I20251211 09:11:51.979277 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 2989012 bytes on disk
I20251211 09:11:51.979480 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":51,"lbm_reads_lt_1ms":8}
I20251211 09:11:51.979610 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.012137
I20251211 09:11:52.164084 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.345s user 0.279s sys 0.029s Metrics: {"bytes_written":7476865,"cfile_cache_hit":11,"cfile_cache_hit_bytes":495051,"cfile_cache_miss":331,"cfile_cache_miss_bytes":19089249,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":163,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":857,"drs_written":1,"lbm_read_time_us":9558,"lbm_reads_lt_1ms":351,"lbm_write_time_us":16456,"lbm_writes_lt_1ms":336,"num_input_rowsets":2,"peak_mem_usage":4277082,"rows_written":267850,"spinlock_wait_cycles":2688}
I20251211 09:11:52.164680 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:52.189705 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.012s sys 0.008s Metrics: {"bytes_written":379482,"cfile_init":1,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":586,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1189,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13200}
I20251211 09:11:52.190121 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011941
I20251211 09:11:52.212613 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.367s user 0.294s sys 0.018s Metrics: {"bytes_written":7481465,"cfile_cache_hit":11,"cfile_cache_hit_bytes":693538,"cfile_cache_miss":333,"cfile_cache_miss_bytes":18891346,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":393,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":750,"drs_written":1,"lbm_read_time_us":10476,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":352,"lbm_write_time_us":17521,"lbm_writes_lt_1ms":336,"num_input_rowsets":2,"peak_mem_usage":4273465,"rows_written":268000,"spinlock_wait_cycles":28672}
I20251211 09:11:52.213692 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:52.247344 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.033s user 0.011s sys 0.009s Metrics: {"bytes_written":429761,"cfile_init":1,"dirs.queue_time_us":572,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":614,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1088,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":15000}
I20251211 09:11:52.247862 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3118034 bytes on disk
I20251211 09:11:52.249042 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":42,"lbm_reads_lt_1ms":8}
I20251211 09:11:52.249344 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011922
I20251211 09:11:52.506273 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.527s user 0.291s sys 0.013s Metrics: {"bytes_written":7576506,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1021389,"cfile_cache_miss":332,"cfile_cache_miss_bytes":18821969,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":768,"drs_written":1,"lbm_read_time_us":12825,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":350,"lbm_write_time_us":23628,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":336,"num_input_rowsets":2,"peak_mem_usage":4334364,"rows_written":271400,"spinlock_wait_cycles":4480,"thread_start_us":205,"threads_started":5}
I20251211 09:11:52.507269 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:52.539700 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.032s user 0.027s sys 0.000s Metrics: {"bytes_written":576221,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":810,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1543,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20250}
I20251211 09:11:52.540091 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1058451 bytes of WAL
I20251211 09:11:52.540269 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:52.540357 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000009 (ops 5057-5681)
I20251211 09:11:52.540807 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:52.540977 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3209747 bytes on disk
I20251211 09:11:52.541312 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":40,"lbm_reads_lt_1ms":8}
I20251211 09:11:52.541483 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011838
I20251211 09:11:52.628021 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.438s user 0.265s sys 0.052s Metrics: {"bytes_written":7844049,"cfile_cache_hit":13,"cfile_cache_hit_bytes":887211,"cfile_cache_miss":349,"cfile_cache_miss_bytes":19661759,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":525,"drs_written":1,"lbm_read_time_us":12092,"lbm_reads_lt_1ms":377,"lbm_write_time_us":18274,"lbm_writes_lt_1ms":352,"num_input_rowsets":2,"peak_mem_usage":4488818,"rows_written":281050,"spinlock_wait_cycles":384}
I20251211 09:11:52.628758 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:52.668646 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.039s user 0.021s sys 0.001s Metrics: {"bytes_written":413279,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":674,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1688,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14350}
I20251211 09:11:52.669237 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049642 bytes of WAL
I20251211 09:11:52.669729 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:52.669799 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000009 (ops 5097-5718)
I20251211 09:11:52.670536 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:52.670671 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011889
I20251211 09:11:52.732306 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.481s user 0.295s sys 0.026s Metrics: {"bytes_written":7898464,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1355196,"cfile_cache_miss":349,"cfile_cache_miss_bytes":19334126,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":812,"drs_written":1,"lbm_read_time_us":16508,"lbm_reads_1-10_ms":6,"lbm_reads_lt_1ms":363,"lbm_write_time_us":19603,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":353,"num_input_rowsets":2,"peak_mem_usage":4520353,"rows_written":283000,"spinlock_wait_cycles":3281792,"thread_start_us":213,"threads_started":5}
I20251211 09:11:52.732682 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3150661 bytes on disk
I20251211 09:11:52.732903 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:52.733134 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:52.769176 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.036s user 0.023s sys 0.000s Metrics: {"bytes_written":447767,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":814,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1061,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":15550}
I20251211 09:11:52.769471 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1076897 bytes of WAL
I20251211 09:11:52.769641 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:52.769829 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000010 (ops 5242-5834)
I20251211 09:11:52.770323 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:52.770483 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011856
I20251211 09:11:52.985723 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.444s user 0.301s sys 0.026s Metrics: {"bytes_written":8139150,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1084137,"cfile_cache_miss":360,"cfile_cache_miss_bytes":20230421,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":821,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":833,"drs_written":1,"lbm_read_time_us":12626,"lbm_reads_lt_1ms":380,"lbm_write_time_us":18033,"lbm_writes_lt_1ms":364,"num_input_rowsets":2,"peak_mem_usage":4654000,"rows_written":291650,"spinlock_wait_cycles":377600}
I20251211 09:11:52.986132 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3249677 bytes on disk
I20251211 09:11:52.986569 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:11:52.986742 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:53.018445 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.032s user 0.021s sys 0.000s Metrics: {"bytes_written":428493,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":791,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1732,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14950}
I20251211 09:11:53.018728 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011784
I20251211 09:11:53.099718 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.429s user 0.312s sys 0.020s Metrics: {"bytes_written":8240589,"cfile_cache_hit":11,"cfile_cache_hit_bytes":571624,"cfile_cache_miss":369,"cfile_cache_miss_bytes":21032700,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":3687,"drs_written":1,"lbm_read_time_us":11385,"lbm_reads_lt_1ms":397,"lbm_write_time_us":16649,"lbm_writes_lt_1ms":368,"num_input_rowsets":2,"peak_mem_usage":4719186,"rows_written":295400,"spinlock_wait_cycles":2468096,"thread_start_us":76,"threads_started":2}
I20251211 09:11:53.100024 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3292660 bytes on disk
I20251211 09:11:53.100186 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:11:53.100315 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:53.128690 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.028s user 0.018s sys 0.002s Metrics: {"bytes_written":407153,"cfile_init":1,"dirs.queue_time_us":314,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":538,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2020,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":14100}
I20251211 09:11:53.129468 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011638
I20251211 09:11:53.285353 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.515s user 0.314s sys 0.026s Metrics: {"bytes_written":8329949,"cfile_cache_hit":12,"cfile_cache_hit_bytes":857602,"cfile_cache_miss":372,"cfile_cache_miss_bytes":20979488,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":732,"drs_written":1,"lbm_read_time_us":14069,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":393,"lbm_write_time_us":24374,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":370,"num_input_rowsets":2,"peak_mem_usage":4770818,"rows_written":298550,"spinlock_wait_cycles":4818176,"thread_start_us":285,"threads_started":5}
I20251211 09:11:53.285681 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3329119 bytes on disk
I20251211 09:11:53.285842 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:53.286489 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:53.328787 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.042s user 0.021s sys 0.004s Metrics: {"bytes_written":512077,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":614,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1167,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17950}
I20251211 09:11:53.329334 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 169838 bytes on disk
I20251211 09:11:53.329548 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20251211 09:11:53.329691 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011567
I20251211 09:11:53.535058 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.516s user 0.323s sys 0.024s Metrics: {"bytes_written":8553722,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1066428,"cfile_cache_miss":378,"cfile_cache_miss_bytes":21366944,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":93,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":756,"drs_written":1,"lbm_read_time_us":17400,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":401,"lbm_write_time_us":21640,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":380,"num_input_rowsets":2,"peak_mem_usage":4900576,"rows_written":306600,"spinlock_wait_cycles":1152}
I20251211 09:11:53.535557 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:53.575057 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.039s user 0.027s sys 0.001s Metrics: {"bytes_written":601457,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":638,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1349,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":21050}
I20251211 09:11:53.575510 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049826 bytes of WAL
I20251211 09:11:53.575604 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:53.575654 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000010 (ops 5682-6290)
I20251211 09:11:53.576063 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:53.576207 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011507
I20251211 09:11:53.810073 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.480s user 0.325s sys 0.030s Metrics: {"bytes_written":8830873,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1075831,"cfile_cache_miss":388,"cfile_cache_miss_bytes":22072165,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":705,"drs_written":1,"lbm_read_time_us":14192,"lbm_reads_lt_1ms":408,"lbm_write_time_us":20943,"lbm_writes_lt_1ms":392,"num_input_rowsets":2,"peak_mem_usage":5058434,"rows_written":316500}
I20251211 09:11:53.810529 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3536089 bytes on disk
I20251211 09:11:53.810782 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":63,"lbm_reads_lt_1ms":4}
I20251211 09:11:53.810946 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:53.825657 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.696s user 0.331s sys 0.018s Metrics: {"bytes_written":8631514,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1228134,"cfile_cache_miss":381,"cfile_cache_miss_bytes":21415246,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":23729,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":874,"drs_written":1,"lbm_read_time_us":18739,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":402,"lbm_write_time_us":29690,"lbm_writes_1-10_ms":8,"lbm_writes_lt_1ms":376,"num_input_rowsets":2,"peak_mem_usage":4951849,"rows_written":309500,"spinlock_wait_cycles":768,"thread_start_us":2855,"threads_started":6}
I20251211 09:11:53.825958 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:11:53.848273 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.037s user 0.025s sys 0.003s Metrics: {"bytes_written":656261,"cfile_init":1,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2823,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":23000}
I20251211 09:11:53.848557 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1069673 bytes of WAL
I20251211 09:11:53.848729 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:53.848814 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000011 (ops 5835-6423)
I20251211 09:11:53.849730 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:53.849893 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 222991 bytes on disk
I20251211 09:11:53.850100 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":39,"lbm_reads_lt_1ms":4}
I20251211 09:11:53.850384 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011426
I20251211 09:11:53.897230 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.071s user 0.035s sys 0.000s Metrics: {"bytes_written":863656,"cfile_init":1,"dirs.queue_time_us":864,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":2422,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4952,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":54,"peak_mem_usage":0,"rows_written":30450}
I20251211 09:11:53.897550 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1047005 bytes of WAL
I20251211 09:11:53.898010 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:53.898041 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000010 (ops 5719-6330)
I20251211 09:11:53.899542 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:53.899701 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3754995 bytes on disk
I20251211 09:11:53.899919 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":37,"lbm_reads_lt_1ms":8}
I20251211 09:11:53.900069 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011425
I20251211 09:11:54.097095 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.521s user 0.346s sys 0.024s Metrics: {"bytes_written":9136169,"cfile_cache_hit":13,"cfile_cache_hit_bytes":919495,"cfile_cache_miss":401,"cfile_cache_miss_bytes":23044753,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":1252,"drs_written":1,"lbm_read_time_us":15194,"lbm_reads_lt_1ms":429,"lbm_write_time_us":23443,"lbm_writes_lt_1ms":405,"num_input_rowsets":2,"peak_mem_usage":5238158,"rows_written":327650,"spinlock_wait_cycles":2048,"thread_start_us":224,"threads_started":5}
I20251211 09:11:54.097476 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:54.138851 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.041s user 0.027s sys 0.000s Metrics: {"bytes_written":639263,"cfile_init":1,"dirs.queue_time_us":17,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":658,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1557,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":22350,"spinlock_wait_cycles":161024}
I20251211 09:11:54.139179 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1048434 bytes of WAL
I20251211 09:11:54.139333 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:54.139472 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000011 (ops 6291-6920)
I20251211 09:11:54.139914 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:54.140091 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011315
I20251211 09:11:54.298228 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.448s user 0.357s sys 0.019s Metrics: {"bytes_written":9464759,"cfile_cache_hit":13,"cfile_cache_hit_bytes":923746,"cfile_cache_miss":413,"cfile_cache_miss_bytes":23919396,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":591,"drs_written":1,"lbm_read_time_us":11649,"lbm_reads_lt_1ms":433,"lbm_write_time_us":19779,"lbm_writes_lt_1ms":421,"num_input_rowsets":2,"peak_mem_usage":5430406,"rows_written":339500,"spinlock_wait_cycles":100736}
I20251211 09:11:54.298501 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:54.326936 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.028s user 0.021s sys 0.003s Metrics: {"bytes_written":521265,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":500,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2137,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":18300}
I20251211 09:11:54.327181 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1055341 bytes of WAL
I20251211 09:11:54.327298 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:54.327353 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000012 (ops 6424-7004)
I20251211 09:11:54.328337 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:54.328531 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3975824 bytes on disk
I20251211 09:11:54.328756 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":53,"lbm_reads_lt_1ms":8}
I20251211 09:11:54.328907 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011237
I20251211 09:11:54.673267 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.773s user 0.368s sys 0.014s Metrics: {"bytes_written":9476078,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1181962,"cfile_cache_miss":415,"cfile_cache_miss_bytes":23677310,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":23196,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":2182,"drs_written":1,"lbm_read_time_us":27567,"lbm_reads_1-10_ms":7,"lbm_reads_lt_1ms":428,"lbm_write_time_us":32739,"lbm_writes_1-10_ms":5,"lbm_writes_lt_1ms":416,"num_input_rowsets":2,"peak_mem_usage":5428606,"rows_written":339950,"thread_start_us":256,"threads_started":6}
I20251211 09:11:54.673594 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3807493 bytes on disk
I20251211 09:11:54.675072 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.535s user 0.347s sys 0.040s Metrics: {"bytes_written":9753413,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1084546,"cfile_cache_miss":426,"cfile_cache_miss_bytes":24532198,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":16,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":720,"drs_written":1,"lbm_read_time_us":19341,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":453,"lbm_write_time_us":22425,"lbm_writes_lt_1ms":433,"num_input_rowsets":2,"peak_mem_usage":5598365,"rows_written":350000,"spinlock_wait_cycles":4865152}
I20251211 09:11:54.675433 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 3923847 bytes on disk
I20251211 09:11:54.675530 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:11:54.675711 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:11:54.678283 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:54.678395 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:54.739727 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.411s user 0.347s sys 0.044s Metrics: {"bytes_written":9972885,"cfile_cache_hit":11,"cfile_cache_hit_bytes":583790,"cfile_cache_miss":443,"cfile_cache_miss_bytes":25608208,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":152,"dirs.run_wall_time_us":781,"drs_written":1,"lbm_read_time_us":13665,"lbm_reads_lt_1ms":463,"lbm_write_time_us":18017,"lbm_writes_lt_1ms":442,"num_input_rowsets":2,"peak_mem_usage":5732463,"rows_written":357800,"spinlock_wait_cycles":642688}
I20251211 09:11:54.739960 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:54.748714 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.070s user 0.027s sys 0.004s Metrics: {"bytes_written":648527,"cfile_init":1,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":574,"drs_written":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4731,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":46,"peak_mem_usage":0,"rows_written":22700}
I20251211 09:11:54.750309 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 217064 bytes on disk
I20251211 09:11:54.750535 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:11:54.750797 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011082
I20251211 09:11:54.751557 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.076s user 0.031s sys 0.007s Metrics: {"bytes_written":926523,"cfile_init":1,"dirs.queue_time_us":37,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2832,"lbm_writes_lt_1ms":59,"peak_mem_usage":0,"rows_written":32600}
I20251211 09:11:54.752800 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1061400 bytes of WAL
I20251211 09:11:54.753439 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:54.753484 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000011 (ops 6331-6980)
I20251211 09:11:54.753815 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:54.753926 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 316870 bytes on disk
I20251211 09:11:54.755959 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:54.756081 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011087
I20251211 09:11:54.767201 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.027s user 0.023s sys 0.000s Metrics: {"bytes_written":482839,"cfile_init":1,"dirs.queue_time_us":30,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1076,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16950}
I20251211 09:11:54.767462 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4173796 bytes on disk
I20251211 09:11:54.767657 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20251211 09:11:54.767850 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.011054
I20251211 09:11:55.234206 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.466s user 0.373s sys 0.043s Metrics: {"bytes_written":10441024,"cfile_cache_hit":11,"cfile_cache_hit_bytes":580113,"cfile_cache_miss":461,"cfile_cache_miss_bytes":26864831,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":5133,"dirs.run_cpu_time_us":126,"dirs.run_wall_time_us":826,"drs_written":1,"lbm_read_time_us":15266,"lbm_reads_lt_1ms":481,"lbm_write_time_us":19686,"lbm_writes_lt_1ms":462,"num_input_rowsets":2,"peak_mem_usage":6007586,"rows_written":374750}
I20251211 09:11:55.234551 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:55.269536 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.035s user 0.017s sys 0.004s Metrics: {"bytes_written":424571,"cfile_init":1,"dirs.queue_time_us":114,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":651,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2085,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14800}
I20251211 09:11:55.269788 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4347486 bytes on disk
I20251211 09:11:55.269968 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":28,"lbm_reads_lt_1ms":8}
I20251211 09:11:55.270085 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010829
I20251211 09:11:55.275751 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.525s user 0.397s sys 0.015s Metrics: {"bytes_written":10382283,"cfile_cache_hit":11,"cfile_cache_hit_bytes":596487,"cfile_cache_miss":459,"cfile_cache_miss_bytes":26683379,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":826,"drs_written":1,"lbm_read_time_us":13773,"lbm_reads_lt_1ms":479,"lbm_write_time_us":23433,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":457,"num_input_rowsets":2,"peak_mem_usage":5970169,"rows_written":372700,"spinlock_wait_cycles":1721856,"thread_start_us":188,"threads_started":5}
I20251211 09:11:55.278918 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:55.335104 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.055s user 0.025s sys 0.000s Metrics: {"bytes_written":517293,"cfile_init":1,"dirs.queue_time_us":4460,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":4201,"drs_written":1,"lbm_read_time_us":28,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8766,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":41,"peak_mem_usage":0,"rows_written":18150}
I20251211 09:11:55.335391 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1052235 bytes of WAL
I20251211 09:11:55.335559 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:55.335642 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000012 (ops 6921-7553)
I20251211 09:11:55.336125 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:55.336311 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4357805 bytes on disk
I20251211 09:11:55.337404 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":42,"lbm_reads_lt_1ms":8}
I20251211 09:11:55.337652 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010847
I20251211 09:11:55.352285 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.596s user 0.369s sys 0.050s Metrics: {"bytes_written":10378883,"cfile_cache_hit":11,"cfile_cache_hit_bytes":623462,"cfile_cache_miss":459,"cfile_cache_miss_bytes":26624628,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":799,"drs_written":1,"lbm_read_time_us":26121,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":476,"lbm_write_time_us":26828,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":457,"num_input_rowsets":2,"peak_mem_usage":5956169,"rows_written":372550,"spinlock_wait_cycles":1259776,"thread_start_us":280,"threads_started":5}
I20251211 09:11:55.353318 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4183401 bytes on disk
I20251211 09:11:55.353480 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:55.353645 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:55.415190 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.061s user 0.028s sys 0.000s Metrics: {"bytes_written":600098,"cfile_init":1,"dirs.queue_time_us":2291,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":879,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3680,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":21000}
I20251211 09:11:55.415413 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1050065 bytes of WAL
I20251211 09:11:55.417661 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:55.417716 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000012 (ops 6981-7630)
I20251211 09:11:55.418496 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:55.418677 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 200610 bytes on disk
I20251211 09:11:55.420397 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:11:55.420879 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010820
I20251211 09:11:55.500454 479 test_util.cc:276] Using random seed: -1991520349
I20251211 09:11:55.512522 479 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20251211 09:11:55.784193 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.514s user 0.407s sys 0.022s Metrics: {"bytes_written":10846230,"cfile_cache_hit":11,"cfile_cache_hit_bytes":574025,"cfile_cache_miss":479,"cfile_cache_miss_bytes":27963913,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":752,"drs_written":1,"lbm_read_time_us":16735,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":498,"lbm_write_time_us":22526,"lbm_writes_lt_1ms":478,"num_input_rowsets":2,"peak_mem_usage":6250220,"rows_written":389550,"spinlock_wait_cycles":5632,"thread_start_us":271,"threads_started":5}
I20251211 09:11:55.784592 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1166031 bytes of WAL
I20251211 09:11:55.784816 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:55.784924 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000013 (ops 7005-7646)
I20251211 09:11:55.785531 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:55.785701 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:55.819437 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.033s user 0.013s sys 0.011s Metrics: {"bytes_written":446379,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":533,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1069,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":15500}
I20251211 09:11:55.820209 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010740
I20251211 09:11:55.911471 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.490s user 0.409s sys 0.032s Metrics: {"bytes_written":10959063,"cfile_cache_hit":13,"cfile_cache_hit_bytes":813416,"cfile_cache_miss":479,"cfile_cache_miss_bytes":28007868,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":612,"drs_written":1,"lbm_read_time_us":12371,"lbm_reads_lt_1ms":499,"lbm_write_time_us":22707,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":484,"num_input_rowsets":2,"peak_mem_usage":6309010,"rows_written":393550,"spinlock_wait_cycles":1152,"thread_start_us":201,"threads_started":5}
I20251211 09:11:55.911823 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:55.932423 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.020s user 0.019s sys 0.000s Metrics: {"bytes_written":413172,"cfile_init":1,"dirs.queue_time_us":1484,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":907,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14350}
I20251211 09:11:55.932830 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010684
I20251211 09:11:55.950974 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.613s user 0.392s sys 0.044s Metrics: {"bytes_written":10882653,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1553197,"cfile_cache_miss":473,"cfile_cache_miss_bytes":27073341,"cfile_init":5,"delta_iterators_relevant":4,"drs_written":1,"lbm_read_time_us":16361,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":492,"lbm_write_time_us":21508,"lbm_writes_lt_1ms":480,"num_input_rowsets":2,"peak_mem_usage":6267987,"rows_written":390850,"spinlock_wait_cycles":768,"thread_start_us":401,"threads_started":7}
I20251211 09:11:55.951287 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:55.984140 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.032s user 0.020s sys 0.002s Metrics: {"bytes_written":517310,"cfile_init":1,"drs_written":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1024,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":18150}
I20251211 09:11:55.984429 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010676
I20251211 09:11:56.294133 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.474s user 0.380s sys 0.070s Metrics: {"bytes_written":11273486,"cfile_cache_hit":11,"cfile_cache_hit_bytes":576319,"cfile_cache_miss":497,"cfile_cache_miss_bytes":29098913,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":687,"drs_written":1,"lbm_read_time_us":14712,"lbm_reads_lt_1ms":525,"lbm_write_time_us":23259,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":497,"num_input_rowsets":2,"peak_mem_usage":6501376,"rows_written":405050,"spinlock_wait_cycles":1280}
I20251211 09:11:56.298327 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:56.338428 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.040s user 0.020s sys 0.000s Metrics: {"bytes_written":366471,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":742,"drs_written":1,"lbm_read_time_us":522,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1518,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12700}
I20251211 09:11:56.339126 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010473
I20251211 09:11:56.427279 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.494s user 0.426s sys 0.021s Metrics: {"bytes_written":11355078,"cfile_cache_hit":11,"cfile_cache_hit_bytes":572885,"cfile_cache_miss":503,"cfile_cache_miss_bytes":29318657,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":522,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":4698,"drs_written":1,"lbm_read_time_us":14460,"lbm_reads_lt_1ms":531,"lbm_write_time_us":20614,"lbm_writes_lt_1ms":502,"num_input_rowsets":2,"peak_mem_usage":6547186,"rows_written":407900,"spinlock_wait_cycles":2048,"thread_start_us":122,"threads_started":1}
I20251211 09:11:56.427624 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4592816 bytes on disk
I20251211 09:11:56.427794 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:56.428094 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:56.453121 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.025s user 0.020s sys 0.000s Metrics: {"bytes_written":406822,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":2593,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":825,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14100}
I20251211 09:11:56.453436 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1056412 bytes of WAL
I20251211 09:11:56.453573 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:56.453655 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000013 (ops 7631-8259)
I20251211 09:11:56.454123 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:56.454277 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 131887 bytes on disk
I20251211 09:11:56.454489 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:11:56.454636 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010429
I20251211 09:11:56.530620 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.546s user 0.421s sys 0.029s Metrics: {"bytes_written":11386921,"cfile_cache_hit":11,"cfile_cache_hit_bytes":583932,"cfile_cache_miss":501,"cfile_cache_miss_bytes":29375972,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":11053,"drs_written":1,"lbm_read_time_us":14933,"lbm_reads_lt_1ms":529,"lbm_write_time_us":25078,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":502,"num_input_rowsets":2,"peak_mem_usage":6561253,"rows_written":409000,"spinlock_wait_cycles":1152,"thread_start_us":205,"threads_started":5}
I20251211 09:11:56.531615 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:56.562238 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.030s user 0.021s sys 0.000s Metrics: {"bytes_written":451501,"cfile_init":1,"dirs.queue_time_us":1435,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":728,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":907,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":15700}
I20251211 09:11:56.562469 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1088985 bytes of WAL
I20251211 09:11:56.562685 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:56.562742 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000013 (ops 7554-8201)
I20251211 09:11:56.563433 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:56.563563 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010429
I20251211 09:11:56.910964 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.571s user 0.446s sys 0.029s Metrics: {"bytes_written":11628844,"cfile_cache_hit":12,"cfile_cache_hit_bytes":706527,"cfile_cache_miss":512,"cfile_cache_miss_bytes":29909121,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":874,"drs_written":1,"lbm_read_time_us":15493,"lbm_reads_lt_1ms":540,"lbm_write_time_us":29721,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":511,"num_input_rowsets":2,"peak_mem_usage":6713842,"rows_written":417750,"spinlock_wait_cycles":3456}
I20251211 09:11:56.911286 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1143942 bytes of WAL
I20251211 09:11:56.911490 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:56.911578 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000014 (ops 7647-8276)
I20251211 09:11:56.912051 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:56.912227 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:56.960037 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.048s user 0.029s sys 0.001s Metrics: {"bytes_written":568488,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":4670,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1985,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":19950}
I20251211 09:11:56.960332 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4897417 bytes on disk
I20251211 09:11:56.960580 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20251211 09:11:56.960763 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010353
I20251211 09:11:57.051120 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.596s user 0.420s sys 0.046s Metrics: {"bytes_written":11743560,"cfile_cache_hit":12,"cfile_cache_hit_bytes":732560,"cfile_cache_miss":520,"cfile_cache_miss_bytes":30195870,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":66,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":5055,"drs_written":1,"lbm_read_time_us":16672,"lbm_reads_lt_1ms":540,"lbm_write_time_us":25815,"lbm_writes_lt_1ms":518,"num_input_rowsets":2,"peak_mem_usage":6783148,"rows_written":422000,"spinlock_wait_cycles":102400,"thread_start_us":417,"threads_started":5}
I20251211 09:11:57.051486 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:57.084079 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.032s user 0.026s sys 0.000s Metrics: {"bytes_written":581424,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":3639,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1184,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20450}
I20251211 09:11:57.084590 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010304
I20251211 09:11:57.286325 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.723s user 0.435s sys 0.041s Metrics: {"bytes_written":11821288,"cfile_cache_hit":13,"cfile_cache_hit_bytes":897947,"cfile_cache_miss":521,"cfile_cache_miss_bytes":30224575,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":482,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":7126,"drs_written":1,"lbm_read_time_us":21544,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":545,"lbm_write_time_us":33882,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":517,"num_input_rowsets":2,"peak_mem_usage":6825416,"rows_written":424700,"spinlock_wait_cycles":820480,"thread_start_us":469,"threads_started":6}
I20251211 09:11:57.286674 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4787083 bytes on disk
I20251211 09:11:57.287129 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4}
I20251211 09:11:57.287338 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:57.324594 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.037s user 0.030s sys 0.000s Metrics: {"bytes_written":663959,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":608,"drs_written":1,"lbm_read_time_us":148,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3149,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":46,"peak_mem_usage":0,"rows_written":23300}
I20251211 09:11:57.324887 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1058469 bytes of WAL
I20251211 09:11:57.325063 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:57.325142 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000014 (ops 8202-8833)
I20251211 09:11:57.326339 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:57.326710 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010197
I20251211 09:11:57.517642 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.557s user 0.461s sys 0.028s Metrics: {"bytes_written":12177177,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1550429,"cfile_cache_miss":531,"cfile_cache_miss_bytes":30520171,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":691,"drs_written":1,"lbm_read_time_us":16982,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":550,"lbm_write_time_us":23527,"lbm_writes_lt_1ms":535,"num_input_rowsets":2,"peak_mem_usage":7029098,"rows_written":437700,"spinlock_wait_cycles":4608}
I20251211 09:11:57.517879 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:57.584930 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.067s user 0.020s sys 0.003s Metrics: {"bytes_written":437390,"cfile_init":1,"dirs.queue_time_us":154,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":2812,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6013,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":15300}
I20251211 09:11:57.585316 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1124324 bytes of WAL
I20251211 09:11:57.588366 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.503s user 0.452s sys 0.027s Metrics: {"bytes_written":12310951,"cfile_cache_hit":12,"cfile_cache_hit_bytes":849905,"cfile_cache_miss":542,"cfile_cache_miss_bytes":31571467,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":136,"dirs.run_wall_time_us":740,"drs_written":1,"lbm_read_time_us":15133,"lbm_reads_lt_1ms":570,"lbm_write_time_us":24186,"lbm_writes_lt_1ms":541,"num_input_rowsets":2,"peak_mem_usage":7107430,"rows_written":442450,"spinlock_wait_cycles":4608,"thread_start_us":248,"threads_started":5}
I20251211 09:11:57.588699 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 4992804 bytes on disk
I20251211 09:11:57.588958 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":45,"lbm_reads_lt_1ms":4}
I20251211 09:11:57.589136 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:57.592170 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:57.592270 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000015 (ops 8277-8895)
I20251211 09:11:57.592741 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:57.593096 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010137
I20251211 09:11:57.615895 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.026s user 0.018s sys 0.000s Metrics: {"bytes_written":362693,"cfile_init":1,"dirs.queue_time_us":540,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4181,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":12550}
I20251211 09:11:57.616704 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1047459 bytes of WAL
I20251211 09:11:57.616837 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:57.616882 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000014 (ops 8260-8887)
I20251211 09:11:57.617336 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:57.617446 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010113
I20251211 09:11:57.903609 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.577s user 0.467s sys 0.033s Metrics: {"bytes_written":12461369,"cfile_cache_hit":13,"cfile_cache_hit_bytes":918981,"cfile_cache_miss":545,"cfile_cache_miss_bytes":31910777,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":169,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":1354,"drs_written":1,"lbm_read_time_us":16084,"lbm_reads_lt_1ms":569,"lbm_write_time_us":27477,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":546,"num_input_rowsets":2,"peak_mem_usage":7196412,"rows_written":448000,"spinlock_wait_cycles":343552,"thread_start_us":201,"threads_started":5}
I20251211 09:11:57.903930 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:11:57.934080 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.030s user 0.021s sys 0.003s Metrics: {"bytes_written":507154,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":4650,"drs_written":1,"lbm_read_time_us":44,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2630,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":41,"peak_mem_usage":0,"rows_written":17750}
I20251211 09:11:57.934437 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.010085
I20251211 09:11:58.229883 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.612s user 0.454s sys 0.051s Metrics: {"bytes_written":12660545,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1062810,"cfile_cache_miss":552,"cfile_cache_miss_bytes":32302318,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":62,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":862,"drs_written":1,"lbm_read_time_us":16117,"lbm_reads_lt_1ms":576,"lbm_write_time_us":27287,"lbm_writes_lt_1ms":556,"num_input_rowsets":2,"peak_mem_usage":7315963,"rows_written":455000,"spinlock_wait_cycles":2816,"thread_start_us":811,"threads_started":5}
I20251211 09:11:58.230244 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:58.288844 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.058s user 0.024s sys 0.007s Metrics: {"bytes_written":690216,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":598,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1350,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":24150}
I20251211 09:11:58.289108 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009929
I20251211 09:11:58.552719 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.957s user 0.466s sys 0.039s Metrics: {"bytes_written":12600311,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1055068,"cfile_cache_miss":552,"cfile_cache_miss_bytes":32150256,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":12369,"dirs.run_cpu_time_us":143,"dirs.run_wall_time_us":988,"drs_written":1,"lbm_read_time_us":22024,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":578,"lbm_write_time_us":37185,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":549,"num_input_rowsets":2,"peak_mem_usage":7285657,"rows_written":453000,"spinlock_wait_cycles":21632,"thread_start_us":344,"threads_started":6}
I20251211 09:11:58.553094 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:11:58.625535 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.072s user 0.045s sys 0.005s Metrics: {"bytes_written":1057015,"cfile_init":1,"dirs.queue_time_us":85,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":680,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5336,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":61,"peak_mem_usage":0,"rows_written":37300}
I20251211 09:11:58.626099 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049705 bytes of WAL
I20251211 09:11:58.626441 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:58.626542 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000016 (ops 8896-9473)
I20251211 09:11:58.627147 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:58.627279 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009818
I20251211 09:11:58.641296 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.707s user 0.489s sys 0.029s Metrics: {"bytes_written":12954960,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1060836,"cfile_cache_miss":566,"cfile_cache_miss_bytes":33075236,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":11062,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":2834,"drs_written":1,"lbm_read_time_us":16191,"lbm_reads_lt_1ms":594,"lbm_write_time_us":26441,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":569,"num_input_rowsets":2,"peak_mem_usage":7488730,"rows_written":465750,"spinlock_wait_cycles":381824,"thread_start_us":656,"threads_started":6}
I20251211 09:11:58.641686 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 5261985 bytes on disk
I20251211 09:11:58.641891 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:58.642057 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:58.738057 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.096s user 0.027s sys 0.008s Metrics: {"bytes_written":761826,"cfile_init":1,"dirs.queue_time_us":308,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":902,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":17417,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":48,"peak_mem_usage":0,"rows_written":26750,"spinlock_wait_cycles":8064}
I20251211 09:11:58.738396 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1053929 bytes of WAL
I20251211 09:11:58.742854 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:58.742924 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000015 (ops 8834-9465)
I20251211 09:11:58.743335 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:58.743506 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 257989 bytes on disk
I20251211 09:11:58.743686 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4}
I20251211 09:11:58.743842 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009699
I20251211 09:11:58.997498 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.708s user 0.488s sys 0.033s Metrics: {"bytes_written":13325698,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1537813,"cfile_cache_miss":577,"cfile_cache_miss_bytes":33585803,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":738,"drs_written":1,"lbm_read_time_us":16186,"lbm_reads_lt_1ms":605,"lbm_write_time_us":31759,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":585,"num_input_rowsets":2,"peak_mem_usage":7700060,"rows_written":479150,"spinlock_wait_cycles":864896,"thread_start_us":270,"threads_started":5}
I20251211 09:11:58.998183 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1056930 bytes of WAL
I20251211 09:11:58.998294 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:58.998417 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000015 (ops 8888-9517)
I20251211 09:11:58.998868 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:59.001761 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 5418031 bytes on disk
I20251211 09:11:59.001986 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:11:59.002094 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:59.036116 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.034s user 0.027s sys 0.002s Metrics: {"bytes_written":704522,"cfile_init":1,"dirs.queue_time_us":2191,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":488,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1338,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":24700}
I20251211 09:11:59.036389 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 238515 bytes on disk
I20251211 09:11:59.036896 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20251211 09:11:59.037684 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009632
I20251211 09:11:59.331286 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.587s user 0.505s sys 0.045s Metrics: {"bytes_written":13695646,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1244008,"cfile_cache_miss":597,"cfile_cache_miss_bytes":34846944,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":626,"drs_written":1,"lbm_read_time_us":17490,"lbm_reads_lt_1ms":617,"lbm_write_time_us":30109,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":601,"num_input_rowsets":2,"peak_mem_usage":7911078,"rows_written":492500,"spinlock_wait_cycles":2432,"thread_start_us":232,"threads_started":5}
I20251211 09:11:59.331681 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:59.371137 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.039s user 0.025s sys 0.004s Metrics: {"bytes_written":616986,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":1730,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1345,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":21650}
I20251211 09:11:59.371412 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049611 bytes of WAL
I20251211 09:11:59.371601 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:59.371711 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000016 (ops 9466-10082)
I20251211 09:11:59.372169 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:59.372306 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 5781615 bytes on disk
I20251211 09:11:59.372525 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20251211 09:11:59.372786 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009526
I20251211 09:11:59.724753 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 1.097s user 0.478s sys 0.078s Metrics: {"bytes_written":13631039,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1418033,"cfile_cache_miss":590,"cfile_cache_miss_bytes":34504087,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":147,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":790,"drs_written":1,"lbm_read_time_us":33607,"lbm_reads_1-10_ms":6,"lbm_reads_lt_1ms":612,"lbm_write_time_us":42015,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":595,"num_input_rowsets":2,"peak_mem_usage":7869719,"rows_written":490300,"spinlock_wait_cycles":726272,"thread_start_us":328,"threads_started":6}
I20251211 09:11:59.725080 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 5546912 bytes on disk
I20251211 09:11:59.725397 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:59.725615 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:11:59.808149 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.082s user 0.032s sys 0.010s Metrics: {"bytes_written":1022029,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":656,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4136,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":61,"peak_mem_usage":0,"rows_written":35950}
I20251211 09:11:59.808480 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009422
I20251211 09:11:59.817384 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.780s user 0.493s sys 0.069s Metrics: {"bytes_written":14006340,"cfile_cache_hit":13,"cfile_cache_hit_bytes":919775,"cfile_cache_miss":613,"cfile_cache_miss_bytes":36013517,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":11365,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":973,"drs_written":1,"lbm_read_time_us":20467,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":632,"lbm_write_time_us":33688,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":613,"num_input_rowsets":2,"peak_mem_usage":8100853,"rows_written":503850,"spinlock_wait_cycles":1664,"thread_start_us":1711,"threads_started":6}
I20251211 09:11:59.817613 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 5702458 bytes on disk
I20251211 09:11:59.817742 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:11:59.818468 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:11:59.866832 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.047s user 0.031s sys 0.000s Metrics: {"bytes_written":711108,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":619,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3714,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":48,"peak_mem_usage":0,"rows_written":24950}
I20251211 09:11:59.867151 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1055412 bytes of WAL
I20251211 09:11:59.867841 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:11:59.867925 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000016 (ops 9518-10130)
I20251211 09:11:59.868489 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:11:59.868644 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 239981 bytes on disk
I20251211 09:11:59.868844 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:11:59.869005 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009393
I20251211 09:12:00.019285 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.646s user 0.495s sys 0.080s Metrics: {"bytes_written":14291325,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1232253,"cfile_cache_miss":622,"cfile_cache_miss_bytes":36466579,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":479,"drs_written":1,"lbm_read_time_us":19510,"lbm_reads_lt_1ms":642,"lbm_write_time_us":31342,"lbm_writes_lt_1ms":626,"num_input_rowsets":2,"peak_mem_usage":8271275,"rows_written":514150,"spinlock_wait_cycles":9344,"thread_start_us":268,"threads_started":5}
I20251211 09:12:00.019625 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:12:00.062939 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.043s user 0.026s sys 0.002s Metrics: {"bytes_written":616710,"cfile_init":1,"dirs.queue_time_us":464,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":2588,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3101,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":21650}
I20251211 09:12:00.063199 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1058674 bytes of WAL
I20251211 09:12:00.063402 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:00.063484 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000017 (ops 10083-10697)
I20251211 09:12:00.064100 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:00.064262 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009324
I20251211 09:12:00.794461 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.925s user 0.542s sys 0.054s Metrics: {"bytes_written":14696738,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1539065,"cfile_cache_miss":637,"cfile_cache_miss_bytes":37225125,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":9916,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":802,"drs_written":1,"lbm_read_time_us":24952,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":656,"lbm_write_time_us":44307,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":643,"num_input_rowsets":2,"peak_mem_usage":8504366,"rows_written":528800,"spinlock_wait_cycles":2688,"thread_start_us":88,"threads_started":1}
I20251211 09:12:00.795507 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:00.817632 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 1.009s user 0.540s sys 0.050s Metrics: {"bytes_written":14627282,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1584221,"cfile_cache_miss":633,"cfile_cache_miss_bytes":36983401,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":11519,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":1264,"drs_written":1,"lbm_read_time_us":27458,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":656,"lbm_write_time_us":43485,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":636,"num_input_rowsets":2,"peak_mem_usage":8453573,"rows_written":526250,"spinlock_wait_cycles":5888,"thread_start_us":338,"threads_started":6}
I20251211 09:12:00.818064 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1055299 bytes of WAL
I20251211 09:12:00.818328 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:00.818375 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000017 (ops 9474-10054)
I20251211 09:12:00.819082 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:00.819262 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 5962226 bytes on disk
I20251211 09:12:00.819402 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:00.819646 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:00.854557 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.059s user 0.038s sys 0.004s Metrics: {"bytes_written":981364,"cfile_init":1,"dirs.queue_time_us":29,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4000,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":59,"peak_mem_usage":0,"rows_written":34550}
I20251211 09:12:00.854908 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1062923 bytes of WAL
I20251211 09:12:00.855116 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:00.855222 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000017 (ops 10131-10748)
I20251211 09:12:00.855850 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:00.856000 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009063
I20251211 09:12:00.918201 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.098s user 0.040s sys 0.005s Metrics: {"bytes_written":1071511,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":750,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5032,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":63,"peak_mem_usage":0,"rows_written":37700}
I20251211 09:12:00.918442 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 2153963 bytes of WAL
I20251211 09:12:00.918593 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 2 log segments from log reader
I20251211 09:12:00.918661 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000018 (ops 10055-10657)
I20251211 09:12:00.918732 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000019 (ops 10658-11240)
I20251211 09:12:00.919479 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:00.919659 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009056
I20251211 09:12:00.931177 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.867s user 0.531s sys 0.070s Metrics: {"bytes_written":14891514,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1225871,"cfile_cache_miss":647,"cfile_cache_miss_bytes":38061463,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":12725,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":21489,"drs_written":1,"lbm_read_time_us":26264,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":674,"lbm_write_time_us":48952,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":647,"num_input_rowsets":2,"peak_mem_usage":8621415,"rows_written":535800,"spinlock_wait_cycles":3072,"thread_start_us":398,"threads_started":6}
I20251211 09:12:00.931502 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:00.972222 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.041s user 0.033s sys 0.004s Metrics: {"bytes_written":881727,"cfile_init":1,"dirs.queue_time_us":757,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":3434,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1901,"lbm_writes_lt_1ms":57,"peak_mem_usage":0,"rows_written":31000}
I20251211 09:12:00.972494 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1060967 bytes of WAL
I20251211 09:12:00.972640 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:00.972724 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000018 (ops 10698-11313)
I20251211 09:12:00.973212 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:00.973384 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.009022
I20251211 09:12:01.836784 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.981s user 0.595s sys 0.030s Metrics: {"bytes_written":15651107,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1732260,"cfile_cache_miss":680,"cfile_cache_miss_bytes":39559274,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":25984,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":4098,"drs_written":1,"lbm_read_time_us":37074,"lbm_reads_1-10_ms":6,"lbm_reads_lt_1ms":702,"lbm_write_time_us":43413,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":679,"num_input_rowsets":2,"peak_mem_usage":9057810,"rows_written":563350,"spinlock_wait_cycles":2944,"thread_start_us":372,"threads_started":6}
I20251211 09:12:01.837118 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 6391398 bytes on disk
I20251211 09:12:01.837291 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:01.837486 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:01.837700 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.864s user 0.595s sys 0.030s Metrics: {"bytes_written":15748179,"cfile_cache_hit":12,"cfile_cache_hit_bytes":778612,"cfile_cache_miss":690,"cfile_cache_miss_bytes":40769056,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":17938,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":1597,"drs_written":1,"lbm_read_time_us":26065,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":717,"lbm_write_time_us":42705,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":686,"num_input_rowsets":2,"peak_mem_usage":9119069,"rows_written":566800,"spinlock_wait_cycles":1705216,"thread_start_us":288,"threads_started":6}
I20251211 09:12:01.837826 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:01.841113 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.921s user 0.576s sys 0.059s Metrics: {"bytes_written":15666960,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1585851,"cfile_cache_miss":681,"cfile_cache_miss_bytes":39755917,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":13632,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":1458,"drs_written":1,"lbm_read_time_us":30774,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":703,"lbm_write_time_us":44887,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":681,"num_input_rowsets":2,"peak_mem_usage":9064403,"rows_written":563950,"spinlock_wait_cycles":873984,"thread_start_us":332,"threads_started":6}
I20251211 09:12:01.841398 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 6398107 bytes on disk
I20251211 09:12:01.841588 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:01.841861 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:01.973657 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.132s user 0.041s sys 0.000s Metrics: {"bytes_written":968172,"cfile_init":1,"dirs.queue_time_us":28,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2251,"lbm_writes_lt_1ms":59,"peak_mem_usage":0,"rows_written":34200}
I20251211 09:12:01.973830 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.136s user 0.031s sys 0.005s Metrics: {"bytes_written":885370,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":93173,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2126,"lbm_writes_lt_1ms":57,"peak_mem_usage":0,"rows_written":31150}
I20251211 09:12:01.973991 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1057932 bytes of WAL
I20251211 09:12:01.974367 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:01.974416 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000019 (ops 11314-11948)
I20251211 09:12:01.974848 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:01.974884 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1058827 bytes of WAL
I20251211 09:12:01.974959 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:01.974956 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.008581
I20251211 09:12:01.975009 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000020 (ops 11241-11823)
I20251211 09:12:01.975236 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.138s user 0.039s sys 0.000s Metrics: {"bytes_written":984121,"cfile_init":1,"dirs.queue_time_us":30,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6423,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":60,"peak_mem_usage":0,"rows_written":34650}
I20251211 09:12:01.975386 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1050698 bytes of WAL
I20251211 09:12:01.975452 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:01.975554 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.008692
I20251211 09:12:01.975658 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:01.975687 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000018 (ops 10749-11361)
I20251211 09:12:01.976089 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:01.976469 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.008693
I20251211 09:12:02.807514 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.832s user 0.607s sys 0.038s Metrics: {"bytes_written":16603722,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1718940,"cfile_cache_miss":718,"cfile_cache_miss_bytes":42124498,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":11837,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":5364,"drs_written":1,"lbm_read_time_us":20953,"lbm_reads_lt_1ms":746,"lbm_write_time_us":39951,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":725,"mutex_wait_us":2,"num_input_rowsets":2,"peak_mem_usage":9623419,"rows_written":597950,"spinlock_wait_cycles":4893824,"thread_start_us":301,"threads_started":6}
I20251211 09:12:02.807832 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 6791746 bytes on disk
I20251211 09:12:02.808034 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:02.808184 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=3.921653
I20251211 09:12:02.895789 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.087s user 0.041s sys 0.000s Metrics: {"bytes_written":1101474,"cfile_init":1,"dirs.queue_time_us":407,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":794,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5114,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":63,"peak_mem_usage":0,"rows_written":38850}
I20251211 09:12:02.896037 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1087734 bytes of WAL
I20251211 09:12:02.896384 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:02.896587 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000020 (ops 11949-12608)
I20251211 09:12:02.897042 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:02.897168 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 386258 bytes on disk
I20251211 09:12:02.897444 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20251211 09:12:02.897590 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.008293
I20251211 09:12:03.067158 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 1.090s user 0.601s sys 0.053s Metrics: {"bytes_written":16605874,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1259258,"cfile_cache_miss":723,"cfile_cache_miss_bytes":42584640,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":366,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":814,"drs_written":1,"lbm_read_time_us":23559,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":746,"lbm_write_time_us":32428,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":726,"num_input_rowsets":2,"peak_mem_usage":9619076,"rows_written":598000,"spinlock_wait_cycles":13696,"thread_start_us":440,"threads_started":6}
I20251211 09:12:03.072414 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=3.921653
I20251211 09:12:03.092454 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 1.114s user 0.607s sys 0.044s Metrics: {"bytes_written":16609763,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1571246,"cfile_cache_miss":719,"cfile_cache_miss_bytes":42284108,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":11112,"dirs.run_cpu_time_us":164,"dirs.run_wall_time_us":6101,"drs_written":1,"lbm_read_time_us":24638,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":741,"lbm_write_time_us":52703,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":723,"num_input_rowsets":2,"peak_mem_usage":9623618,"rows_written":598150,"spinlock_wait_cycles":8594432,"thread_start_us":417,"threads_started":6}
I20251211 09:12:03.092818 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=4.913840
I20251211 09:12:03.152932 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.060s user 0.047s sys 0.004s Metrics: {"bytes_written":1344542,"cfile_init":1,"dirs.queue_time_us":25,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3045,"lbm_writes_lt_1ms":75,"peak_mem_usage":0,"rows_written":47600}
I20251211 09:12:03.153244 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1057069 bytes of WAL
I20251211 09:12:03.153424 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:03.153460 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000021 (ops 11824-12405)
I20251211 09:12:03.154096 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:03.154225 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 7271547 bytes on disk
I20251211 09:12:03.154422 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":39,"lbm_reads_lt_1ms":8}
I20251211 09:12:03.154549 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.008202
I20251211 09:12:03.195096 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.122s user 0.049s sys 0.003s Metrics: {"bytes_written":1330368,"cfile_init":1,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":730,"drs_written":1,"lbm_read_time_us":26,"lbm_reads_lt_1ms":4,"lbm_write_time_us":10226,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":72,"peak_mem_usage":0,"rows_written":47050}
I20251211 09:12:03.195429 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 2142848 bytes of WAL
I20251211 09:12:03.195600 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 2 log segments from log reader
I20251211 09:12:03.195679 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000019 (ops 11362-11987)
I20251211 09:12:03.195755 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000020 (ops 11988-12631)
I20251211 09:12:03.196638 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:03.196794 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.008208
I20251211 09:12:03.729959 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.832s user 0.638s sys 0.061s Metrics: {"bytes_written":17678985,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1267943,"cfile_cache_miss":769,"cfile_cache_miss_bytes":45423847,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":45014,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":93136,"drs_written":1,"lbm_read_time_us":23783,"lbm_reads_lt_1ms":789,"lbm_write_time_us":40096,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":771,"num_input_rowsets":2,"peak_mem_usage":10245337,"rows_written":636800,"spinlock_wait_cycles":2432,"thread_start_us":291,"threads_started":6}
I20251211 09:12:03.730340 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 7240567 bytes on disk
I20251211 09:12:03.730547 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:03.730700 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:12:03.797914 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.067s user 0.029s sys 0.002s Metrics: {"bytes_written":718724,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":936,"drs_written":1,"lbm_read_time_us":763,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3039,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":48,"peak_mem_usage":0,"rows_written":25250}
I20251211 09:12:03.798192 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1050612 bytes of WAL
I20251211 09:12:03.798374 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:03.798467 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000021 (ops 12609-13218)
I20251211 09:12:03.799470 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:03.799646 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.008035
I20251211 09:12:03.916712 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.762s user 0.647s sys 0.044s Metrics: {"bytes_written":17923786,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1447158,"cfile_cache_miss":780,"cfile_cache_miss_bytes":45888724,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":8581,"dirs.run_cpu_time_us":79,"dirs.run_wall_time_us":30328,"drs_written":1,"lbm_read_time_us":21041,"lbm_reads_lt_1ms":800,"lbm_write_time_us":31697,"lbm_writes_lt_1ms":781,"num_input_rowsets":2,"peak_mem_usage":10383652,"rows_written":645750,"spinlock_wait_cycles":7632000,"thread_start_us":336,"threads_started":6}
I20251211 09:12:03.917217 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:12:03.984808 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.067s user 0.030s sys 0.001s Metrics: {"bytes_written":656139,"cfile_init":1,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":3871,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1576,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":23000}
I20251211 09:12:03.985039 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.007969
I20251211 09:12:04.265498 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 1.069s user 0.613s sys 0.084s Metrics: {"bytes_written":17906279,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1758161,"cfile_cache_miss":776,"cfile_cache_miss_bytes":45527077,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":8824,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":1090,"drs_written":1,"lbm_read_time_us":31227,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":802,"lbm_write_time_us":52138,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":777,"num_input_rowsets":2,"peak_mem_usage":10372829,"rows_written":645050,"spinlock_wait_cycles":2626304,"thread_start_us":405,"threads_started":6}
I20251211 09:12:04.265928 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 7335851 bytes on disk
I20251211 09:12:04.266626 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:04.266836 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:04.374007 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.107s user 0.036s sys 0.003s Metrics: {"bytes_written":994464,"cfile_init":1,"dirs.queue_time_us":1151,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":842,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6181,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":59,"peak_mem_usage":0,"rows_written":35050}
I20251211 09:12:04.374598 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1049921 bytes of WAL
I20251211 09:12:04.376336 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:04.376641 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000021 (ops 12632-13244)
I20251211 09:12:04.378026 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:04.378574 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.007853
I20251211 09:12:04.577057 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.777s user 0.627s sys 0.076s Metrics: {"bytes_written":18375321,"cfile_cache_hit":13,"cfile_cache_hit_bytes":917243,"cfile_cache_miss":801,"cfile_cache_miss_bytes":47654927,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":13139,"dirs.run_cpu_time_us":144,"dirs.run_wall_time_us":700,"drs_written":1,"lbm_read_time_us":21843,"lbm_reads_lt_1ms":825,"lbm_write_time_us":37502,"lbm_writes_lt_1ms":803,"num_input_rowsets":2,"peak_mem_usage":10674180,"rows_written":662050,"spinlock_wait_cycles":5244672,"thread_start_us":317,"threads_started":6}
I20251211 09:12:04.577476 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:12:04.612685 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.035s user 0.032s sys 0.000s Metrics: {"bytes_written":771026,"cfile_init":1,"dirs.queue_time_us":23,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1584,"lbm_writes_lt_1ms":51,"peak_mem_usage":0,"rows_written":27100}
I20251211 09:12:04.613104 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 7798591 bytes on disk
I20251211 09:12:04.613389 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":42,"lbm_reads_lt_1ms":8}
I20251211 09:12:04.613583 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.007730
I20251211 09:12:05.042862 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 1.055s user 0.678s sys 0.051s Metrics: {"bytes_written":18558498,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1664265,"cfile_cache_miss":802,"cfile_cache_miss_bytes":47393943,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":404,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":894,"drs_written":1,"lbm_read_time_us":27613,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":829,"lbm_write_time_us":47362,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":807,"num_input_rowsets":2,"peak_mem_usage":10785303,"rows_written":668750,"spinlock_wait_cycles":37248,"thread_start_us":266,"threads_started":6}
I20251211 09:12:05.043449 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1124392 bytes of WAL
I20251211 09:12:05.043579 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:05.043608 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000022 (ops 12406-13024)
I20251211 09:12:05.043962 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:05.044039 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 7610141 bytes on disk
I20251211 09:12:05.044137 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:05.044205 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.929465
I20251211 09:12:05.116730 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.072s user 0.041s sys 0.000s Metrics: {"bytes_written":980120,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":808,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3192,"lbm_writes_lt_1ms":60,"peak_mem_usage":0,"rows_written":34500}
I20251211 09:12:05.118505 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1067831 bytes of WAL
I20251211 09:12:05.118743 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:05.118800 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000023 (ops 13025-13612)
I20251211 09:12:05.119264 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:05.119455 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 340669 bytes on disk
I20251211 09:12:05.119603 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":26,"lbm_reads_lt_1ms":4}
I20251211 09:12:05.119728 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.007586
I20251211 09:12:05.464620 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.851s user 0.674s sys 0.065s Metrics: {"bytes_written":19122534,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1386603,"cfile_cache_miss":832,"cfile_cache_miss_bytes":49173239,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":9262,"dirs.run_cpu_time_us":126,"dirs.run_wall_time_us":7960,"drs_written":1,"lbm_read_time_us":25268,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":851,"lbm_write_time_us":42705,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":831,"num_input_rowsets":2,"peak_mem_usage":11112675,"rows_written":689150,"spinlock_wait_cycles":557184,"thread_start_us":60,"threads_started":1}
I20251211 09:12:05.465701 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 7845835 bytes on disk
I20251211 09:12:05.465934 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:05.466322 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.937278
I20251211 09:12:05.513113 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.047s user 0.030s sys 0.003s Metrics: {"bytes_written":789471,"cfile_init":1,"dirs.queue_time_us":207,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":14698,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1882,"lbm_writes_lt_1ms":52,"peak_mem_usage":0,"rows_written":27650}
I20251211 09:12:05.514310 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1055969 bytes of WAL
I20251211 09:12:05.514490 10773 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:05.514583 10773 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000022 (ops 13219-13836)
I20251211 09:12:05.515400 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:05.515601 10833 maintenance_manager.cc:419] P 0746569747b045f2ae635513af494c62: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.007441
I20251211 09:12:05.536895 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 1.158s user 0.684s sys 0.047s Metrics: {"bytes_written":18869784,"cfile_cache_hit":20,"cfile_cache_hit_bytes":2030863,"cfile_cache_miss":814,"cfile_cache_miss_bytes":47843961,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":13257,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":2526,"drs_written":1,"lbm_read_time_us":38914,"lbm_reads_1-10_ms":5,"lbm_reads_lt_1ms":833,"lbm_write_time_us":57436,"lbm_writes_1-10_ms":9,"lbm_writes_lt_1ms":815,"num_input_rowsets":2,"peak_mem_usage":10956011,"rows_written":680100,"spinlock_wait_cycles":8960,"thread_start_us":260,"threads_started":6}
I20251211 09:12:05.537279 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=3.922158
I20251211 09:12:05.582082 479 test_util.cc:276] Using random seed: -1981438721
I20251211 09:12:05.590395 479 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20251211 09:12:05.598428 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.061s user 0.038s sys 0.007s Metrics: {"bytes_written":1085987,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":3943,"drs_written":1,"lbm_read_time_us":11,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2018,"lbm_writes_lt_1ms":64,"peak_mem_usage":0,"rows_written":38250}
I20251211 09:12:05.598771 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1052607 bytes of WAL
I20251211 09:12:05.598946 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:05.599020 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000022 (ops 13245-13852)
I20251211 09:12:05.599419 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:05.599538 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 8121131 bytes on disk
I20251211 09:12:05.599756 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20251211 09:12:05.599920 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.007429
I20251211 09:12:06.083323 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.963s user 0.705s sys 0.061s Metrics: {"bytes_written":19509521,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1096969,"cfile_cache_miss":850,"cfile_cache_miss_bytes":50477689,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":9648,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":8024,"drs_written":1,"lbm_read_time_us":26802,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":869,"lbm_write_time_us":39841,"lbm_writes_lt_1ms":850,"num_input_rowsets":2,"peak_mem_usage":11334376,"rows_written":703250,"spinlock_wait_cycles":3257472,"thread_start_us":292,"threads_started":6}
I20251211 09:12:06.083755 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 8008998 bytes on disk
I20251211 09:12:06.084039 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:06.084237 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=2.931993
I20251211 09:12:06.126777 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.042s user 0.039s sys 0.000s Metrics: {"bytes_written":833806,"cfile_init":1,"dirs.queue_time_us":37,"drs_written":1,"lbm_read_time_us":30,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1683,"lbm_writes_lt_1ms":55,"peak_mem_usage":0,"rows_written":29250}
I20251211 09:12:06.127676 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1053591 bytes of WAL
I20251211 09:12:06.127863 10697 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:06.127952 10697 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000024 (ops 13613-14192)
I20251211 09:12:06.128369 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:06.128504 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 286391 bytes on disk
I20251211 09:12:06.128679 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:06.128818 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.007075
I20251211 09:12:06.132709 479 tablet_server.cc:178] TabletServer@127.0.119.194:0 shutting down...
I20251211 09:12:06.306373 10773 maintenance_manager.cc:643] P 0746569747b045f2ae635513af494c62: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.791s user 0.616s sys 0.044s Metrics: {"bytes_written":19883355,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1304792,"cfile_cache_miss":863,"cfile_cache_miss_bytes":51282038,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":177,"dirs.run_cpu_time_us":141,"dirs.run_wall_time_us":777,"drs_written":1,"lbm_read_time_us":21158,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":886,"lbm_write_time_us":34431,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":865,"num_input_rowsets":2,"peak_mem_usage":11559752,"rows_written":716800,"spinlock_wait_cycles":768,"thread_start_us":286,"threads_started":6}
I20251211 09:12:06.306859 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:12:06.307035 479 tablet_replica.cc:333] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62: stopping tablet replica
I20251211 09:12:06.307085 479 raft_consensus.cc:2243] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:12:06.307153 479 raft_consensus.cc:2272] T 4f79787fcc1e447bbbda048ceb8174f6 P 0746569747b045f2ae635513af494c62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:12:06.319619 479 tablet_server.cc:195] TabletServer@127.0.119.194:0 shutdown complete.
I20251211 09:12:06.355944 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251211 09:12:06.357611 479 server_base.cc:1047] running on GCE node
W20251211 09:12:06.357728 11440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:12:06.357740 11443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:12:06.357784 11441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:06.358048 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:12:06.358109 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:12:06.358131 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444326358131 us; error 0 us; skew 500 ppm
I20251211 09:12:06.358913 479 webserver.cc:492] Webserver started at http://127.0.119.196:42749/ using document root <none> and password file <none>
I20251211 09:12:06.358999 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:12:06.359042 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:12:06.359097 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:12:06.359365 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-3-root/instance:
uuid: "539a550344804183a17162cda1f8dd10"
format_stamp: "Formatted at 2025-12-11 09:12:06 on dist-test-slave-hb70"
I20251211 09:12:06.360273 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20251211 09:12:06.360723 11448 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:06.360899 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:06.360940 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-3-root
uuid: "539a550344804183a17162cda1f8dd10"
format_stamp: "Formatted at 2025-12-11 09:12:06 on dist-test-slave-hb70"
I20251211 09:12:06.360986 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:12:06.370684 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:12:06.370867 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:12:06.371004 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:12:06.371239 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:12:06.371354 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:06.371466 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:12:06.371515 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:06.374946 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.196:45831
I20251211 09:12:06.376246 11512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.196:45831 every 8 connection(s)
I20251211 09:12:06.387138 11513 heartbeater.cc:344] Connected to a master server at 127.0.119.254:46505
I20251211 09:12:06.387218 11513 heartbeater.cc:461] Registering TS with master...
I20251211 09:12:06.387334 11513 heartbeater.cc:507] Master 127.0.119.254:46505 requested a full tablet report, sending...
I20251211 09:12:06.387704 10627 ts_manager.cc:194] Registered new tserver with Master: 539a550344804183a17162cda1f8dd10 (127.0.119.196:45831)
I20251211 09:12:06.388092 10627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43716
I20251211 09:12:06.563635 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.964s user 0.659s sys 0.055s Metrics: {"bytes_written":19925847,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1106669,"cfile_cache_miss":868,"cfile_cache_miss_bytes":51577063,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":350,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":796,"drs_written":1,"lbm_read_time_us":27586,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":886,"lbm_write_time_us":68828,"lbm_writes_1-10_ms":5,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":861,"num_input_rowsets":2,"peak_mem_usage":11575981,"rows_written":718350,"thread_start_us":315,"threads_started":6}
I20251211 09:12:06.564100 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.000000
I20251211 09:12:06.581053 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.017s user 0.016s sys 0.000s Metrics: {"bytes_written":447721,"cfile_init":1,"dirs.queue_time_us":33,"drs_written":1,"lbm_read_time_us":11,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1022,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":15550}
I20251211 09:12:06.581267 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling LogGCOp(4f79787fcc1e447bbbda048ceb8174f6): free 1055673 bytes of WAL
I20251211 09:12:06.581384 10848 log_reader.cc:385] T 4f79787fcc1e447bbbda048ceb8174f6: removed 1 log segments from log reader
I20251211 09:12:06.581427 10848 log.cc:1079] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4f79787fcc1e447bbbda048ceb8174f6/wal-000000023 (ops 13853-14510)
I20251211 09:12:06.581754 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: LogGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:06.581861 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.006953
W20251211 09:12:06.667179 10694 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.119.194:39597: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20251211 09:12:06.667606 10694 consensus_peers.cc:597] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 -> Peer 0746569747b045f2ae635513af494c62 (127.0.119.194:39597): Couldn't send request to peer 0746569747b045f2ae635513af494c62. Status: Network error: Client connection negotiation failed: client connection to 127.0.119.194:39597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 09:12:06.737622 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.608s user 0.568s sys 0.032s Metrics: {"bytes_written":20314986,"cfile_cache_hit":12,"cfile_cache_hit_bytes":758236,"cfile_cache_miss":886,"cfile_cache_miss_bytes":52974976,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":325,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":731,"drs_written":1,"lbm_read_time_us":18004,"lbm_reads_lt_1ms":906,"lbm_write_time_us":36074,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":885,"num_input_rowsets":2,"peak_mem_usage":11813263,"rows_written":732500,"spinlock_wait_cycles":896,"thread_start_us":328,"threads_started":6}
I20251211 09:12:06.737977 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 8346255 bytes on disk
I20251211 09:12:06.738129 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:07.042318 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.460s user 0.407s sys 0.052s Metrics: {"bytes_written":20353282,"cfile_cache_hit":10,"cfile_cache_hit_bytes":533287,"cfile_cache_miss":890,"cfile_cache_miss_bytes":53321871,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":252,"dirs.run_cpu_time_us":186,"dirs.run_wall_time_us":819,"drs_written":1,"lbm_read_time_us":16685,"lbm_reads_lt_1ms":918,"lbm_write_time_us":26577,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":887,"num_input_rowsets":2,"peak_mem_usage":11848073,"rows_written":733900,"spinlock_wait_cycles":1408}
I20251211 09:12:07.042984 10908 maintenance_manager.cc:419] P 5d155cbee4fb47dc9016503144988821: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 8362982 bytes on disk
I20251211 09:12:07.043226 10848 maintenance_manager.cc:643] P 5d155cbee4fb47dc9016503144988821: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:07.134364 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=0.242942
I20251211 09:12:07.137043 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: FlushMRSOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"bytes_written":40947,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":137,"dirs.run_wall_time_us":778,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":195,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1400}
I20251211 09:12:07.137212 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6): perf score=1.006767
I20251211 09:12:07.388573 11513 heartbeater.cc:499] Master 127.0.119.254:46505 was elected leader, sending a full tablet report...
I20251211 09:12:07.479776 11531 consensus_queue.cc:579] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [LEADER]: Leader has been unable to successfully communicate with peer 0746569747b045f2ae635513af494c62 for more than 1 seconds (1.348s)
I20251211 09:12:07.480902 10730 consensus_queue.cc:237] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14709, Committed index: 14709, Last appended: 1.14709, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14710 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } } peers { permanent_uuid: "539a550344804183a17162cda1f8dd10" member_type: NON_VOTER last_known_addr { host: "127.0.119.196" port: 45831 } attrs { promote: true } }
I20251211 09:12:07.481695 10881 raft_consensus.cc:1275] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 1 FOLLOWER]: Refusing update from remote peer 5e829aedbeb240b0a75e81982c601f04: Log matching property violated. Preceding OpId in replica: term: 1 index: 14709. Preceding OpId from leader: term: 1 index: 14710. (index mismatch)
W20251211 09:12:07.481990 10694 consensus_peers.cc:597] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 -> Peer 0746569747b045f2ae635513af494c62 (127.0.119.194:39597): Couldn't send request to peer 0746569747b045f2ae635513af494c62. Status: Network error: Client connection negotiation failed: client connection to 127.0.119.194:39597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251211 09:12:07.482025 11531 consensus_queue.cc:1048] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14710, Last known committed idx: 14709, Time since last communication: 0.000s
I20251211 09:12:07.482693 11369 raft_consensus.cc:2955] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 1 LEADER]: Committing config change with OpId 1.14710: config changed from index -1 to 14710, NON_VOTER 539a550344804183a17162cda1f8dd10 (127.0.119.196) added. New config: { opid_index: 14710 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } } peers { permanent_uuid: "539a550344804183a17162cda1f8dd10" member_type: NON_VOTER last_known_addr { host: "127.0.119.196" port: 45831 } attrs { promote: true } } }
I20251211 09:12:07.483632 10614 catalog_manager.cc:5167] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 4f79787fcc1e447bbbda048ceb8174f6 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20251211 09:12:07.483837 10627 catalog_manager.cc:5654] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 reported cstate change: config changed from index -1 to 14710, NON_VOTER 539a550344804183a17162cda1f8dd10 (127.0.119.196) added. New cstate: current_term: 1 leader_uuid: "5e829aedbeb240b0a75e81982c601f04" committed_config { opid_index: 14710 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "539a550344804183a17162cda1f8dd10" member_type: NON_VOTER last_known_addr { host: "127.0.119.196" port: 45831 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20251211 09:12:07.484550 10881 raft_consensus.cc:2955] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 1 FOLLOWER]: Committing config change with OpId 1.14710: config changed from index -1 to 14710, NON_VOTER 539a550344804183a17162cda1f8dd10 (127.0.119.196) added. New config: { opid_index: 14710 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } } peers { permanent_uuid: "539a550344804183a17162cda1f8dd10" member_type: NON_VOTER last_known_addr { host: "127.0.119.196" port: 45831 } attrs { promote: true } } }
W20251211 09:12:07.485123 10694 consensus_peers.cc:597] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 -> Peer 539a550344804183a17162cda1f8dd10 (127.0.119.196:45831): Couldn't send request to peer 539a550344804183a17162cda1f8dd10. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f79787fcc1e447bbbda048ceb8174f6. This is attempt 1: this message will repeat every 5th retry.
I20251211 09:12:07.568022 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: CompactRowSetsOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.431s user 0.398s sys 0.032s Metrics: {"bytes_written":20353282,"cfile_cache_hit":10,"cfile_cache_hit_bytes":296769,"cfile_cache_miss":896,"cfile_cache_miss_bytes":53587659,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":417,"dirs.run_cpu_time_us":138,"dirs.run_wall_time_us":1292,"drs_written":1,"lbm_read_time_us":16640,"lbm_reads_lt_1ms":920,"lbm_write_time_us":23675,"lbm_writes_lt_1ms":888,"num_input_rowsets":2,"peak_mem_usage":11864583,"rows_written":733900,"thread_start_us":210,"threads_started":5}
I20251211 09:12:07.568394 10757 maintenance_manager.cc:419] P 5e829aedbeb240b0a75e81982c601f04: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 8362982 bytes on disk
I20251211 09:12:07.568609 10697 maintenance_manager.cc:643] P 5e829aedbeb240b0a75e81982c601f04: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:08.070128 11546 ts_tablet_manager.cc:933] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: Initiating tablet copy from peer 5e829aedbeb240b0a75e81982c601f04 (127.0.119.193:36689)
I20251211 09:12:08.070310 11546 tablet_copy_client.cc:323] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: tablet copy: Beginning tablet copy session from remote peer at address 127.0.119.193:36689
I20251211 09:12:08.072536 10740 tablet_copy_service.cc:140] P 5e829aedbeb240b0a75e81982c601f04: Received BeginTabletCopySession request for tablet 4f79787fcc1e447bbbda048ceb8174f6 from peer 539a550344804183a17162cda1f8dd10 ({username='slave'} at 127.0.0.1:38662)
I20251211 09:12:08.072597 10740 tablet_copy_service.cc:161] P 5e829aedbeb240b0a75e81982c601f04: Beginning new tablet copy session on tablet 4f79787fcc1e447bbbda048ceb8174f6 from peer 539a550344804183a17162cda1f8dd10 at {username='slave'} at 127.0.0.1:38662: session id = 539a550344804183a17162cda1f8dd10-4f79787fcc1e447bbbda048ceb8174f6
I20251211 09:12:08.073136 10740 tablet_copy_source_session.cc:215] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: Tablet Copy: opened 5 blocks and 1 log segments
I20251211 09:12:08.073515 11546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f79787fcc1e447bbbda048ceb8174f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:12:08.074613 11546 tablet_copy_client.cc:806] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: tablet copy: Starting download of 5 data blocks...
I20251211 09:12:08.129895 11546 tablet_copy_client.cc:670] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: tablet copy: Starting download of 1 WAL segments...
I20251211 09:12:08.132061 11546 tablet_copy_client.cc:538] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20251211 09:12:08.132834 11546 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: Bootstrap starting.
I20251211 09:12:08.170260 11546 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: Bootstrap replayed 1/1 log segments. Stats: ops{read=518 overwritten=0 applied=518 ignored=487} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=1. Pending: 0 replicates
I20251211 09:12:08.170583 11546 tablet_bootstrap.cc:492] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: Bootstrap complete.
I20251211 09:12:08.170856 11546 ts_tablet_manager.cc:1403] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: Time spent bootstrapping tablet: real 0.038s user 0.022s sys 0.016s
I20251211 09:12:08.171005 11546 raft_consensus.cc:359] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14710 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } } peers { permanent_uuid: "539a550344804183a17162cda1f8dd10" member_type: NON_VOTER last_known_addr { host: "127.0.119.196" port: 45831 } attrs { promote: true } }
I20251211 09:12:08.171069 11546 raft_consensus.cc:740] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 539a550344804183a17162cda1f8dd10, State: Initialized, Role: LEARNER
I20251211 09:12:08.171095 11546 consensus_queue.cc:260] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14710, Last appended: 1.14710, Last appended by leader: 14710, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14710 OBSOLETE_local: false peers { permanent_uuid: "5e829aedbeb240b0a75e81982c601f04" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 36689 } } peers { permanent_uuid: "5d155cbee4fb47dc9016503144988821" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 39045 } } peers { permanent_uuid: "0746569747b045f2ae635513af494c62" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 39597 } } peers { permanent_uuid: "539a550344804183a17162cda1f8dd10" member_type: NON_VOTER last_known_addr { host: "127.0.119.196" port: 45831 } attrs { promote: true } }
I20251211 09:12:08.171236 11546 ts_tablet_manager.cc:1434] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: Time spent starting tablet: real 0.000s user 0.001s sys 0.001s
I20251211 09:12:08.171528 10740 tablet_copy_service.cc:342] P 5e829aedbeb240b0a75e81982c601f04: Request end of tablet copy session 539a550344804183a17162cda1f8dd10-4f79787fcc1e447bbbda048ceb8174f6 received from {username='slave'} at 127.0.0.1:38662
I20251211 09:12:08.171576 10740 tablet_copy_service.cc:434] P 5e829aedbeb240b0a75e81982c601f04: ending tablet copy session 539a550344804183a17162cda1f8dd10-4f79787fcc1e447bbbda048ceb8174f6 on tablet 4f79787fcc1e447bbbda048ceb8174f6 with peer 539a550344804183a17162cda1f8dd10
I20251211 09:12:08.178187 11514 maintenance_manager.cc:419] P 539a550344804183a17162cda1f8dd10: Scheduling UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6): 8362982 bytes on disk
I20251211 09:12:08.178398 11453 maintenance_manager.cc:643] P 539a550344804183a17162cda1f8dd10: UndoDeltaBlockGCOp(4f79787fcc1e447bbbda048ceb8174f6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:08.399961 479 tablet_server.cc:178] TabletServer@127.0.119.193:0 shutting down...
I20251211 09:12:08.402467 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:12:08.402844 479 tablet_replica.cc:333] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04: stopping tablet replica
I20251211 09:12:08.402899 479 raft_consensus.cc:2243] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:12:08.402989 479 raft_consensus.cc:2272] T 4f79787fcc1e447bbbda048ceb8174f6 P 5e829aedbeb240b0a75e81982c601f04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:12:08.415297 479 tablet_server.cc:195] TabletServer@127.0.119.193:0 shutdown complete.
I20251211 09:12:08.416332 479 tablet_server.cc:178] TabletServer@127.0.119.195:0 shutting down...
I20251211 09:12:08.419268 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:12:08.419382 479 tablet_replica.cc:333] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821: stopping tablet replica
I20251211 09:12:08.419445 479 raft_consensus.cc:2243] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 09:12:08.419530 479 raft_consensus.cc:2272] T 4f79787fcc1e447bbbda048ceb8174f6 P 5d155cbee4fb47dc9016503144988821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:12:08.431157 479 tablet_server.cc:195] TabletServer@127.0.119.195:0 shutdown complete.
I20251211 09:12:08.432080 479 tablet_server.cc:178] TabletServer@127.0.119.196:0 shutting down...
I20251211 09:12:08.434366 479 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20251211 09:12:08.434520 479 tablet_replica.cc:333] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10: stopping tablet replica
I20251211 09:12:08.434587 479 raft_consensus.cc:2243] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10 [term 1 LEARNER]: Raft consensus shutting down.
I20251211 09:12:08.434653 479 raft_consensus.cc:2272] T 4f79787fcc1e447bbbda048ceb8174f6 P 539a550344804183a17162cda1f8dd10 [term 1 LEARNER]: Raft consensus is shut down!
I20251211 09:12:08.446267 479 tablet_server.cc:195] TabletServer@127.0.119.196:0 shutdown complete.
I20251211 09:12:08.447156 479 master.cc:561] Master@127.0.119.254:46505 shutting down...
I20251211 09:12:08.449400 479 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 1 LEADER]: Raft consensus shutting down.
I20251211 09:12:08.449494 479 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 09:12:08.449537 479 tablet_replica.cc:333] T 00000000000000000000000000000000 P 91a1f46df3034a81a40c0aa762634cef: stopping tablet replica
I20251211 09:12:08.461369 479 master.cc:583] Master@127.0.119.254:46505 shutdown complete.
[ OK ] ShouldGCWals/ParticipantCopyITest.TestCopyParticipantOps/0 (23189 ms)
[ RUN ] ShouldGCWals/ParticipantCopyITest.TestCopyParticipantOps/1
I20251211 09:12:08.489888 479 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.119.254:40721
I20251211 09:12:08.490049 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:12:08.491163 11552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:12:08.491312 11553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.491348 479 server_base.cc:1047] running on GCE node
W20251211 09:12:08.491380 11555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.491509 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:12:08.491547 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:12:08.491565 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444328491566 us; error 0 us; skew 500 ppm
I20251211 09:12:08.492139 479 webserver.cc:492] Webserver started at http://127.0.119.254:33401/ using document root <none> and password file <none>
I20251211 09:12:08.492215 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:12:08.492269 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:12:08.492339 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:12:08.492606 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/master-0-root/instance:
uuid: "025fdcd8168448f0a68ceac4bd8e5729"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.493556 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:12:08.494017 11560 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.494140 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.494184 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/master-0-root
uuid: "025fdcd8168448f0a68ceac4bd8e5729"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.494232 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:12:08.498821 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:12:08.499020 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:12:08.501588 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.254:40721
I20251211 09:12:08.507802 11613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.254:40721 every 8 connection(s)
I20251211 09:12:08.507925 11614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:12:08.508850 11614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729: Bootstrap starting.
I20251211 09:12:08.509116 11614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729: Neither blocks nor log segments found. Creating new log.
I20251211 09:12:08.509689 11614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729: No bootstrap required, opened a new log
I20251211 09:12:08.509810 11614 raft_consensus.cc:359] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025fdcd8168448f0a68ceac4bd8e5729" member_type: VOTER }
I20251211 09:12:08.509863 11614 raft_consensus.cc:385] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:12:08.509877 11614 raft_consensus.cc:740] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 025fdcd8168448f0a68ceac4bd8e5729, State: Initialized, Role: FOLLOWER
I20251211 09:12:08.509927 11614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025fdcd8168448f0a68ceac4bd8e5729" member_type: VOTER }
I20251211 09:12:08.509963 11614 raft_consensus.cc:399] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 09:12:08.509987 11614 raft_consensus.cc:493] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 09:12:08.510015 11614 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:12:08.510517 11614 raft_consensus.cc:515] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025fdcd8168448f0a68ceac4bd8e5729" member_type: VOTER }
I20251211 09:12:08.510571 11614 leader_election.cc:304] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 025fdcd8168448f0a68ceac4bd8e5729; no voters:
I20251211 09:12:08.510687 11614 leader_election.cc:290] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 09:12:08.510746 11617 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:12:08.510824 11614 sys_catalog.cc:565] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [sys.catalog]: configured and running, proceeding with master startup.
I20251211 09:12:08.510892 11617 raft_consensus.cc:697] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [term 1 LEADER]: Becoming Leader. State: Replica: 025fdcd8168448f0a68ceac4bd8e5729, State: Running, Role: LEADER
I20251211 09:12:08.510946 11617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025fdcd8168448f0a68ceac4bd8e5729" member_type: VOTER }
I20251211 09:12:08.511114 11617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 025fdcd8168448f0a68ceac4bd8e5729. Latest consensus state: current_term: 1 leader_uuid: "025fdcd8168448f0a68ceac4bd8e5729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025fdcd8168448f0a68ceac4bd8e5729" member_type: VOTER } }
I20251211 09:12:08.511250 11617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [sys.catalog]: This master's current role is: LEADER
I20251211 09:12:08.511134 11618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "025fdcd8168448f0a68ceac4bd8e5729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "025fdcd8168448f0a68ceac4bd8e5729" member_type: VOTER } }
I20251211 09:12:08.511504 11623 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 09:12:08.511551 11618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729 [sys.catalog]: This master's current role is: LEADER
I20251211 09:12:08.511730 11623 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 09:12:08.512110 479 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20251211 09:12:08.512336 11623 catalog_manager.cc:1357] Generated new cluster ID: fd857e643512413eabb9234b71199817
I20251211 09:12:08.512375 11623 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 09:12:08.534468 11623 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 09:12:08.534925 11623 catalog_manager.cc:1514] Loading token signing keys...
I20251211 09:12:08.542204 11623 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 025fdcd8168448f0a68ceac4bd8e5729: Generated new TSK 0
I20251211 09:12:08.542367 11623 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 09:12:08.544131 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:12:08.545318 11635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:12:08.545408 11636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.545392 479 server_base.cc:1047] running on GCE node
W20251211 09:12:08.545508 11638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.545647 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:12:08.545684 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:12:08.545706 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444328545706 us; error 0 us; skew 500 ppm
I20251211 09:12:08.546288 479 webserver.cc:492] Webserver started at http://127.0.119.193:45083/ using document root <none> and password file <none>
I20251211 09:12:08.546393 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:12:08.546442 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:12:08.546499 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:12:08.546759 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/instance:
uuid: "eafe4e6d25964662a92aa9ccca728a68"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.547555 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:12:08.547955 11643 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.548094 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.548134 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root
uuid: "eafe4e6d25964662a92aa9ccca728a68"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.548184 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:12:08.566413 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:12:08.566615 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:12:08.566795 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:12:08.566987 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:12:08.567013 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.567046 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:12:08.567075 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.569676 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.193:33139
I20251211 09:12:08.569751 11706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.193:33139 every 8 connection(s)
I20251211 09:12:08.570042 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:12:08.571187 11712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:12:08.571203 11711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.571425 479 server_base.cc:1047] running on GCE node
W20251211 09:12:08.571291 11714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.571557 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:12:08.571599 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:12:08.571619 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444328571619 us; error 0 us; skew 500 ppm
I20251211 09:12:08.572218 479 webserver.cc:492] Webserver started at http://127.0.119.194:40303/ using document root <none> and password file <none>
I20251211 09:12:08.572302 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:12:08.572345 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:12:08.572384 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:12:08.572657 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/instance:
uuid: "62e0aeab56d74ab394482e46bc7e5376"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.573225 11707 heartbeater.cc:344] Connected to a master server at 127.0.119.254:40721
I20251211 09:12:08.573331 11707 heartbeater.cc:461] Registering TS with master...
I20251211 09:12:08.573457 11707 heartbeater.cc:507] Master 127.0.119.254:40721 requested a full tablet report, sending...
I20251211 09:12:08.573726 11577 ts_manager.cc:194] Registered new tserver with Master: eafe4e6d25964662a92aa9ccca728a68 (127.0.119.193:33139)
I20251211 09:12:08.573830 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20251211 09:12:08.574265 11719 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.574368 11577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60464
I20251211 09:12:08.574396 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.574432 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root
uuid: "62e0aeab56d74ab394482e46bc7e5376"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.574478 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:12:08.582952 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:12:08.583177 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:12:08.583303 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:12:08.583489 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:12:08.583514 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.583547 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:12:08.583572 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.586212 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.194:33765
I20251211 09:12:08.586268 11783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.194:33765 every 8 connection(s)
I20251211 09:12:08.586563 479 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 09:12:08.588009 11788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 09:12:08.588013 11787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.588097 479 server_base.cc:1047] running on GCE node
W20251211 09:12:08.588178 11790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 09:12:08.588344 479 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20251211 09:12:08.588387 479 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20251211 09:12:08.588406 479 hybrid_clock.cc:648] HybridClock initialized: now 1765444328588406 us; error 0 us; skew 500 ppm
I20251211 09:12:08.589013 479 webserver.cc:492] Webserver started at http://127.0.119.195:44389/ using document root <none> and password file <none>
I20251211 09:12:08.589102 479 fs_manager.cc:362] Metadata directory not provided
I20251211 09:12:08.589146 479 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 09:12:08.589203 479 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 09:12:08.589545 479 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/instance:
uuid: "70d5b8336bdf4227ad8e3289e9f4eb87"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.589635 11784 heartbeater.cc:344] Connected to a master server at 127.0.119.254:40721
I20251211 09:12:08.589700 11784 heartbeater.cc:461] Registering TS with master...
I20251211 09:12:08.589807 11784 heartbeater.cc:507] Master 127.0.119.254:40721 requested a full tablet report, sending...
I20251211 09:12:08.590027 11577 ts_manager.cc:194] Registered new tserver with Master: 62e0aeab56d74ab394482e46bc7e5376 (127.0.119.194:33765)
I20251211 09:12:08.590502 11577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60476
I20251211 09:12:08.590615 479 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20251211 09:12:08.591089 11795 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.591200 479 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.591238 479 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root
uuid: "70d5b8336bdf4227ad8e3289e9f4eb87"
format_stamp: "Formatted at 2025-12-11 09:12:08 on dist-test-slave-hb70"
I20251211 09:12:08.591279 479 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 09:12:08.605294 479 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 09:12:08.605530 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 09:12:08.605686 479 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 09:12:08.605885 479 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 09:12:08.605912 479 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.605950 479 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 09:12:08.605981 479 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 09:12:08.608621 479 rpc_server.cc:307] RPC server started. Bound to: 127.0.119.195:43691
I20251211 09:12:08.608696 11858 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.119.195:43691 every 8 connection(s)
I20251211 09:12:08.611647 11859 heartbeater.cc:344] Connected to a master server at 127.0.119.254:40721
I20251211 09:12:08.611704 11859 heartbeater.cc:461] Registering TS with master...
I20251211 09:12:08.611799 11859 heartbeater.cc:507] Master 127.0.119.254:40721 requested a full tablet report, sending...
I20251211 09:12:08.611997 11577 ts_manager.cc:194] Registered new tserver with Master: 70d5b8336bdf4227ad8e3289e9f4eb87 (127.0.119.195:43691)
I20251211 09:12:08.612067 479 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003277046s
I20251211 09:12:08.612357 11577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60488
I20251211 09:12:08.612414 479 test_util.cc:276] Using random seed: -1978408387
I20251211 09:12:08.616541 11577 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60494:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 09:12:08.616668 11577 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 09:12:08.620910 11671 tablet_service.cc:1505] Processing CreateTablet for tablet 4ef1e2c2a06546419b8ab0f8bd9b7ffe (DEFAULT_TABLE table=test-workload [id=6df34545b0864952bf2236c2ce6d023e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:12:08.621044 11671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef1e2c2a06546419b8ab0f8bd9b7ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:12:08.621272 11823 tablet_service.cc:1505] Processing CreateTablet for tablet 4ef1e2c2a06546419b8ab0f8bd9b7ffe (DEFAULT_TABLE table=test-workload [id=6df34545b0864952bf2236c2ce6d023e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:12:08.621393 11823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef1e2c2a06546419b8ab0f8bd9b7ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:12:08.621416 11747 tablet_service.cc:1505] Processing CreateTablet for tablet 4ef1e2c2a06546419b8ab0f8bd9b7ffe (DEFAULT_TABLE table=test-workload [id=6df34545b0864952bf2236c2ce6d023e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251211 09:12:08.621520 11747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef1e2c2a06546419b8ab0f8bd9b7ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 09:12:08.622489 11875 tablet_bootstrap.cc:492] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Bootstrap starting.
I20251211 09:12:08.622794 11876 tablet_bootstrap.cc:492] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Bootstrap starting.
I20251211 09:12:08.622849 11875 tablet_bootstrap.cc:654] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Neither blocks nor log segments found. Creating new log.
I20251211 09:12:08.623042 11877 tablet_bootstrap.cc:492] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Bootstrap starting.
I20251211 09:12:08.623246 11876 tablet_bootstrap.cc:654] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Neither blocks nor log segments found. Creating new log.
I20251211 09:12:08.623358 11877 tablet_bootstrap.cc:654] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Neither blocks nor log segments found. Creating new log.
I20251211 09:12:08.623736 11876 tablet_bootstrap.cc:492] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: No bootstrap required, opened a new log
I20251211 09:12:08.623782 11876 ts_tablet_manager.cc:1403] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:12:08.623811 11877 tablet_bootstrap.cc:492] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: No bootstrap required, opened a new log
I20251211 09:12:08.623862 11877 ts_tablet_manager.cc:1403] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:12:08.623880 11876 raft_consensus.cc:359] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.623943 11876 raft_consensus.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:12:08.623966 11877 raft_consensus.cc:359] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.624032 11877 raft_consensus.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:12:08.624059 11877 raft_consensus.cc:740] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62e0aeab56d74ab394482e46bc7e5376, State: Initialized, Role: FOLLOWER
I20251211 09:12:08.624105 11877 consensus_queue.cc:260] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.624218 11875 tablet_bootstrap.cc:492] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: No bootstrap required, opened a new log
I20251211 09:12:08.624240 11877 ts_tablet_manager.cc:1434] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20251211 09:12:08.624267 11875 ts_tablet_manager.cc:1403] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251211 09:12:08.623972 11876 raft_consensus.cc:740] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eafe4e6d25964662a92aa9ccca728a68, State: Initialized, Role: FOLLOWER
I20251211 09:12:08.624274 11784 heartbeater.cc:499] Master 127.0.119.254:40721 was elected leader, sending a full tablet report...
I20251211 09:12:08.624402 11876 consensus_queue.cc:260] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.624462 11875 raft_consensus.cc:359] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.624547 11876 ts_tablet_manager.cc:1434] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251211 09:12:08.624575 11707 heartbeater.cc:499] Master 127.0.119.254:40721 was elected leader, sending a full tablet report...
I20251211 09:12:08.624598 11875 raft_consensus.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 09:12:08.624713 11875 raft_consensus.cc:740] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d5b8336bdf4227ad8e3289e9f4eb87, State: Initialized, Role: FOLLOWER
I20251211 09:12:08.624909 11875 consensus_queue.cc:260] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.625113 11875 ts_tablet_manager.cc:1434] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 09:12:08.625128 11859 heartbeater.cc:499] Master 127.0.119.254:40721 was elected leader, sending a full tablet report...
I20251211 09:12:08.747316 11883 raft_consensus.cc:493] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 09:12:08.747421 11883 raft_consensus.cc:515] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.747584 11883 leader_election.cc:290] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eafe4e6d25964662a92aa9ccca728a68 (127.0.119.193:33139), 62e0aeab56d74ab394482e46bc7e5376 (127.0.119.194:33765)
I20251211 09:12:08.750084 11757 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ef1e2c2a06546419b8ab0f8bd9b7ffe" candidate_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62e0aeab56d74ab394482e46bc7e5376" is_pre_election: true
I20251211 09:12:08.750172 11757 raft_consensus.cc:2468] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70d5b8336bdf4227ad8e3289e9f4eb87 in term 0.
I20251211 09:12:08.750253 11681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ef1e2c2a06546419b8ab0f8bd9b7ffe" candidate_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafe4e6d25964662a92aa9ccca728a68" is_pre_election: true
I20251211 09:12:08.750285 11797 leader_election.cc:304] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62e0aeab56d74ab394482e46bc7e5376, 70d5b8336bdf4227ad8e3289e9f4eb87; no voters:
I20251211 09:12:08.750345 11681 raft_consensus.cc:2468] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70d5b8336bdf4227ad8e3289e9f4eb87 in term 0.
I20251211 09:12:08.750380 11883 raft_consensus.cc:2804] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 09:12:08.750439 11883 raft_consensus.cc:493] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 09:12:08.750478 11883 raft_consensus.cc:3060] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:12:08.751060 11883 raft_consensus.cc:515] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.751183 11883 leader_election.cc:290] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [CANDIDATE]: Term 1 election: Requested vote from peers eafe4e6d25964662a92aa9ccca728a68 (127.0.119.193:33139), 62e0aeab56d74ab394482e46bc7e5376 (127.0.119.194:33765)
I20251211 09:12:08.751299 11681 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ef1e2c2a06546419b8ab0f8bd9b7ffe" candidate_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eafe4e6d25964662a92aa9ccca728a68"
I20251211 09:12:08.751296 11757 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ef1e2c2a06546419b8ab0f8bd9b7ffe" candidate_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62e0aeab56d74ab394482e46bc7e5376"
I20251211 09:12:08.751387 11681 raft_consensus.cc:3060] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:12:08.751403 11757 raft_consensus.cc:3060] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [term 0 FOLLOWER]: Advancing to term 1
I20251211 09:12:08.752038 11757 raft_consensus.cc:2468] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70d5b8336bdf4227ad8e3289e9f4eb87 in term 1.
I20251211 09:12:08.752038 11681 raft_consensus.cc:2468] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70d5b8336bdf4227ad8e3289e9f4eb87 in term 1.
I20251211 09:12:08.752216 11796 leader_election.cc:304] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d5b8336bdf4227ad8e3289e9f4eb87, eafe4e6d25964662a92aa9ccca728a68; no voters:
I20251211 09:12:08.752298 11883 raft_consensus.cc:2804] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 09:12:08.752426 11883 raft_consensus.cc:697] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [term 1 LEADER]: Becoming Leader. State: Replica: 70d5b8336bdf4227ad8e3289e9f4eb87, State: Running, Role: LEADER
I20251211 09:12:08.752470 11883 consensus_queue.cc:237] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } }
I20251211 09:12:08.752965 11577 catalog_manager.cc:5654] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70d5b8336bdf4227ad8e3289e9f4eb87 (127.0.119.195). New cstate: current_term: 1 leader_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70d5b8336bdf4227ad8e3289e9f4eb87" member_type: VOTER last_known_addr { host: "127.0.119.195" port: 43691 } health_report { overall_health: HEALTHY } } }
I20251211 09:12:08.772282 11681 raft_consensus.cc:1275] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68 [term 1 FOLLOWER]: Refusing update from remote peer 70d5b8336bdf4227ad8e3289e9f4eb87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:12:08.772282 11757 raft_consensus.cc:1275] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376 [term 1 FOLLOWER]: Refusing update from remote peer 70d5b8336bdf4227ad8e3289e9f4eb87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 09:12:08.772532 11883 consensus_queue.cc:1048] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62e0aeab56d74ab394482e46bc7e5376" member_type: VOTER last_known_addr { host: "127.0.119.194" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:12:08.772609 11885 consensus_queue.cc:1048] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eafe4e6d25964662a92aa9ccca728a68" member_type: VOTER last_known_addr { host: "127.0.119.193" port: 33139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 09:12:08.895943 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:08.896190 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:08.900281 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:08.912375 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.007s sys 0.007s Metrics: {"bytes_written":276407,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":897,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":608,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:12:08.912701 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 88543 bytes on disk
I20251211 09:12:08.912914 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20251211 09:12:08.917157 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.017s user 0.004s sys 0.011s Metrics: {"bytes_written":273659,"cfile_init":1,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":496,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":637,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20251211 09:12:08.917449 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87619 bytes on disk
I20251211 09:12:08.917614 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20251211 09:12:08.919231 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.023s user 0.009s sys 0.004s Metrics: {"bytes_written":273659,"cfile_init":1,"dirs.queue_time_us":33,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":633,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6394,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9500}
I20251211 09:12:08.919358 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87619 bytes on disk
I20251211 09:12:08.920751 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.039537 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.042200 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.044512 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.053506 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.011s user 0.010s sys 0.001s Metrics: {"bytes_written":280244,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":146,"dirs.run_wall_time_us":808,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":586,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:12:09.053838 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 89832 bytes on disk
I20251211 09:12:09.054064 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.054234 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014645
I20251211 09:12:09.057822 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.018s user 0.010s sys 0.003s Metrics: {"bytes_written":275100,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":554,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":659,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:09.058542 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87996 bytes on disk
I20251211 09:12:09.058719 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.058861 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014648
I20251211 09:12:09.061687 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":277828,"cfile_init":1,"dirs.queue_time_us":1341,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":441,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":647,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20251211 09:12:09.061863 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014646
I20251211 09:12:09.090502 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.032s user 0.026s sys 0.004s Metrics: {"bytes_written":544986,"cfile_cache_hit":12,"cfile_cache_hit_bytes":418187,"cfile_cache_miss":40,"cfile_cache_miss_bytes":930135,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":630,"drs_written":1,"lbm_read_time_us":735,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1119,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":290344,"rows_written":19050,"thread_start_us":224,"threads_started":5}
I20251211 09:12:09.090799 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 180661 bytes on disk
I20251211 09:12:09.091228 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.094193 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.040s user 0.027s sys 0.002s Metrics: {"bytes_written":550491,"cfile_cache_hit":12,"cfile_cache_hit_bytes":422037,"cfile_cache_miss":40,"cfile_cache_miss_bytes":940245,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":218,"dirs.run_wall_time_us":2042,"drs_written":1,"lbm_read_time_us":935,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1024,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":293394,"rows_written":19250,"thread_start_us":305,"threads_started":5}
I20251211 09:12:09.094429 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 182576 bytes on disk
I20251211 09:12:09.094710 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.098862 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.037s user 0.029s sys 0.000s Metrics: {"bytes_written":550491,"cfile_cache_hit":12,"cfile_cache_hit_bytes":422701,"cfile_cache_miss":40,"cfile_cache_miss_bytes":940147,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":709,"dirs.run_cpu_time_us":55,"dirs.run_wall_time_us":984,"drs_written":1,"lbm_read_time_us":784,"lbm_reads_lt_1ms":64,"lbm_write_time_us":1132,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":293394,"rows_written":19250,"spinlock_wait_cycles":384,"thread_start_us":260,"threads_started":5}
I20251211 09:12:09.099007 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 182576 bytes on disk
I20251211 09:12:09.099121 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.206677 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.210456 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.212806 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.223229 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.013s sys 0.000s Metrics: {"bytes_written":272508,"cfile_init":1,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":635,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":954,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450,"spinlock_wait_cycles":384}
I20251211 09:12:09.223423 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014580
I20251211 09:12:09.226178 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.011s sys 0.000s Metrics: {"bytes_written":280320,"cfile_init":1,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":516,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":645,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:12:09.226320 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1048832 bytes of WAL
I20251211 09:12:09.226416 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:09.226459 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000001 (ops 1-579)
I20251211 09:12:09.226805 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:09.226889 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014578
I20251211 09:12:09.229351 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.012s sys 0.002s Metrics: {"bytes_written":277866,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":578,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":651,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20251211 09:12:09.229557 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 89034 bytes on disk
I20251211 09:12:09.229786 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.229907 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014581
I20251211 09:12:09.268728 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.042s user 0.036s sys 0.000s Metrics: {"bytes_written":823373,"cfile_cache_hit":10,"cfile_cache_hit_bytes":446253,"cfile_cache_miss":52,"cfile_cache_miss_bytes":1610561,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":347,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":1437,"drs_written":1,"lbm_read_time_us":915,"lbm_reads_lt_1ms":76,"lbm_write_time_us":1969,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":440411,"rows_written":29000}
I20251211 09:12:09.268932 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 280686 bytes on disk
I20251211 09:12:09.270444 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.275167 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.052s user 0.040s sys 0.000s Metrics: {"bytes_written":815819,"cfile_cache_hit":10,"cfile_cache_hit_bytes":440478,"cfile_cache_miss":52,"cfile_cache_miss_bytes":1595156,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":187,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":878,"drs_written":1,"lbm_read_time_us":959,"lbm_reads_lt_1ms":76,"lbm_write_time_us":1673,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":435836,"rows_written":28700,"spinlock_wait_cycles":2432}
I20251211 09:12:09.275389 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 277762 bytes on disk
I20251211 09:12:09.275903 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":195,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.292124 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.062s user 0.033s sys 0.006s Metrics: {"bytes_written":815819,"cfile_cache_hit":10,"cfile_cache_hit_bytes":444327,"cfile_cache_miss":52,"cfile_cache_miss_bytes":1590903,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":308,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":877,"drs_written":1,"lbm_read_time_us":1464,"lbm_reads_lt_1ms":72,"lbm_write_time_us":2790,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":435836,"rows_written":28700}
I20251211 09:12:09.292797 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 277762 bytes on disk
I20251211 09:12:09.292969 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.377321 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.382725 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.384138 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.408562 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.031s user 0.013s sys 0.000s Metrics: {"bytes_written":273691,"cfile_init":1,"dirs.queue_time_us":11170,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":730,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":688,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20251211 09:12:09.409374 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1051593 bytes of WAL
I20251211 09:12:09.409539 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:09.409600 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000001 (ops 1-629)
I20251211 09:12:09.410789 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:09.410902 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014460
I20251211 09:12:09.418490 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.036s user 0.014s sys 0.000s Metrics: {"bytes_written":274961,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":792,"drs_written":1,"lbm_read_time_us":754,"lbm_reads_lt_1ms":4,"lbm_write_time_us":742,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:09.418720 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87719 bytes on disk
I20251211 09:12:09.419734 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.419889 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014457
I20251211 09:12:09.423617 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.039s user 0.015s sys 0.000s Metrics: {"bytes_written":284270,"cfile_init":1,"dirs.queue_time_us":2729,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":1035,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":700,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9900}
I20251211 09:12:09.423780 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1051976 bytes of WAL
I20251211 09:12:09.423945 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:09.424003 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000001 (ops 1-625)
I20251211 09:12:09.424502 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:09.425709 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 91019 bytes on disk
I20251211 09:12:09.425872 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.425999 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014458
I20251211 09:12:09.481163 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.069s user 0.050s sys 0.000s Metrics: {"bytes_written":1084428,"cfile_cache_hit":12,"cfile_cache_hit_bytes":609309,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2108841,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":797,"drs_written":1,"lbm_read_time_us":1563,"lbm_reads_lt_1ms":86,"lbm_write_time_us":1955,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":583991,"rows_written":38200}
I20251211 09:12:09.481470 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 373792 bytes on disk
I20251211 09:12:09.481652 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.515942 11566 maintenance_manager.cc:419] P 025fdcd8168448f0a68ceac4bd8e5729: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.003577
I20251211 09:12:09.519938 11565 maintenance_manager.cc:643] P 025fdcd8168448f0a68ceac4bd8e5729: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.004s user 0.000s sys 0.003s Metrics: {"bytes_written":6633,"cfile_init":1,"dirs.queue_time_us":124,"dirs.run_cpu_time_us":145,"dirs.run_wall_time_us":690,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":174,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":5,"thread_start_us":73,"threads_started":1}
I20251211 09:12:09.521091 11566 maintenance_manager.cc:419] P 025fdcd8168448f0a68ceac4bd8e5729: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 485 bytes on disk
I20251211 09:12:09.521320 11565 maintenance_manager.cc:643] P 025fdcd8168448f0a68ceac4bd8e5729: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.545717 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.126s user 0.042s sys 0.007s Metrics: {"bytes_written":1093601,"cfile_cache_hit":13,"cfile_cache_hit_bytes":641842,"cfile_cache_miss":61,"cfile_cache_miss_bytes":2100596,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":137,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":610,"drs_written":1,"lbm_read_time_us":1213,"lbm_reads_lt_1ms":81,"lbm_write_time_us":2210,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":587676,"rows_written":38550}
I20251211 09:12:09.546029 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 377288 bytes on disk
I20251211 09:12:09.546209 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.547449 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.121s user 0.048s sys 0.000s Metrics: {"bytes_written":1094908,"cfile_cache_hit":12,"cfile_cache_hit_bytes":617009,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2129687,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":9570,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":668,"drs_written":1,"lbm_read_time_us":1363,"lbm_reads_lt_1ms":82,"lbm_write_time_us":5280,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":63,"num_input_rowsets":2,"peak_mem_usage":590091,"rows_written":38600}
I20251211 09:12:09.548179 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 377844 bytes on disk
I20251211 09:12:09.548346 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.562922 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.566902 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.578770 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.584748 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.022s user 0.013s sys 0.000s Metrics: {"bytes_written":273720,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":189,"dirs.run_wall_time_us":846,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":681,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20251211 09:12:09.584954 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 88143 bytes on disk
I20251211 09:12:09.585119 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.585278 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014368
I20251211 09:12:09.601446 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.034s user 0.012s sys 0.002s Metrics: {"bytes_written":275094,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":707,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1197,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:09.601598 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 88343 bytes on disk
I20251211 09:12:09.602388 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.602840 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014376
I20251211 09:12:09.616608 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.038s user 0.013s sys 0.002s Metrics: {"bytes_written":290935,"cfile_init":1,"dirs.queue_time_us":2469,"dirs.run_cpu_time_us":78,"dirs.run_wall_time_us":577,"drs_written":1,"lbm_read_time_us":31,"lbm_reads_lt_1ms":4,"lbm_write_time_us":684,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10150}
I20251211 09:12:09.629947 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 93931 bytes on disk
I20251211 09:12:09.634189 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.634431 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014371
I20251211 09:12:09.652343 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.067s user 0.054s sys 0.007s Metrics: {"bytes_written":1347216,"cfile_cache_hit":13,"cfile_cache_hit_bytes":690937,"cfile_cache_miss":69,"cfile_cache_miss_bytes":2708767,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":224,"dirs.run_cpu_time_us":132,"dirs.run_wall_time_us":824,"drs_written":1,"lbm_read_time_us":1801,"lbm_reads_lt_1ms":89,"lbm_write_time_us":4417,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":74,"num_input_rowsets":2,"peak_mem_usage":728848,"rows_written":47700}
I20251211 09:12:09.652575 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 477541 bytes on disk
I20251211 09:12:09.652698 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.679419 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.076s user 0.053s sys 0.007s Metrics: {"bytes_written":1361745,"cfile_cache_hit":12,"cfile_cache_hit_bytes":664249,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2763933,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":195,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":722,"drs_written":1,"lbm_read_time_us":3265,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":89,"lbm_write_time_us":3097,"lbm_writes_lt_1ms":76,"num_input_rowsets":2,"peak_mem_usage":731648,"rows_written":48100}
I20251211 09:12:09.679586 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 481872 bytes on disk
I20251211 09:12:09.679728 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.724618 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.090s user 0.054s sys 0.006s Metrics: {"bytes_written":1378513,"cfile_cache_hit":12,"cfile_cache_hit_bytes":676092,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2798674,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":189,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":736,"drs_written":1,"lbm_read_time_us":1853,"lbm_reads_lt_1ms":90,"lbm_write_time_us":4225,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":75,"num_input_rowsets":2,"peak_mem_usage":743208,"rows_written":48750}
I20251211 09:12:09.724944 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 488859 bytes on disk
I20251211 09:12:09.725234 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.754386 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.761016 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.772640 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.011s user 0.006s sys 0.004s Metrics: {"bytes_written":275017,"cfile_init":1,"dirs.queue_time_us":59,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":680,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":502,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:09.772969 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87826 bytes on disk
I20251211 09:12:09.773876 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.774217 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014157
I20251211 09:12:09.774484 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.020s user 0.010s sys 0.000s Metrics: {"bytes_written":279156,"cfile_init":1,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":529,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":572,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20251211 09:12:09.774704 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014311
I20251211 09:12:09.786670 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.814277 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.027s user 0.014s sys 0.000s Metrics: {"bytes_written":279165,"cfile_init":1,"dirs.queue_time_us":63,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":755,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":689,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20251211 09:12:09.814539 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 89156 bytes on disk
I20251211 09:12:09.814955 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.815477 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014149
I20251211 09:12:09.855497 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.081s user 0.063s sys 0.005s Metrics: {"bytes_written":1626892,"cfile_cache_hit":13,"cfile_cache_hit_bytes":744823,"cfile_cache_miss":81,"cfile_cache_miss_bytes":3378211,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":762,"drs_written":1,"lbm_read_time_us":2103,"lbm_reads_lt_1ms":101,"lbm_write_time_us":3202,"lbm_writes_lt_1ms":86,"num_input_rowsets":2,"peak_mem_usage":878913,"rows_written":57650,"spinlock_wait_cycles":27904}
I20251211 09:12:09.856576 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 586500 bytes on disk
I20251211 09:12:09.856776 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.891487 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.116s user 0.066s sys 0.003s Metrics: {"bytes_written":1621173,"cfile_cache_hit":11,"cfile_cache_hit_bytes":475918,"cfile_cache_miss":83,"cfile_cache_miss_bytes":3628680,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":165,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":856,"drs_written":1,"lbm_read_time_us":1855,"lbm_reads_lt_1ms":107,"lbm_write_time_us":5926,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":84,"num_input_rowsets":2,"peak_mem_usage":876753,"rows_written":57400}
I20251211 09:12:09.891777 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 584082 bytes on disk
I20251211 09:12:09.891954 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.901573 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.086s user 0.063s sys 0.008s Metrics: {"bytes_written":1651334,"cfile_cache_hit":11,"cfile_cache_hit_bytes":475926,"cfile_cache_miss":83,"cfile_cache_miss_bytes":3705564,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":762,"drs_written":1,"lbm_read_time_us":2364,"lbm_reads_lt_1ms":103,"lbm_write_time_us":2872,"lbm_writes_lt_1ms":88,"num_input_rowsets":2,"peak_mem_usage":891113,"rows_written":58450}
I20251211 09:12:09.901751 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 595275 bytes on disk
I20251211 09:12:09.901937 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.952782 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.962253 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.009s user 0.008s sys 0.000s Metrics: {"bytes_written":272561,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":835,"drs_written":1,"lbm_read_time_us":11,"lbm_reads_lt_1ms":4,"lbm_write_time_us":461,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20251211 09:12:09.963482 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1048418 bytes of WAL
I20251211 09:12:09.963608 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:09.963675 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000002 (ops 630-1259)
I20251211 09:12:09.964169 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:09.964458 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87009 bytes on disk
I20251211 09:12:09.964617 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.964767 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013914
I20251211 09:12:09.968475 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:09.979321 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.011s user 0.010s sys 0.000s Metrics: {"bytes_written":281609,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":691,"drs_written":1,"lbm_read_time_us":11,"lbm_reads_lt_1ms":4,"lbm_write_time_us":506,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:12:09.979779 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1051481 bytes of WAL
I20251211 09:12:09.979935 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:09.979972 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000002 (ops 580-1158)
I20251211 09:12:09.981933 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:09.982118 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 90330 bytes on disk
I20251211 09:12:09.983045 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":37,"lbm_reads_lt_1ms":4}
I20251211 09:12:09.983297 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013910
I20251211 09:12:09.993238 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.012168 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.019s user 0.011s sys 0.003s Metrics: {"bytes_written":280237,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":711,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":651,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:12:10.012404 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1055582 bytes of WAL
I20251211 09:12:10.012514 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:10.012571 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000002 (ops 626-1251)
I20251211 09:12:10.012969 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:10.013087 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 89933 bytes on disk
I20251211 09:12:10.013221 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.013365 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014071
I20251211 09:12:10.064688 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.100s user 0.059s sys 0.016s Metrics: {"bytes_written":1888716,"cfile_cache_hit":12,"cfile_cache_hit_bytes":762156,"cfile_cache_miss":92,"cfile_cache_miss_bytes":4036410,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":135,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":705,"drs_written":1,"lbm_read_time_us":2743,"lbm_reads_lt_1ms":112,"lbm_write_time_us":4759,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":98,"num_input_rowsets":2,"peak_mem_usage":1019195,"rows_written":66850,"spinlock_wait_cycles":384}
I20251211 09:12:10.064906 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 686519 bytes on disk
I20251211 09:12:10.065045 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.099767 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.116s user 0.074s sys 0.009s Metrics: {"bytes_written":1903982,"cfile_cache_hit":12,"cfile_cache_hit_bytes":769149,"cfile_cache_miss":92,"cfile_cache_miss_bytes":4070437,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":178,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":649,"drs_written":1,"lbm_read_time_us":2387,"lbm_reads_lt_1ms":112,"lbm_write_time_us":5444,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":98,"num_input_rowsets":2,"peak_mem_usage":1028345,"rows_written":67450}
I20251211 09:12:10.099938 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 693702 bytes on disk
I20251211 09:12:10.100068 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.110389 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.097s user 0.074s sys 0.000s Metrics: {"bytes_written":1923446,"cfile_cache_hit":10,"cfile_cache_hit_bytes":446667,"cfile_cache_miss":96,"cfile_cache_miss_bytes":4447573,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":289,"dirs.run_cpu_time_us":143,"dirs.run_wall_time_us":704,"drs_written":1,"lbm_read_time_us":2810,"lbm_reads_lt_1ms":116,"lbm_write_time_us":5004,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":98,"num_input_rowsets":2,"peak_mem_usage":1038128,"rows_written":68200}
I20251211 09:12:10.110707 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 702456 bytes on disk
I20251211 09:12:10.110921 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.166507 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.170984 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.183178 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.010s sys 0.000s Metrics: {"bytes_written":285537,"cfile_init":1,"dirs.queue_time_us":61,"dirs.run_cpu_time_us":137,"dirs.run_wall_time_us":922,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1064,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9950}
I20251211 09:12:10.183694 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014038
I20251211 09:12:10.187925 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.017s user 0.009s sys 0.002s Metrics: {"bytes_written":274978,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":725,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":589,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:10.188144 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.014034
I20251211 09:12:10.191952 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.212815 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.021s user 0.013s sys 0.000s Metrics: {"bytes_written":276470,"cfile_init":1,"dirs.queue_time_us":3623,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":670,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":644,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:12:10.216794 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013996
I20251211 09:12:10.345820 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.157s user 0.083s sys 0.007s Metrics: {"bytes_written":2171777,"cfile_cache_hit":12,"cfile_cache_hit_bytes":654188,"cfile_cache_miss":106,"cfile_cache_miss_bytes":4886678,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":132,"dirs.run_wall_time_us":776,"drs_written":1,"lbm_read_time_us":3670,"lbm_reads_lt_1ms":130,"lbm_write_time_us":6311,"lbm_writes_lt_1ms":111,"num_input_rowsets":2,"peak_mem_usage":1172310,"rows_written":77000,"spinlock_wait_cycles":384}
I20251211 09:12:10.346104 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 798469 bytes on disk
I20251211 09:12:10.346261 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.363862 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.180s user 0.077s sys 0.014s Metrics: {"bytes_written":2162570,"cfile_cache_hit":12,"cfile_cache_hit_bytes":663442,"cfile_cache_miss":106,"cfile_cache_miss_bytes":4861040,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":2481,"dirs.run_cpu_time_us":532,"dirs.run_wall_time_us":6588,"drs_written":1,"lbm_read_time_us":2774,"lbm_reads_lt_1ms":130,"lbm_write_time_us":11887,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":107,"mutex_wait_us":1438,"num_input_rowsets":2,"peak_mem_usage":1169260,"rows_written":76800}
I20251211 09:12:10.364555 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 796592 bytes on disk
I20251211 09:12:10.365324 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":35,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.365550 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.366636 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.380445 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.015s user 0.004s sys 0.006s Metrics: {"bytes_written":275069,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":1063,"drs_written":1,"lbm_read_time_us":34,"lbm_reads_lt_1ms":4,"lbm_write_time_us":590,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:10.380843 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87800 bytes on disk
I20251211 09:12:10.381349 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.015s user 0.012s sys 0.001s Metrics: {"bytes_written":275020,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":512,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":683,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:10.381707 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87786 bytes on disk
I20251211 09:12:10.381827 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.382170 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013950
I20251211 09:12:10.381955 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.382292 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013953
I20251211 09:12:10.393347 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.176s user 0.082s sys 0.010s Metrics: {"bytes_written":2192316,"cfile_cache_hit":14,"cfile_cache_hit_bytes":866852,"cfile_cache_miss":104,"cfile_cache_miss_bytes":4734200,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":510,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":490,"drs_written":1,"lbm_read_time_us":6155,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":127,"lbm_write_time_us":4879,"lbm_writes_lt_1ms":111,"num_input_rowsets":2,"peak_mem_usage":1188186,"rows_written":77800}
I20251211 09:12:10.393587 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.409965 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.012s sys 0.000s Metrics: {"bytes_written":277729,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":626,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":590,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20251211 09:12:10.410174 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 896642 bytes on disk
I20251211 09:12:10.410332 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":31,"lbm_reads_lt_1ms":8}
I20251211 09:12:10.410538 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013941
I20251211 09:12:10.506151 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.122s user 0.084s sys 0.012s Metrics: {"bytes_written":2430469,"cfile_cache_hit":11,"cfile_cache_hit_bytes":623240,"cfile_cache_miss":117,"cfile_cache_miss_bytes":5599098,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":115,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":710,"drs_written":1,"lbm_read_time_us":4913,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":136,"lbm_write_time_us":4025,"lbm_writes_lt_1ms":121,"num_input_rowsets":2,"peak_mem_usage":1325512,"rows_written":86350,"spinlock_wait_cycles":6016}
I20251211 09:12:10.506680 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 899963 bytes on disk
I20251211 09:12:10.507103 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.570186 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.160s user 0.087s sys 0.012s Metrics: {"bytes_written":2462537,"cfile_cache_hit":11,"cfile_cache_hit_bytes":625013,"cfile_cache_miss":119,"cfile_cache_miss_bytes":5678387,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":133,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":464,"drs_written":1,"lbm_read_time_us":6240,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":138,"lbm_write_time_us":5466,"lbm_writes_lt_1ms":123,"num_input_rowsets":2,"peak_mem_usage":1343286,"rows_written":87450,"spinlock_wait_cycles":768}
I20251211 09:12:10.570310 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.570425 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.188s user 0.089s sys 0.008s Metrics: {"bytes_written":2435691,"cfile_cache_hit":11,"cfile_cache_hit_bytes":623219,"cfile_cache_miss":119,"cfile_cache_miss_bytes":5612921,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":138,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":757,"drs_written":1,"lbm_read_time_us":4473,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":138,"lbm_write_time_us":18837,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":119,"num_input_rowsets":2,"peak_mem_usage":1328761,"rows_written":86550,"spinlock_wait_cycles":1152}
I20251211 09:12:10.570549 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 902392 bytes on disk
I20251211 09:12:10.570681 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.580929 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.581347 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 912663 bytes on disk
I20251211 09:12:10.581530 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.583200 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.013s user 0.009s sys 0.002s Metrics: {"bytes_written":273686,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":538,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":663,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500,"spinlock_wait_cycles":768}
I20251211 09:12:10.583416 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1046883 bytes of WAL
I20251211 09:12:10.583506 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:10.583573 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000003 (ops 1260-1884)
I20251211 09:12:10.583974 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:10.584147 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 89079 bytes on disk
I20251211 09:12:10.584286 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.584431 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013955
I20251211 09:12:10.598914 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.018s user 0.012s sys 0.000s Metrics: {"bytes_written":283085,"cfile_init":1,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":773,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":627,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20251211 09:12:10.599133 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1060737 bytes of WAL
I20251211 09:12:10.599226 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:10.599282 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000003 (ops 1159-1742)
I20251211 09:12:10.600194 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:10.600328 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013950
I20251211 09:12:10.601882 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.621003 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.019s user 0.013s sys 0.000s Metrics: {"bytes_written":283169,"cfile_init":1,"dirs.queue_time_us":2222,"dirs.run_cpu_time_us":139,"dirs.run_wall_time_us":825,"drs_written":1,"lbm_read_time_us":35,"lbm_reads_lt_1ms":4,"lbm_write_time_us":615,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20251211 09:12:10.621230 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1053805 bytes of WAL
I20251211 09:12:10.621351 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:10.621385 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000003 (ops 1252-1878)
I20251211 09:12:10.621727 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:10.622102 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 91979 bytes on disk
I20251211 09:12:10.622346 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.623332 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013940
I20251211 09:12:10.711499 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.111s user 0.099s sys 0.008s Metrics: {"bytes_written":2713269,"cfile_cache_hit":11,"cfile_cache_hit_bytes":506397,"cfile_cache_miss":129,"cfile_cache_miss_bytes":6449373,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":145,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":733,"drs_written":1,"lbm_read_time_us":2421,"lbm_reads_lt_1ms":153,"lbm_write_time_us":4369,"lbm_writes_lt_1ms":132,"num_input_rowsets":2,"peak_mem_usage":1486862,"rows_written":96400,"spinlock_wait_cycles":768}
I20251211 09:12:10.711751 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1013385 bytes on disk
I20251211 09:12:10.711889 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.768384 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.145s user 0.102s sys 0.007s Metrics: {"bytes_written":2736303,"cfile_cache_hit":10,"cfile_cache_hit_bytes":448946,"cfile_cache_miss":132,"cfile_cache_miss_bytes":6572360,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":728,"drs_written":1,"lbm_read_time_us":2943,"lbm_reads_lt_1ms":152,"lbm_write_time_us":4989,"lbm_writes_lt_1ms":134,"num_input_rowsets":2,"peak_mem_usage":1501486,"rows_written":97300}
I20251211 09:12:10.768658 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1023850 bytes on disk
I20251211 09:12:10.768783 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.788657 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.204s user 0.098s sys 0.015s Metrics: {"bytes_written":2699111,"cfile_cache_hit":10,"cfile_cache_hit_bytes":442183,"cfile_cache_miss":130,"cfile_cache_miss_bytes":6473071,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":671,"drs_written":1,"lbm_read_time_us":13513,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":149,"lbm_write_time_us":7673,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":131,"num_input_rowsets":2,"peak_mem_usage":1479927,"rows_written":95850,"spinlock_wait_cycles":1536}
I20251211 09:12:10.788825 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.803329 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.805045 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.014s sys 0.000s Metrics: {"bytes_written":276497,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":550,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":663,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:12:10.805353 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013895
I20251211 09:12:10.819568 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:10.831122 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.028s user 0.013s sys 0.000s Metrics: {"bytes_written":281577,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":643,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":667,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:12:10.833446 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013888
I20251211 09:12:10.847673 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.028s user 0.013s sys 0.001s Metrics: {"bytes_written":272524,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":606,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2672,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9450}
I20251211 09:12:10.847885 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013882
I20251211 09:12:10.936242 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.131s user 0.109s sys 0.016s Metrics: {"bytes_written":2963308,"cfile_cache_hit":10,"cfile_cache_hit_bytes":444214,"cfile_cache_miss":140,"cfile_cache_miss_bytes":7178468,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":157,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":692,"drs_written":1,"lbm_read_time_us":3458,"lbm_reads_lt_1ms":168,"lbm_write_time_us":6006,"lbm_writes_lt_1ms":143,"num_input_rowsets":2,"peak_mem_usage":1635817,"rows_written":105450,"spinlock_wait_cycles":768}
I20251211 09:12:10.936476 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1116462 bytes on disk
I20251211 09:12:10.936625 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:10.994633 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.161s user 0.120s sys 0.004s Metrics: {"bytes_written":2986494,"cfile_cache_hit":12,"cfile_cache_hit_bytes":655618,"cfile_cache_miss":138,"cfile_cache_miss_bytes":7020608,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":242,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":695,"drs_written":1,"lbm_read_time_us":6298,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":161,"lbm_write_time_us":6999,"lbm_writes_lt_1ms":144,"num_input_rowsets":2,"peak_mem_usage":1649452,"rows_written":106200}
I20251211 09:12:10.994915 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1125147 bytes on disk
I20251211 09:12:10.995081 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.018778 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.028119 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.180s user 0.115s sys 0.010s Metrics: {"bytes_written":3000486,"cfile_cache_hit":14,"cfile_cache_hit_bytes":819906,"cfile_cache_miss":140,"cfile_cache_miss_bytes":6898546,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":459,"drs_written":1,"lbm_read_time_us":3227,"lbm_reads_lt_1ms":164,"lbm_write_time_us":10586,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":142,"num_input_rowsets":2,"peak_mem_usage":1657086,"rows_written":106750}
I20251211 09:12:11.028483 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1131516 bytes on disk
I20251211 09:12:11.028668 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.031831 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.013s user 0.010s sys 0.000s Metrics: {"bytes_written":280357,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":74,"dirs.run_wall_time_us":438,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":604,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:12:11.032207 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013634
I20251211 09:12:11.035912 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.049098 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.056890 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.021s user 0.012s sys 0.000s Metrics: {"bytes_written":276501,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":641,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":807,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:12:11.057099 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013626
I20251211 09:12:11.065738 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.014s user 0.013s sys 0.000s Metrics: {"bytes_written":273690,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":672,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":615,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20251211 09:12:11.066246 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87428 bytes on disk
I20251211 09:12:11.066396 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.066509 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013622
I20251211 09:12:11.174913 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.142s user 0.124s sys 0.005s Metrics: {"bytes_written":3234824,"cfile_cache_hit":11,"cfile_cache_hit_bytes":623224,"cfile_cache_miss":151,"cfile_cache_miss_bytes":7714856,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":227,"dirs.run_cpu_time_us":126,"dirs.run_wall_time_us":796,"drs_written":1,"lbm_read_time_us":5739,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":174,"lbm_write_time_us":6256,"lbm_writes_lt_1ms":154,"num_input_rowsets":2,"peak_mem_usage":1792442,"rows_written":115200,"spinlock_wait_cycles":896}
I20251211 09:12:11.175256 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1226504 bytes on disk
I20251211 09:12:11.175486 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.233166 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.176s user 0.106s sys 0.023s Metrics: {"bytes_written":3250678,"cfile_cache_hit":14,"cfile_cache_hit_bytes":868636,"cfile_cache_miss":148,"cfile_cache_miss_bytes":7514374,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":445,"dirs.run_cpu_time_us":88,"dirs.run_wall_time_us":614,"drs_written":1,"lbm_read_time_us":4279,"lbm_reads_lt_1ms":172,"lbm_write_time_us":7593,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":154,"num_input_rowsets":2,"peak_mem_usage":1805642,"rows_written":115800}
I20251211 09:12:11.233741 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1233834 bytes on disk
I20251211 09:12:11.233870 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.242756 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.176s user 0.115s sys 0.015s Metrics: {"bytes_written":3262008,"cfile_cache_hit":12,"cfile_cache_hit_bytes":647789,"cfile_cache_miss":150,"cfile_cache_miss_bytes":7768437,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":513,"drs_written":1,"lbm_read_time_us":5039,"lbm_reads_lt_1ms":170,"lbm_write_time_us":6235,"lbm_writes_lt_1ms":155,"num_input_rowsets":2,"peak_mem_usage":1811407,"rows_written":116250}
I20251211 09:12:11.243661 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1238843 bytes on disk
I20251211 09:12:11.243827 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.266878 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.274441 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.287124 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.020s user 0.008s sys 0.002s Metrics: {"bytes_written":277841,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":825,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4852,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9650}
I20251211 09:12:11.287343 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 88793 bytes on disk
I20251211 09:12:11.287534 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.287503 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.287722 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013540
I20251211 09:12:11.291785 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.017s user 0.006s sys 0.004s Metrics: {"bytes_written":281571,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":447,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3310,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:12:11.291965 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1048084 bytes of WAL
I20251211 09:12:11.292896 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:11.292965 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000004 (ops 1743-2319)
I20251211 09:12:11.293493 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:11.293608 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013533
I20251211 09:12:11.306255 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.019s user 0.013s sys 0.000s Metrics: {"bytes_written":276465,"cfile_init":1,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":580,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":686,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20251211 09:12:11.306530 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1047650 bytes of WAL
I20251211 09:12:11.306947 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:11.307049 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000004 (ops 1879-2496)
I20251211 09:12:11.308475 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:11.308599 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013530
I20251211 09:12:11.461881 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.153s user 0.131s sys 0.013s Metrics: {"bytes_written":3532970,"cfile_cache_hit":11,"cfile_cache_hit_bytes":474478,"cfile_cache_miss":163,"cfile_cache_miss_bytes":8645612,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":392,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":752,"drs_written":1,"lbm_read_time_us":4382,"lbm_reads_lt_1ms":187,"lbm_write_time_us":7992,"lbm_writes_lt_1ms":167,"num_input_rowsets":2,"peak_mem_usage":1967292,"rows_written":125850}
I20251211 09:12:11.462240 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1346947 bytes on disk
I20251211 09:12:11.462417 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.467990 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.180s user 0.128s sys 0.013s Metrics: {"bytes_written":3507686,"cfile_cache_hit":12,"cfile_cache_hit_bytes":608366,"cfile_cache_miss":160,"cfile_cache_miss_bytes":8436364,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":98,"dirs.run_cpu_time_us":140,"dirs.run_wall_time_us":658,"drs_written":1,"lbm_read_time_us":4948,"lbm_reads_lt_1ms":180,"lbm_write_time_us":7428,"lbm_writes_lt_1ms":166,"num_input_rowsets":2,"peak_mem_usage":1950993,"rows_written":124850}
I20251211 09:12:11.468261 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1336009 bytes on disk
I20251211 09:12:11.468434 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.509089 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.533820 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.542132 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.033s user 0.016s sys 0.000s Metrics: {"bytes_written":273745,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":723,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":11936,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9500,"spinlock_wait_cycles":768}
I20251211 09:12:11.542440 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1052667 bytes of WAL
I20251211 09:12:11.542577 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:11.542650 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000004 (ops 1885-2520)
I20251211 09:12:11.543128 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:11.543262 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 87285 bytes on disk
I20251211 09:12:11.543408 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.543536 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013246
I20251211 09:12:11.599440 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.306s user 0.132s sys 0.015s Metrics: {"bytes_written":3526505,"cfile_cache_hit":13,"cfile_cache_hit_bytes":747583,"cfile_cache_miss":161,"cfile_cache_miss_bytes":8353795,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":176,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":722,"drs_written":1,"lbm_read_time_us":10736,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":183,"lbm_write_time_us":7846,"lbm_writes_lt_1ms":167,"num_input_rowsets":2,"peak_mem_usage":1964682,"rows_written":125600}
I20251211 09:12:11.600273 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1344470 bytes on disk
I20251211 09:12:11.601758 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":1338,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3}
I20251211 09:12:11.601909 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.614164 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.080s user 0.010s sys 0.006s Metrics: {"bytes_written":281602,"cfile_init":1,"dirs.queue_time_us":2472,"dirs.run_cpu_time_us":605,"dirs.run_wall_time_us":1148,"drs_written":1,"lbm_read_time_us":32,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5089,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:12:11.614374 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013140
I20251211 09:12:11.628849 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.026s user 0.015s sys 0.004s Metrics: {"bytes_written":399483,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":594,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2932,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13800}
I20251211 09:12:11.629060 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 130883 bytes on disk
I20251211 09:12:11.629189 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.629316 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013264
I20251211 09:12:11.742827 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.199s user 0.139s sys 0.008s Metrics: {"bytes_written":3769981,"cfile_cache_hit":12,"cfile_cache_hit_bytes":629793,"cfile_cache_miss":172,"cfile_cache_miss_bytes":9119039,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":199,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":963,"drs_written":1,"lbm_read_time_us":5810,"lbm_reads_lt_1ms":192,"lbm_write_time_us":10637,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":176,"num_input_rowsets":2,"peak_mem_usage":2105508,"rows_written":134350,"spinlock_wait_cycles":384}
I20251211 09:12:11.743343 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1442492 bytes on disk
I20251211 09:12:11.743563 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.743827 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.795583 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.051s user 0.006s sys 0.010s Metrics: {"bytes_written":300294,"cfile_init":1,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":815,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":835,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10350}
I20251211 09:12:11.795890 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 95255 bytes on disk
I20251211 09:12:11.796144 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.796319 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013175
I20251211 09:12:11.835757 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.206s user 0.137s sys 0.016s Metrics: {"bytes_written":3911128,"cfile_cache_hit":11,"cfile_cache_hit_bytes":685200,"cfile_cache_miss":179,"cfile_cache_miss_bytes":9432136,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":6509,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":696,"drs_written":1,"lbm_read_time_us":5162,"lbm_reads_lt_1ms":199,"lbm_write_time_us":9307,"lbm_writes_lt_1ms":184,"num_input_rowsets":2,"peak_mem_usage":2184913,"rows_written":139400}
I20251211 09:12:11.836006 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:11.870606 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.033s user 0.014s sys 0.000s Metrics: {"bytes_written":280361,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":809,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":567,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20251211 09:12:11.870811 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1056919 bytes of WAL
I20251211 09:12:11.870886 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:11.870920 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000005 (ops 2320-2901)
I20251211 09:12:11.871577 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:11.871726 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1590154 bytes on disk
I20251211 09:12:11.871912 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":31,"lbm_reads_lt_1ms":8}
I20251211 09:12:11.872037 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013155
I20251211 09:12:11.980002 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.366s user 0.136s sys 0.016s Metrics: {"bytes_written":3807610,"cfile_cache_hit":13,"cfile_cache_hit_bytes":943302,"cfile_cache_miss":173,"cfile_cache_miss_bytes":8900554,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":856,"drs_written":1,"lbm_read_time_us":7965,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":195,"lbm_write_time_us":17034,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":176,"num_input_rowsets":2,"peak_mem_usage":2126332,"rows_written":135650}
I20251211 09:12:11.980219 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1456861 bytes on disk
I20251211 09:12:11.980880 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:11.981022 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:12.041126 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.245s user 0.150s sys 0.008s Metrics: {"bytes_written":4056670,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1012166,"cfile_cache_miss":184,"cfile_cache_miss_bytes":9493796,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":137,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":571,"drs_written":1,"lbm_read_time_us":5060,"lbm_reads_lt_1ms":204,"lbm_write_time_us":11593,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":189,"num_input_rowsets":2,"peak_mem_usage":2271183,"rows_written":144700,"spinlock_wait_cycles":384}
I20251211 09:12:12.041309 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.046073 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.065s user 0.011s sys 0.011s Metrics: {"bytes_written":578827,"cfile_init":1,"dirs.queue_time_us":257,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":675,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2799,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20350}
I20251211 09:12:12.049417 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1062472 bytes of WAL
I20251211 09:12:12.049526 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:12.049562 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000005 (ops 2497-3118)
I20251211 09:12:12.050391 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:12.050770 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 193662 bytes on disk
I20251211 09:12:12.050925 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:12.051033 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013153
I20251211 09:12:12.065093 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.023s user 0.019s sys 0.000s Metrics: {"bytes_written":404551,"cfile_init":1,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":655,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1502,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14000}
I20251211 09:12:12.065367 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1056702 bytes of WAL
I20251211 09:12:12.065539 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:12.065624 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000005 (ops 2521-3154)
I20251211 09:12:12.066179 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:12.066644 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1692826 bytes on disk
I20251211 09:12:12.066839 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20251211 09:12:12.066992 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013198
I20251211 09:12:12.084214 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.212s user 0.154s sys 0.014s Metrics: {"bytes_written":4183903,"cfile_cache_hit":13,"cfile_cache_hit_bytes":824085,"cfile_cache_miss":191,"cfile_cache_miss_bytes":10012637,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":140,"dirs.run_cpu_time_us":161,"dirs.run_wall_time_us":3501,"drs_written":1,"lbm_read_time_us":6085,"lbm_reads_lt_1ms":211,"lbm_write_time_us":8938,"lbm_writes_lt_1ms":195,"num_input_rowsets":2,"peak_mem_usage":2345741,"rows_written":149150}
I20251211 09:12:12.084504 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.102355 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.018s user 0.014s sys 0.000s Metrics: {"bytes_written":324260,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":79,"dirs.run_wall_time_us":820,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":689,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11250}
I20251211 09:12:12.102672 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1716882 bytes on disk
I20251211 09:12:12.103718 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":35,"lbm_reads_lt_1ms":8}
I20251211 09:12:12.103904 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013197
I20251211 09:12:12.277575 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.210s user 0.184s sys 0.008s Metrics: {"bytes_written":4446131,"cfile_cache_hit":11,"cfile_cache_hit_bytes":698720,"cfile_cache_miss":205,"cfile_cache_miss_bytes":10833394,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":171,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":775,"drs_written":1,"lbm_read_time_us":5850,"lbm_reads_lt_1ms":225,"lbm_write_time_us":9724,"lbm_writes_lt_1ms":206,"num_input_rowsets":2,"peak_mem_usage":2498314,"rows_written":158700,"spinlock_wait_cycles":1152}
I20251211 09:12:12.277951 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1721675 bytes on disk
I20251211 09:12:12.278131 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:12.326931 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.223s user 0.164s sys 0.019s Metrics: {"bytes_written":4493950,"cfile_cache_hit":12,"cfile_cache_hit_bytes":684006,"cfile_cache_miss":204,"cfile_cache_miss_bytes":10981856,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":471,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":666,"drs_written":1,"lbm_read_time_us":5425,"lbm_reads_lt_1ms":224,"lbm_write_time_us":8438,"lbm_writes_lt_1ms":208,"num_input_rowsets":2,"peak_mem_usage":2525389,"rows_written":160400,"spinlock_wait_cycles":768}
I20251211 09:12:12.327580 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1741367 bytes on disk
I20251211 09:12:12.327790 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:12.328838 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.346843 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.018s user 0.011s sys 0.000s Metrics: {"bytes_written":277755,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":627,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1066,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20251211 09:12:12.347126 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012954
I20251211 09:12:12.358319 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.379417 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.021s user 0.013s sys 0.000s Metrics: {"bytes_written":272539,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":768,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1061,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20251211 09:12:12.379706 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012937
I20251211 09:12:12.418324 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.367s user 0.162s sys 0.014s Metrics: {"bytes_written":4372992,"cfile_cache_hit":12,"cfile_cache_hit_bytes":760285,"cfile_cache_miss":200,"cfile_cache_miss_bytes":10554119,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":727,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":1142,"drs_written":1,"lbm_read_time_us":8429,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":219,"lbm_write_time_us":14819,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":200,"num_input_rowsets":2,"peak_mem_usage":2444787,"rows_written":156000}
I20251211 09:12:12.418684 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.456722 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.037s user 0.017s sys 0.003s Metrics: {"bytes_written":453908,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":779,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2791,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":39,"peak_mem_usage":0,"rows_written":15800}
I20251211 09:12:12.456983 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.013084
I20251211 09:12:12.547349 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.200s user 0.164s sys 0.020s Metrics: {"bytes_written":4716502,"cfile_cache_hit":10,"cfile_cache_hit_bytes":445941,"cfile_cache_miss":216,"cfile_cache_miss_bytes":11805363,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":487,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":958,"drs_written":1,"lbm_read_time_us":5549,"lbm_reads_lt_1ms":240,"lbm_write_time_us":8798,"lbm_writes_lt_1ms":218,"num_input_rowsets":2,"peak_mem_usage":2657821,"rows_written":168350}
I20251211 09:12:12.547664 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 1831704 bytes on disk
I20251211 09:12:12.547821 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:12.578370 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.606192 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.027s user 0.010s sys 0.003s Metrics: {"bytes_written":275104,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":634,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1067,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20251211 09:12:12.606465 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012634
I20251211 09:12:12.629284 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.249s user 0.156s sys 0.029s Metrics: {"bytes_written":4757494,"cfile_cache_hit":12,"cfile_cache_hit_bytes":643340,"cfile_cache_miss":216,"cfile_cache_miss_bytes":11720534,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":53,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":834,"drs_written":1,"lbm_read_time_us":6497,"lbm_reads_lt_1ms":240,"lbm_write_time_us":10984,"lbm_writes_lt_1ms":220,"num_input_rowsets":2,"peak_mem_usage":2682390,"rows_written":169850,"spinlock_wait_cycles":768}
I20251211 09:12:12.629632 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.647037 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":279191,"cfile_init":1,"dirs.queue_time_us":1828,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":595,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1665,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20251211 09:12:12.647644 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1066170 bytes of WAL
I20251211 09:12:12.647753 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:12.647828 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000006 (ops 2902-3488)
I20251211 09:12:12.648221 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:12.648535 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012827
I20251211 09:12:12.721390 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.264s user 0.175s sys 0.013s Metrics: {"bytes_written":4811240,"cfile_cache_hit":12,"cfile_cache_hit_bytes":746179,"cfile_cache_miss":220,"cfile_cache_miss_bytes":11745355,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":681,"drs_written":1,"lbm_read_time_us":5914,"lbm_reads_lt_1ms":248,"lbm_write_time_us":10920,"lbm_writes_lt_1ms":222,"num_input_rowsets":2,"peak_mem_usage":2709371,"rows_written":171800,"spinlock_wait_cycles":896}
I20251211 09:12:12.721601 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.748057 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.026s user 0.015s sys 0.001s Metrics: {"bytes_written":351825,"cfile_init":1,"dirs.queue_time_us":16,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":714,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1129,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12150}
I20251211 09:12:12.748371 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012706
I20251211 09:12:12.894096 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.287s user 0.180s sys 0.019s Metrics: {"bytes_written":4984272,"cfile_cache_hit":12,"cfile_cache_hit_bytes":786844,"cfile_cache_miss":226,"cfile_cache_miss_bytes":12169700,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":161,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":691,"drs_written":1,"lbm_read_time_us":8545,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":249,"lbm_write_time_us":9945,"lbm_writes_lt_1ms":229,"num_input_rowsets":2,"peak_mem_usage":2811446,"rows_written":177900}
I20251211 09:12:12.894523 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.895392 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.247s user 0.188s sys 0.013s Metrics: {"bytes_written":5026923,"cfile_cache_hit":13,"cfile_cache_hit_bytes":679250,"cfile_cache_miss":227,"cfile_cache_miss_bytes":12395980,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":241,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":912,"drs_written":1,"lbm_read_time_us":6962,"lbm_reads_lt_1ms":255,"lbm_write_time_us":10362,"lbm_writes_lt_1ms":229,"num_input_rowsets":2,"peak_mem_usage":2839760,"rows_written":179550,"spinlock_wait_cycles":768}
I20251211 09:12:12.896534 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:12.929973 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.035s user 0.016s sys 0.000s Metrics: {"bytes_written":337333,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":434,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":806,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11750}
I20251211 09:12:12.930140 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1049895 bytes of WAL
I20251211 09:12:12.930250 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:12.930289 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000006 (ops 3155-3779)
I20251211 09:12:12.930617 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:12.930703 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2048191 bytes on disk
I20251211 09:12:12.930979 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":33,"lbm_reads_lt_1ms":8}
I20251211 09:12:12.931347 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012980
I20251211 09:12:12.944856 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.043s user 0.015s sys 0.000s Metrics: {"bytes_written":302865,"cfile_init":1,"dirs.queue_time_us":1301,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":559,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":669,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10450}
I20251211 09:12:12.945299 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012973
I20251211 09:12:13.062628 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.314s user 0.191s sys 0.014s Metrics: {"bytes_written":5147450,"cfile_cache_hit":10,"cfile_cache_hit_bytes":494240,"cfile_cache_miss":234,"cfile_cache_miss_bytes":12901224,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":410,"dirs.run_cpu_time_us":156,"dirs.run_wall_time_us":825,"drs_written":1,"lbm_read_time_us":9138,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":261,"lbm_write_time_us":12739,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":235,"mutex_wait_us":2,"num_input_rowsets":2,"peak_mem_usage":2908802,"rows_written":183950}
I20251211 09:12:13.063346 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2009223 bytes on disk
I20251211 09:12:13.063606 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.064217 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.094640 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.030s user 0.015s sys 0.001s Metrics: {"bytes_written":335881,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":700,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":658,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11700}
I20251211 09:12:13.094880 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1056224 bytes of WAL
I20251211 09:12:13.094980 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:13.095041 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000006 (ops 3119-3744)
I20251211 09:12:13.095520 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:13.095654 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 108621 bytes on disk
I20251211 09:12:13.095788 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.095903 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012946
I20251211 09:12:13.145681 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.214s user 0.192s sys 0.016s Metrics: {"bytes_written":5306410,"cfile_cache_hit":12,"cfile_cache_hit_bytes":827517,"cfile_cache_miss":238,"cfile_cache_miss_bytes":12987805,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":400,"dirs.run_cpu_time_us":160,"dirs.run_wall_time_us":1931,"drs_written":1,"lbm_read_time_us":6028,"lbm_reads_lt_1ms":258,"lbm_write_time_us":11277,"lbm_writes_lt_1ms":241,"num_input_rowsets":2,"peak_mem_usage":3001819,"rows_written":189650,"spinlock_wait_cycles":1408}
I20251211 09:12:13.146023 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2075153 bytes on disk
I20251211 09:12:13.146231 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.156592 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.180773 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.024s user 0.010s sys 0.004s Metrics: {"bytes_written":272507,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":681,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5566,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9450}
I20251211 09:12:13.181322 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012855
I20251211 09:12:13.227404 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.282s user 0.193s sys 0.014s Metrics: {"bytes_written":5318978,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1004711,"cfile_cache_miss":234,"cfile_cache_miss_bytes":12839777,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":621,"drs_written":1,"lbm_read_time_us":8126,"lbm_reads_lt_1ms":262,"lbm_write_time_us":11371,"lbm_writes_lt_1ms":243,"num_input_rowsets":2,"peak_mem_usage":3007161,"rows_written":190000}
I20251211 09:12:13.228698 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2079150 bytes on disk
I20251211 09:12:13.228879 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.230206 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.248230 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.018s user 0.015s sys 0.000s Metrics: {"bytes_written":350194,"cfile_init":1,"dirs.queue_time_us":120,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":951,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1089,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12100}
I20251211 09:12:13.248483 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012824
I20251211 09:12:13.437601 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.342s user 0.192s sys 0.022s Metrics: {"bytes_written":5474638,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1134819,"cfile_cache_miss":243,"cfile_cache_miss_bytes":13118531,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":741,"drs_written":1,"lbm_read_time_us":10595,"lbm_reads_lt_1ms":263,"lbm_write_time_us":15624,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":248,"num_input_rowsets":2,"peak_mem_usage":3099361,"rows_written":195650,"spinlock_wait_cycles":86272}
I20251211 09:12:13.439234 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2144018 bytes on disk
I20251211 09:12:13.439535 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.439779 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.468897 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.029s user 0.007s sys 0.010s Metrics: {"bytes_written":369037,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":677,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1005,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12800}
I20251211 09:12:13.469164 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012709
I20251211 09:12:13.474013 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.293s user 0.205s sys 0.009s Metrics: {"bytes_written":5569633,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1083935,"cfile_cache_miss":246,"cfile_cache_miss_bytes":13432613,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1128,"dirs.run_cpu_time_us":432,"dirs.run_wall_time_us":3185,"drs_written":1,"lbm_read_time_us":8171,"lbm_reads_lt_1ms":270,"lbm_write_time_us":11720,"lbm_writes_lt_1ms":255,"num_input_rowsets":2,"peak_mem_usage":3156021,"rows_written":199100}
I20251211 09:12:13.474270 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.495007 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.021s user 0.013s sys 0.000s Metrics: {"bytes_written":292151,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":78,"dirs.run_wall_time_us":469,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":568,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10200}
I20251211 09:12:13.495412 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2278607 bytes on disk
I20251211 09:12:13.495642 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":33,"lbm_reads_lt_1ms":8}
I20251211 09:12:13.495929 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012698
I20251211 09:12:13.546022 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.297s user 0.201s sys 0.028s Metrics: {"bytes_written":5654838,"cfile_cache_hit":11,"cfile_cache_hit_bytes":645583,"cfile_cache_miss":253,"cfile_cache_miss_bytes":14085723,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":79,"dirs.run_wall_time_us":492,"drs_written":1,"lbm_read_time_us":11653,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":276,"lbm_write_time_us":11744,"lbm_writes_lt_1ms":259,"num_input_rowsets":2,"peak_mem_usage":3205418,"rows_written":202100,"spinlock_wait_cycles":768}
I20251211 09:12:13.546322 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2218486 bytes on disk
I20251211 09:12:13.546697 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":28,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.546880 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.563290 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.016s user 0.012s sys 0.000s Metrics: {"bytes_written":285656,"cfile_init":1,"dirs.queue_time_us":18,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":610,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9950}
I20251211 09:12:13.563493 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1058935 bytes of WAL
I20251211 09:12:13.563616 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:13.563679 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000007 (ops 3489-4071)
I20251211 09:12:13.564116 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:13.565217 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 91609 bytes on disk
I20251211 09:12:13.565449 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":41,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.565604 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012668
I20251211 09:12:13.780153 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.284s user 0.206s sys 0.015s Metrics: {"bytes_written":5854356,"cfile_cache_hit":13,"cfile_cache_hit_bytes":826008,"cfile_cache_miss":263,"cfile_cache_miss_bytes":14439838,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":817,"drs_written":1,"lbm_read_time_us":7565,"lbm_reads_lt_1ms":283,"lbm_write_time_us":12472,"lbm_writes_lt_1ms":267,"num_input_rowsets":2,"peak_mem_usage":3324316,"rows_written":209300,"spinlock_wait_cycles":384}
I20251211 09:12:13.780375 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2301096 bytes on disk
I20251211 09:12:13.780925 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.781056 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.801671 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.021s user 0.012s sys 0.004s Metrics: {"bytes_written":353178,"cfile_init":1,"dirs.queue_time_us":17,"dirs.run_cpu_time_us":79,"dirs.run_wall_time_us":426,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":984,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12200}
I20251211 09:12:13.801904 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012574
I20251211 09:12:13.848325 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.283s user 0.212s sys 0.017s Metrics: {"bytes_written":5930745,"cfile_cache_hit":13,"cfile_cache_hit_bytes":820268,"cfile_cache_miss":267,"cfile_cache_miss_bytes":14649512,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":699,"dirs.run_cpu_time_us":67,"dirs.run_wall_time_us":374,"drs_written":1,"lbm_read_time_us":9410,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":286,"lbm_write_time_us":12438,"lbm_writes_lt_1ms":270,"num_input_rowsets":2,"peak_mem_usage":3370894,"rows_written":212050,"spinlock_wait_cycles":1152}
I20251211 09:12:13.848569 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2332075 bytes on disk
I20251211 09:12:13.848707 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.848824 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.866992 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.397s user 0.211s sys 0.017s Metrics: {"bytes_written":5828872,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1047764,"cfile_cache_miss":256,"cfile_cache_miss_bytes":14150850,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1293,"dirs.run_cpu_time_us":444,"dirs.run_wall_time_us":11859,"drs_written":1,"lbm_read_time_us":12298,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":279,"lbm_write_time_us":24743,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":262,"num_input_rowsets":2,"peak_mem_usage":3306251,"rows_written":208450}
I20251211 09:12:13.867300 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2291387 bytes on disk
I20251211 09:12:13.867862 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:12:13.868052 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:13.867978 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.019s user 0.012s sys 0.004s Metrics: {"bytes_written":338286,"cfile_init":1,"dirs.queue_time_us":20,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":771,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11800}
I20251211 09:12:13.868325 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012589
I20251211 09:12:13.912268 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.044s user 0.022s sys 0.001s Metrics: {"bytes_written":462643,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":698,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2338,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":39,"peak_mem_usage":0,"rows_written":16150}
I20251211 09:12:13.912565 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1057586 bytes of WAL
I20251211 09:12:13.912689 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:13.912842 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000007 (ops 3745-4369)
I20251211 09:12:13.914088 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:13.914251 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012584
I20251211 09:12:14.115411 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.313s user 0.203s sys 0.032s Metrics: {"bytes_written":6193320,"cfile_cache_hit":13,"cfile_cache_hit_bytes":598377,"cfile_cache_miss":277,"cfile_cache_miss_bytes":15568809,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":881,"drs_written":1,"lbm_read_time_us":9329,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":300,"lbm_write_time_us":13584,"lbm_writes_lt_1ms":281,"mutex_wait_us":1,"num_input_rowsets":2,"peak_mem_usage":3523844,"rows_written":221500,"spinlock_wait_cycles":692480}
I20251211 09:12:14.115648 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1047263 bytes of WAL
I20251211 09:12:14.115859 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:14.115904 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000007 (ops 3780-4408)
I20251211 09:12:14.116359 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:14.116485 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2441570 bytes on disk
I20251211 09:12:14.116616 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:14.116703 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:14.120080 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.252s user 0.221s sys 0.020s Metrics: {"bytes_written":6255254,"cfile_cache_hit":11,"cfile_cache_hit_bytes":655996,"cfile_cache_miss":281,"cfile_cache_miss_bytes":15678650,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":364,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":679,"drs_written":1,"lbm_read_time_us":6986,"lbm_reads_lt_1ms":305,"lbm_write_time_us":12234,"lbm_writes_lt_1ms":283,"num_input_rowsets":2,"peak_mem_usage":3560783,"rows_written":223850,"spinlock_wait_cycles":768}
I20251211 09:12:14.120242 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:14.135370 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.015s user 0.013s sys 0.000s Metrics: {"bytes_written":281658,"cfile_init":1,"dirs.queue_time_us":1661,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":724,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800,"thread_start_us":60,"threads_started":1}
I20251211 09:12:14.135624 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1062485 bytes of WAL
I20251211 09:12:14.135759 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:14.135860 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000008 (ops 4072-4656)
I20251211 09:12:14.136330 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:14.136472 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012163
I20251211 09:12:14.143520 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.027s user 0.013s sys 0.002s Metrics: {"bytes_written":342393,"cfile_init":1,"dirs.queue_time_us":310,"drs_written":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2158,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":11950}
I20251211 09:12:14.143695 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012363
I20251211 09:12:14.273775 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.359s user 0.222s sys 0.022s Metrics: {"bytes_written":6277633,"cfile_cache_hit":11,"cfile_cache_hit_bytes":575914,"cfile_cache_miss":285,"cfile_cache_miss_bytes":15810128,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":376,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":709,"drs_written":1,"lbm_read_time_us":8024,"lbm_reads_lt_1ms":309,"lbm_write_time_us":18131,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":283,"num_input_rowsets":2,"peak_mem_usage":3566965,"rows_written":224600,"thread_start_us":54,"threads_started":1}
I20251211 09:12:14.274174 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2477317 bytes on disk
I20251211 09:12:14.274400 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:14.274605 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:14.303048 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.028s user 0.014s sys 0.004s Metrics: {"bytes_written":390232,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":611,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1012,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13600}
I20251211 09:12:14.303318 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 127241 bytes on disk
I20251211 09:12:14.303541 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:14.303716 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012248
I20251211 09:12:14.397116 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.261s user 0.231s sys 0.017s Metrics: {"bytes_written":6529977,"cfile_cache_hit":12,"cfile_cache_hit_bytes":647363,"cfile_cache_miss":292,"cfile_cache_miss_bytes":16413437,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":905,"drs_written":1,"lbm_read_time_us":7584,"lbm_reads_lt_1ms":320,"lbm_write_time_us":12660,"lbm_writes_lt_1ms":294,"num_input_rowsets":2,"peak_mem_usage":3720374,"rows_written":233650,"spinlock_wait_cycles":384}
I20251211 09:12:14.397379 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2581713 bytes on disk
I20251211 09:12:14.397713 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:14.458719 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:14.490095 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.346s user 0.232s sys 0.019s Metrics: {"bytes_written":6525116,"cfile_cache_hit":11,"cfile_cache_hit_bytes":658202,"cfile_cache_miss":293,"cfile_cache_miss_bytes":16388132,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":144,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":527,"drs_written":1,"lbm_read_time_us":9558,"lbm_reads_lt_1ms":317,"lbm_write_time_us":14782,"lbm_writes_lt_1ms":294,"num_input_rowsets":2,"peak_mem_usage":3716623,"rows_written":233450,"spinlock_wait_cycles":1792}
I20251211 09:12:14.490417 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:14.514873 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.054s user 0.011s sys 0.006s Metrics: {"bytes_written":281586,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":753,"drs_written":1,"lbm_read_time_us":31,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1082,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20251211 09:12:14.515180 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012418
I20251211 09:12:14.518129 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.028s user 0.012s sys 0.004s Metrics: {"bytes_written":315975,"cfile_init":1,"dirs.queue_time_us":277,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":1606,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":831,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":10950}
I20251211 09:12:14.519165 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012408
I20251211 09:12:14.605892 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.302s user 0.237s sys 0.021s Metrics: {"bytes_written":6656056,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1041055,"cfile_cache_miss":295,"cfile_cache_miss_bytes":16348825,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":706,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":614,"drs_written":1,"lbm_read_time_us":7985,"lbm_reads_lt_1ms":315,"lbm_write_time_us":13617,"lbm_writes_lt_1ms":300,"num_input_rowsets":2,"peak_mem_usage":3793799,"rows_written":238200,"spinlock_wait_cycles":768}
I20251211 09:12:14.606192 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2633583 bytes on disk
I20251211 09:12:14.606492 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20251211 09:12:14.606683 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:14.630158 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.023s user 0.013s sys 0.003s Metrics: {"bytes_written":312132,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":642,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":807,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10800}
I20251211 09:12:14.630779 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1049958 bytes of WAL
I20251211 09:12:14.630889 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:14.630966 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000008 (ops 4370-4957)
I20251211 09:12:14.631327 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:14.631434 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012311
I20251211 09:12:14.825058 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.306s user 0.216s sys 0.042s Metrics: {"bytes_written":6826135,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1028006,"cfile_cache_miss":301,"cfile_cache_miss_bytes":16827144,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1143,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":773,"drs_written":1,"lbm_read_time_us":8464,"lbm_reads_lt_1ms":329,"lbm_write_time_us":13631,"lbm_writes_lt_1ms":307,"num_input_rowsets":2,"peak_mem_usage":3893897,"rows_written":244400,"spinlock_wait_cycles":434176}
I20251211 09:12:14.825383 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:14.845023 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.019s user 0.017s sys 0.000s Metrics: {"bytes_written":398343,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":801,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":782,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":13750}
I20251211 09:12:14.845366 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012273
I20251211 09:12:15.135360 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.287s user 0.247s sys 0.024s Metrics: {"bytes_written":7207925,"cfile_cache_hit":12,"cfile_cache_hit_bytes":858602,"cfile_cache_miss":320,"cfile_cache_miss_bytes":18008404,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":509,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":1192,"drs_written":1,"lbm_read_time_us":9314,"lbm_reads_lt_1ms":348,"lbm_write_time_us":12567,"lbm_writes_lt_1ms":322,"mutex_wait_us":16,"num_input_rowsets":2,"peak_mem_usage":4116164,"rows_written":258150,"spinlock_wait_cycles":1280}
I20251211 09:12:15.136384 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.621s user 0.234s sys 0.039s Metrics: {"bytes_written":6802335,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1002833,"cfile_cache_miss":299,"cfile_cache_miss_bytes":16784451,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":25502,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":1173,"drs_written":1,"lbm_read_time_us":19072,"lbm_reads_1-10_ms":5,"lbm_reads_lt_1ms":318,"lbm_write_time_us":23920,"lbm_writes_1-10_ms":5,"lbm_writes_lt_1ms":301,"num_input_rowsets":2,"peak_mem_usage":3881264,"rows_written":243450,"spinlock_wait_cycles":768,"thread_start_us":292,"threads_started":6}
I20251211 09:12:15.137105 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:15.137194 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1075515 bytes of WAL
I20251211 09:12:15.137355 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:15.137456 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000008 (ops 4409-5046)
I20251211 09:12:15.138330 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:15.138468 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2863737 bytes on disk
I20251211 09:12:15.138636 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:15.138773 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:15.158277 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.019s user 0.016s sys 0.000s Metrics: {"bytes_written":383498,"cfile_init":1,"dirs.queue_time_us":1512,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":865,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13350}
I20251211 09:12:15.158564 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 125078 bytes on disk
I20251211 09:12:15.159468 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:15.159679 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012067
I20251211 09:12:15.179672 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.548s user 0.256s sys 0.018s Metrics: {"bytes_written":6956669,"cfile_cache_hit":12,"cfile_cache_hit_bytes":669062,"cfile_cache_miss":308,"cfile_cache_miss_bytes":17520936,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":191,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":733,"drs_written":1,"lbm_read_time_us":16203,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":330,"lbm_write_time_us":22927,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":311,"num_input_rowsets":2,"peak_mem_usage":3972097,"rows_written":249000,"spinlock_wait_cycles":1152,"thread_start_us":253,"threads_started":5}
I20251211 09:12:15.179910 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 2757844 bytes on disk
I20251211 09:12:15.180847 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20251211 09:12:15.180972 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:15.215998 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.079s user 0.032s sys 0.001s Metrics: {"bytes_written":799752,"cfile_init":1,"dirs.queue_time_us":280,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":2202,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8535,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":52,"peak_mem_usage":0,"rows_written":28050}
I20251211 09:12:15.216379 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012137
I20251211 09:12:15.251976 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.071s user 0.028s sys 0.001s Metrics: {"bytes_written":692796,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":803,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3706,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":48,"peak_mem_usage":0,"rows_written":24250}
I20251211 09:12:15.253213 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 233891 bytes on disk
I20251211 09:12:15.254109 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24,"lbm_reads_lt_1ms":4}
I20251211 09:12:15.254305 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.012118
I20251211 09:12:15.629351 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.469s user 0.265s sys 0.025s Metrics: {"bytes_written":7579264,"cfile_cache_hit":13,"cfile_cache_hit_bytes":871041,"cfile_cache_miss":333,"cfile_cache_miss_bytes":18977939,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":511,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":697,"drs_written":1,"lbm_read_time_us":17632,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":349,"lbm_write_time_us":17630,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":338,"num_input_rowsets":2,"peak_mem_usage":4331838,"rows_written":271500,"spinlock_wait_cycles":3584}
I20251211 09:12:15.629648 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:15.658617 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.404s user 0.287s sys 0.016s Metrics: {"bytes_written":7628384,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1098460,"cfile_cache_miss":336,"cfile_cache_miss_bytes":18855966,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":980,"drs_written":1,"lbm_read_time_us":15813,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":355,"lbm_write_time_us":16430,"lbm_writes_lt_1ms":342,"num_input_rowsets":2,"peak_mem_usage":4351012,"rows_written":273250,"spinlock_wait_cycles":2048}
I20251211 09:12:15.658998 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:15.672433 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.455s user 0.264s sys 0.032s Metrics: {"bytes_written":7579264,"cfile_cache_hit":13,"cfile_cache_hit_bytes":942925,"cfile_cache_miss":333,"cfile_cache_miss_bytes":18880003,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":180,"dirs.run_cpu_time_us":84,"dirs.run_wall_time_us":1113,"drs_written":1,"lbm_read_time_us":16059,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":360,"lbm_write_time_us":21391,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":338,"num_input_rowsets":2,"peak_mem_usage":4317128,"rows_written":271500,"thread_start_us":227,"threads_started":5}
I20251211 09:12:15.672729 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1064283 bytes of WAL
I20251211 09:12:15.673946 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:15.674041 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000009 (ops 4657-5242)
I20251211 09:12:15.675381 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.046s user 0.021s sys 0.004s Metrics: {"bytes_written":609161,"cfile_init":1,"dirs.queue_time_us":28,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1608,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":21350}
I20251211 09:12:15.678913 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1047582 bytes of WAL
I20251211 09:12:15.679030 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:15.679076 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000009 (ops 5047-5688)
I20251211 09:12:15.676254 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:15.679418 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:15.679570 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3017942 bytes on disk
I20251211 09:12:15.679632 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3221210 bytes on disk
I20251211 09:12:15.679698 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:15.680593 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:15.679801 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":35,"lbm_reads_lt_1ms":8}
I20251211 09:12:15.680749 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011738
I20251211 09:12:15.692134 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.033s user 0.026s sys 0.000s Metrics: {"bytes_written":594786,"cfile_init":1,"dirs.queue_time_us":27,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1330,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":20800}
I20251211 09:12:15.692389 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1062270 bytes of WAL
I20251211 09:12:15.692521 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:15.692593 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000009 (ops 4958-5569)
I20251211 09:12:15.692971 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:15.693324 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3236580 bytes on disk
I20251211 09:12:15.693725 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":43,"lbm_reads_lt_1ms":8}
I20251211 09:12:15.693929 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011724
I20251211 09:12:15.763248 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.081s user 0.029s sys 0.000s Metrics: {"bytes_written":665283,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":830,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7424,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":23350}
I20251211 09:12:15.763522 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1104400 bytes of WAL
I20251211 09:12:15.763653 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:15.763710 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000010 (ops 5243-5850)
I20251211 09:12:15.764118 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:15.764222 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 223298 bytes on disk
I20251211 09:12:15.764375 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:15.764506 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011719
I20251211 09:12:16.059630 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.365s user 0.287s sys 0.028s Metrics: {"bytes_written":8202215,"cfile_cache_hit":13,"cfile_cache_hit_bytes":921279,"cfile_cache_miss":363,"cfile_cache_miss_bytes":20571353,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":151,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":765,"drs_written":1,"lbm_read_time_us":11623,"lbm_reads_lt_1ms":383,"lbm_write_time_us":16114,"lbm_writes_lt_1ms":366,"num_input_rowsets":2,"peak_mem_usage":4692444,"rows_written":294050,"spinlock_wait_cycles":1152}
I20251211 09:12:16.060072 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:16.086741 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.027s user 0.014s sys 0.003s Metrics: {"bytes_written":407123,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":579,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":864,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14100}
I20251211 09:12:16.087018 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3408643 bytes on disk
I20251211 09:12:16.087404 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":145,"lbm_reads_lt_1ms":8}
I20251211 09:12:16.087738 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011730
I20251211 09:12:16.136044 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.371s user 0.298s sys 0.022s Metrics: {"bytes_written":8226849,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1354352,"cfile_cache_miss":361,"cfile_cache_miss_bytes":20190370,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":151,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":796,"drs_written":1,"lbm_read_time_us":10534,"lbm_reads_lt_1ms":381,"lbm_write_time_us":17538,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":367,"num_input_rowsets":2,"peak_mem_usage":4702893,"rows_written":294850,"spinlock_wait_cycles":2816}
I20251211 09:12:16.136392 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3284884 bytes on disk
I20251211 09:12:16.136580 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:16.137535 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:16.167001 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.029s user 0.022s sys 0.000s Metrics: {"bytes_written":479046,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":682,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":898,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16800}
I20251211 09:12:16.167284 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011695
I20251211 09:12:16.409365 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.724s user 0.284s sys 0.040s Metrics: {"bytes_written":8172975,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1850384,"cfile_cache_miss":356,"cfile_cache_miss_bytes":19550272,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":14882,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":1074,"drs_written":1,"lbm_read_time_us":23112,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":373,"lbm_write_time_us":37455,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":360,"num_input_rowsets":2,"peak_mem_usage":4672400,"rows_written":292850,"spinlock_wait_cycles":384,"thread_start_us":315,"threads_started":6}
I20251211 09:12:16.409718 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:16.459164 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.049s user 0.025s sys 0.007s Metrics: {"bytes_written":788038,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":76,"dirs.run_wall_time_us":478,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1635,"lbm_writes_lt_1ms":52,"peak_mem_usage":0,"rows_written":27600}
I20251211 09:12:16.459415 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1063689 bytes of WAL
I20251211 09:12:16.459739 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:16.459834 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000010 (ops 5689-6342)
I20251211 09:12:16.460886 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:16.461021 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3529783 bytes on disk
I20251211 09:12:16.461265 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":33,"lbm_reads_lt_1ms":8}
I20251211 09:12:16.461416 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011616
I20251211 09:12:16.496870 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.409s user 0.309s sys 0.019s Metrics: {"bytes_written":8596978,"cfile_cache_hit":11,"cfile_cache_hit_bytes":571164,"cfile_cache_miss":383,"cfile_cache_miss_bytes":21972022,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":498,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":2449,"drs_written":1,"lbm_read_time_us":11215,"lbm_reads_lt_1ms":403,"lbm_write_time_us":16554,"lbm_writes_lt_1ms":383,"num_input_rowsets":2,"peak_mem_usage":4928260,"rows_written":308150,"spinlock_wait_cycles":384}
I20251211 09:12:16.497116 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3439991 bytes on disk
I20251211 09:12:16.497731 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20251211 09:12:16.497907 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:16.525641 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.358s user 0.304s sys 0.027s Metrics: {"bytes_written":8694112,"cfile_cache_hit":12,"cfile_cache_hit_bytes":743386,"cfile_cache_miss":386,"cfile_cache_miss_bytes":22046418,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":148,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":694,"drs_written":1,"lbm_read_time_us":11292,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":409,"lbm_write_time_us":14547,"lbm_writes_lt_1ms":387,"num_input_rowsets":2,"peak_mem_usage":4982427,"rows_written":311650,"spinlock_wait_cycles":116352}
I20251211 09:12:16.525965 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:16.532429 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.034s user 0.021s sys 0.000s Metrics: {"bytes_written":413283,"cfile_init":1,"dirs.queue_time_us":26,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1504,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14350}
I20251211 09:12:16.532940 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1056800 bytes of WAL
I20251211 09:12:16.533080 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:16.533139 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000010 (ops 5570-6181)
I20251211 09:12:16.533565 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:16.533694 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 134348 bytes on disk
I20251211 09:12:16.533880 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20251211 09:12:16.534915 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011389
I20251211 09:12:16.550645 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.025s user 0.017s sys 0.000s Metrics: {"bytes_written":342384,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":481,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1494,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11950,"spinlock_wait_cycles":768}
I20251211 09:12:16.550871 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1056958 bytes of WAL
I20251211 09:12:16.550985 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:16.551095 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000011 (ops 5851-6432)
I20251211 09:12:16.551579 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:16.551697 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3591026 bytes on disk
I20251211 09:12:16.551864 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20251211 09:12:16.552275 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011375
I20251211 09:12:16.927172 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.375s user 0.316s sys 0.032s Metrics: {"bytes_written":9024718,"cfile_cache_hit":13,"cfile_cache_hit_bytes":856393,"cfile_cache_miss":397,"cfile_cache_miss_bytes":22831751,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":143,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":753,"drs_written":1,"lbm_read_time_us":10561,"lbm_reads_lt_1ms":417,"lbm_write_time_us":16185,"lbm_writes_lt_1ms":401,"num_input_rowsets":2,"peak_mem_usage":5178158,"rows_written":323600,"spinlock_wait_cycles":23552}
I20251211 09:12:16.927500 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:16.956511 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.029s user 0.024s sys 0.000s Metrics: {"bytes_written":541082,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":646,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1094,"lbm_writes_lt_1ms":43,"peak_mem_usage":0,"rows_written":18900}
I20251211 09:12:16.956780 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011235
I20251211 09:12:17.169970 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.708s user 0.318s sys 0.032s Metrics: {"bytes_written":8937673,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1343628,"cfile_cache_miss":390,"cfile_cache_miss_bytes":22079302,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":16074,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":945,"drs_written":1,"lbm_read_time_us":24880,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":407,"lbm_write_time_us":40794,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":395,"num_input_rowsets":2,"peak_mem_usage":5114608,"rows_written":320450,"spinlock_wait_cycles":1184384,"thread_start_us":658,"threads_started":6}
I20251211 09:12:17.170338 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=2.929465
I20251211 09:12:17.257344 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.087s user 0.035s sys 0.004s Metrics: {"bytes_written":934279,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":138,"dirs.run_wall_time_us":663,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3937,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":58,"peak_mem_usage":0,"rows_written":32900}
I20251211 09:12:17.258131 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1058736 bytes of WAL
I20251211 09:12:17.258293 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:17.258359 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000011 (ops 6343-6983)
I20251211 09:12:17.259061 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:17.259196 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011131
I20251211 09:12:17.336513 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.801s user 0.321s sys 0.030s Metrics: {"bytes_written":8992344,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1556092,"cfile_cache_miss":393,"cfile_cache_miss_bytes":22046200,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":4629,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":3713,"drs_written":1,"lbm_read_time_us":26594,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":409,"lbm_write_time_us":28867,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":395,"num_input_rowsets":2,"peak_mem_usage":5157883,"rows_written":322500,"spinlock_wait_cycles":1152,"thread_start_us":445,"threads_started":6}
I20251211 09:12:17.336828 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 3605368 bytes on disk
I20251211 09:12:17.336992 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20251211 09:12:17.337126 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=2.929465
I20251211 09:12:17.379247 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.422s user 0.334s sys 0.049s Metrics: {"bytes_written":9549673,"cfile_cache_hit":13,"cfile_cache_hit_bytes":911959,"cfile_cache_miss":419,"cfile_cache_miss_bytes":24153559,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":1086,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":798,"drs_written":1,"lbm_read_time_us":11792,"lbm_reads_lt_1ms":447,"lbm_write_time_us":19311,"lbm_writes_lt_1ms":424,"num_input_rowsets":2,"peak_mem_usage":5483256,"rows_written":342500,"spinlock_wait_cycles":8192}
I20251211 09:12:17.379501 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:17.392160 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.055s user 0.042s sys 0.000s Metrics: {"bytes_written":1064833,"cfile_init":1,"dirs.queue_time_us":27,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2131,"lbm_writes_lt_1ms":63,"peak_mem_usage":0,"rows_written":37600}
I20251211 09:12:17.392979 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1049954 bytes of WAL
I20251211 09:12:17.393131 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:17.393219 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000011 (ops 6182-6789)
I20251211 09:12:17.393839 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:17.393986 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 374306 bytes on disk
I20251211 09:12:17.394147 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20251211 09:12:17.394280 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.011129
I20251211 09:12:17.410032 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.030s user 0.025s sys 0.000s Metrics: {"bytes_written":540997,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":608,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3022,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":18900}
I20251211 09:12:17.410264 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1069663 bytes of WAL
I20251211 09:12:17.410416 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:17.410494 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000012 (ops 6433-7021)
I20251211 09:12:17.410986 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:17.411309 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 4014649 bytes on disk
I20251211 09:12:17.411522 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20251211 09:12:17.411700 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.010946
I20251211 09:12:17.822695 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.411s user 0.377s sys 0.024s Metrics: {"bytes_written":10071588,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1073704,"cfile_cache_miss":442,"cfile_cache_miss_bytes":25380494,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":150,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":743,"drs_written":1,"lbm_read_time_us":11559,"lbm_reads_lt_1ms":462,"lbm_write_time_us":19149,"lbm_writes_lt_1ms":447,"num_input_rowsets":2,"peak_mem_usage":5790362,"rows_written":361400,"spinlock_wait_cycles":41856}
I20251211 09:12:17.823686 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 4054183 bytes on disk
I20251211 09:12:17.824060 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20251211 09:12:17.824241 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.000000
I20251211 09:12:17.856698 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.032s user 0.014s sys 0.008s Metrics: {"bytes_written":460183,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":628,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1066,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16050}
I20251211 09:12:17.857477 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.010865
I20251211 09:12:18.021292 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.762s user 0.370s sys 0.029s Metrics: {"bytes_written":9846609,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1568720,"cfile_cache_miss":427,"cfile_cache_miss_bytes":24276560,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":13548,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":1062,"drs_written":1,"lbm_read_time_us":17726,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":454,"lbm_write_time_us":32547,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":433,"num_input_rowsets":2,"peak_mem_usage":5643889,"rows_written":353350,"spinlock_wait_cycles":1280,"thread_start_us":57,"threads_started":1}
I20251211 09:12:18.021601 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=2.929465
I20251211 09:12:18.097354 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.075s user 0.035s sys 0.001s Metrics: {"bytes_written":881649,"cfile_init":1,"dirs.queue_time_us":1149,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":1045,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1708,"lbm_writes_lt_1ms":57,"peak_mem_usage":0,"rows_written":31000}
I20251211 09:12:18.097637 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1059880 bytes of WAL
I20251211 09:12:18.098186 11648 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:18.098381 11648 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P eafe4e6d25964662a92aa9ccca728a68: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-0-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000012 (ops 6984-7617)
I20251211 09:12:18.100948 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:18.101168 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 4266356 bytes on disk
I20251211 09:12:18.101414 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":50,"lbm_reads_lt_1ms":8}
I20251211 09:12:18.101629 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.010885
I20251211 09:12:18.125319 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.731s user 0.370s sys 0.044s Metrics: {"bytes_written":10035172,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1264284,"cfile_cache_miss":435,"cfile_cache_miss_bytes":25069524,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":15433,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":14426,"drs_written":1,"lbm_read_time_us":21871,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":453,"lbm_write_time_us":39056,"lbm_writes_1-10_ms":7,"lbm_writes_lt_1ms":438,"num_input_rowsets":2,"peak_mem_usage":5750514,"rows_written":360100,"spinlock_wait_cycles":768,"thread_start_us":1176,"threads_started":6}
I20251211 09:12:18.125644 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:18.244923 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.119s user 0.037s sys 0.000s Metrics: {"bytes_written":789283,"cfile_init":1,"dirs.queue_time_us":323,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":2013,"drs_written":1,"lbm_read_time_us":29,"lbm_reads_lt_1ms":4,"lbm_write_time_us":22617,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":51,"peak_mem_usage":0,"rows_written":27650}
I20251211 09:12:18.245841 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1048641 bytes of WAL
I20251211 09:12:18.246001 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:18.246079 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000012 (ops 6790-7389)
I20251211 09:12:18.249540 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.004s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:18.249751 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 4310392 bytes on disk
I20251211 09:12:18.250502 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20251211 09:12:18.250667 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.010811
I20251211 09:12:18.409185 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.552s user 0.371s sys 0.033s Metrics: {"bytes_written":10511345,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1549255,"cfile_cache_miss":461,"cfile_cache_miss_bytes":26095187,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":33,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":729,"drs_written":1,"lbm_read_time_us":14035,"lbm_reads_lt_1ms":485,"lbm_write_time_us":22790,"lbm_writes_lt_1ms":464,"num_input_rowsets":2,"peak_mem_usage":6052354,"rows_written":377450,"spinlock_wait_cycles":1152}
I20251211 09:12:18.410085 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): 4238126 bytes on disk
I20251211 09:12:18.410318 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: UndoDeltaBlockGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20251211 09:12:18.410527 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:18.455160 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.044s user 0.027s sys 0.000s Metrics: {"bytes_written":615604,"cfile_init":1,"dirs.queue_time_us":220,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":519,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2296,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":21600}
I20251211 09:12:18.455531 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1069557 bytes of WAL
I20251211 09:12:18.455847 11800 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:18.455924 11800 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 70d5b8336bdf4227ad8e3289e9f4eb87: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-2-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000013 (ops 7022-7610)
I20251211 09:12:18.456337 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:18.456698 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.010692
I20251211 09:12:18.730958 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.627s user 0.378s sys 0.045s Metrics: {"bytes_written":10703705,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1106416,"cfile_cache_miss":470,"cfile_cache_miss_bytes":27019310,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":21297,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":767,"drs_written":1,"lbm_read_time_us":16209,"lbm_reads_lt_1ms":490,"lbm_write_time_us":29655,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":471,"num_input_rowsets":2,"peak_mem_usage":6149509,"rows_written":384350,"spinlock_wait_cycles":683392,"thread_start_us":268,"threads_started":6}
I20251211 09:12:18.731336 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
I20251211 09:12:18.772929 11648 maintenance_manager.cc:643] P eafe4e6d25964662a92aa9ccca728a68: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.041s user 0.030s sys 0.000s Metrics: {"bytes_written":717466,"cfile_init":1,"dirs.queue_time_us":455,"dirs.run_cpu_time_us":219,"dirs.run_wall_time_us":690,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1490,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":25200}
I20251211 09:12:18.773177 11708 maintenance_manager.cc:419] P eafe4e6d25964662a92aa9ccca728a68: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.010582
I20251211 09:12:18.781702 479 test_util.cc:276] Using random seed: -1968239101
I20251211 09:12:18.788179 479 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
F20251211 09:12:18.867202 12071 test_workload.cc:305] Already present: key already present
*** Check failure stack trace: ***
F20251211 09:12:18.868261 12069 test_workload.cc:305] Already present: key already present
*** Check failure stack trace: ***
*** Aborted at 1765444338 (unix time) try "date -d @1765444338" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e8000001df) received by PID 479 (TID 0x7f9201a88700) from PID 479; stack trace: ***
@ 0x7f9256e52980 (unknown) at ??:0
I20251211 09:12:19.003762 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.753s user 0.393s sys 0.046s Metrics: {"bytes_written":10797941,"cfile_cache_hit":13,"cfile_cache_hit_bytes":933615,"cfile_cache_miss":473,"cfile_cache_miss_bytes":27456105,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":13377,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":754,"drs_written":1,"lbm_read_time_us":20708,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":490,"lbm_write_time_us":40852,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":471,"num_input_rowsets":2,"peak_mem_usage":6208110,"rows_written":387750,"spinlock_wait_cycles":768,"thread_start_us":336,"threads_started":6}
I20251211 09:12:19.003963 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=2.929465
@ 0x7f9255101fb7 gsignal at ??:0
I20251211 09:12:19.058912 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.054s user 0.027s sys 0.006s Metrics: {"bytes_written":811084,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":872,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1751,"lbm_writes_lt_1ms":54,"peak_mem_usage":0,"rows_written":28497}
I20251211 09:12:19.059401 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): free 1064500 bytes of WAL
I20251211 09:12:19.059612 11724 log_reader.cc:385] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe: removed 1 log segments from log reader
I20251211 09:12:19.060372 11724 log.cc:1079] T 4ef1e2c2a06546419b8ab0f8bd9b7ffe P 62e0aeab56d74ab394482e46bc7e5376: Deleting log segment in path: /tmp/dist-test-task5b5_5A/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1765444027994158-479-0/minicluster-data/ts-1-root/wals/4ef1e2c2a06546419b8ab0f8bd9b7ffe/wal-000000013 (ops 7390-7996)
I20251211 09:12:19.060842 11724 maintenance_manager.cc:643] P 62e0aeab56d74ab394482e46bc7e5376: LogGCOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20251211 09:12:19.060993 11785 maintenance_manager.cc:419] P 62e0aeab56d74ab394482e46bc7e5376: Scheduling CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.010515
@ 0x7f9255103921 abort at ??:0
@ 0x7f9255f6adcd google::LogMessage::Fail() at ??:0
@ 0x7f9255f6eb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f9255f6a7cc google::LogMessage::Flush() at ??:0
@ 0x7f9255f6bf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f92577b3778 kudu::TestWorkload::GetNumberOfErrors() at ??:0
@ 0x7f92577b65dc kudu::TestWorkload::WriteThread() at ??:0
@ 0x7f92557896df (unknown) at ??:0
@ 0x7f9256e476db start_thread at ??:0
I20251211 09:12:19.162652 11800 maintenance_manager.cc:643] P 70d5b8336bdf4227ad8e3289e9f4eb87: CompactRowSetsOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe) complete. Timing: real 0.706s user 0.423s sys 0.026s Metrics: {"bytes_written":11112276,"cfile_cache_hit":12,"cfile_cache_hit_bytes":754712,"cfile_cache_miss":486,"cfile_cache_miss_bytes":28457658,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1114,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":8894,"drs_written":1,"lbm_read_time_us":23529,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":508,"lbm_write_time_us":29581,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":489,"num_input_rowsets":2,"peak_mem_usage":6397778,"rows_written":399050,"spinlock_wait_cycles":2432,"thread_start_us":2459,"threads_started":6}
I20251211 09:12:19.163741 11860 maintenance_manager.cc:419] P 70d5b8336bdf4227ad8e3289e9f4eb87: Scheduling FlushMRSOp(4ef1e2c2a06546419b8ab0f8bd9b7ffe): perf score=1.937278
@ 0x7f92551e471f clone at ??:0