[==========] Running 26 tests from 5 test suites.
[----------] Global test environment set-up.
[----------] 12 tests from ScanTokenTest
[ RUN ] ScanTokenTest.SlowScansListTest
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260926 13:54:50.589689 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:34379
I20260926 13:54:50.591111 3582 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260926 13:54:50.592088 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:50.607187 3591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:50.607630 3589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:50.608882 3582 server_base.cc:1061] running on GCE node
W20260926 13:54:50.607887 3588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:51.710671 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:51.710896 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:51.711043 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430891711028 us; error 0 us; skew 500 ppm
I20260926 13:54:51.711794 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:51.718981 3582 webserver.cc:533] Webserver started at http://127.3.127.190:42521/ using document root <none> and password file <none>
I20260926 13:54:51.719733 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:51.719909 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:51.720279 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:51.725793 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "f97967663fae4b489bbd73398d2e66bc"
format_stamp: "Formatted at 2026-09-26 13:54:51 on dist-test-slave-fk7n"
I20260926 13:54:51.733024 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260926 13:54:51.737679 3597 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:51.738709 3582 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260926 13:54:51.739006 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "f97967663fae4b489bbd73398d2e66bc"
format_stamp: "Formatted at 2026-09-26 13:54:51 on dist-test-slave-fk7n"
I20260926 13:54:51.739302 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:51.807894 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:51.809381 3582 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260926 13:54:51.809798 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:51.875027 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:34379
I20260926 13:54:51.875101 3648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:34379 every 8 connection(s)
I20260926 13:54:51.882298 3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:51.902473 3649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc: Bootstrap starting.
I20260926 13:54:51.907964 3649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:51.909592 3649 log.cc:826] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc: Log is configured to *not* fsync() on all Append() calls
I20260926 13:54:51.913646 3649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc: No bootstrap required, opened a new log
I20260926 13:54:51.932880 3649 raft_consensus.cc:359] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f97967663fae4b489bbd73398d2e66bc" member_type: VOTER }
I20260926 13:54:51.933369 3649 raft_consensus.cc:385] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:51.933568 3649 raft_consensus.cc:740] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97967663fae4b489bbd73398d2e66bc, State: Initialized, Role: FOLLOWER
I20260926 13:54:51.934312 3649 consensus_queue.cc:260] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f97967663fae4b489bbd73398d2e66bc" member_type: VOTER }
I20260926 13:54:51.934751 3649 raft_consensus.cc:399] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:51.934986 3649 raft_consensus.cc:493] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:51.935258 3649 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:51.939011 3649 raft_consensus.cc:515] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f97967663fae4b489bbd73398d2e66bc" member_type: VOTER }
I20260926 13:54:51.939603 3649 leader_election.cc:304] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f97967663fae4b489bbd73398d2e66bc; no voters:
I20260926 13:54:51.941198 3649 leader_election.cc:290] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:51.941493 3652 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:51.943738 3652 raft_consensus.cc:697] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 1 LEADER]: Becoming Leader. State: Replica: f97967663fae4b489bbd73398d2e66bc, State: Running, Role: LEADER
I20260926 13:54:51.944562 3652 consensus_queue.cc:237] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f97967663fae4b489bbd73398d2e66bc" member_type: VOTER }
I20260926 13:54:51.945542 3649 sys_catalog.cc:565] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:54:51.954365 3653 sys_catalog.cc:455] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f97967663fae4b489bbd73398d2e66bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f97967663fae4b489bbd73398d2e66bc" member_type: VOTER } }
I20260926 13:54:51.954416 3654 sys_catalog.cc:455] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f97967663fae4b489bbd73398d2e66bc. Latest consensus state: current_term: 1 leader_uuid: "f97967663fae4b489bbd73398d2e66bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f97967663fae4b489bbd73398d2e66bc" member_type: VOTER } }
I20260926 13:54:51.955029 3653 sys_catalog.cc:458] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:51.955057 3654 sys_catalog.cc:458] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:51.957756 3661 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:54:51.968957 3661 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:54:51.970582 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:54:51.983304 3661 catalog_manager.cc:1396] Generated new cluster ID: 5253f438bd7e406e975b054dc6e3af3e
I20260926 13:54:51.983589 3661 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:54:52.010456 3661 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:54:52.012297 3661 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:54:52.029204 3661 catalog_manager.cc:6219] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc: Generated new TSK 0
I20260926 13:54:52.029965 3661 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:54:52.037127 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:52.045675 3671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:52.046799 3672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:52.050180 3674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:52.050307 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:52.051045 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:52.051232 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:52.051389 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430892051374 us; error 0 us; skew 500 ppm
I20260926 13:54:52.051944 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:52.055372 3582 webserver.cc:533] Webserver started at http://127.3.127.129:42599/ using document root <none> and password file <none>
I20260926 13:54:52.055866 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:52.056037 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:52.056279 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:52.057351 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "dc5c35396fea479d9bf2da9540918505"
format_stamp: "Formatted at 2026-09-26 13:54:52 on dist-test-slave-fk7n"
I20260926 13:54:52.062695 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260926 13:54:52.066998 3679 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:52.067727 3582 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260926 13:54:52.067983 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "dc5c35396fea479d9bf2da9540918505"
format_stamp: "Formatted at 2026-09-26 13:54:52 on dist-test-slave-fk7n"
I20260926 13:54:52.068234 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.SlowScansListTest.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:52.103916 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:52.105157 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:52.107537 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:54:52.111289 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:54:52.111495 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:52.111742 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:54:52.111894 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:52.200371 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:40873
I20260926 13:54:52.200541 3741 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:40873 every 8 connection(s)
I20260926 13:54:52.227110 3742 heartbeater.cc:344] Connected to a master server at 127.3.127.190:34379
I20260926 13:54:52.227603 3742 heartbeater.cc:461] Registering TS with master...
I20260926 13:54:52.228740 3742 heartbeater.cc:507] Master 127.3.127.190:34379 requested a full tablet report, sending...
I20260926 13:54:52.231913 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.026669929s
I20260926 13:54:52.231911 3614 ts_manager.cc:194] Registered new tserver with Master: dc5c35396fea479d9bf2da9540918505 (127.3.127.129:40873)
I20260926 13:54:52.234926 3614 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34968
I20260926 13:54:52.262164 3614 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34976:
name: "slow_scans_show"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
I20260926 13:54:52.315476 3707 tablet_service.cc:1511] Processing CreateTablet for tablet 3e515955eab842a4bfed8b404494fe76 (DEFAULT_TABLE table=slow_scans_show [id=6427794728514c22bcaa2eac1e0f0309]), partition=
I20260926 13:54:52.316636 3707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e515955eab842a4bfed8b404494fe76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:52.328215 3754 tablet_bootstrap.cc:492] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505: Bootstrap starting.
I20260926 13:54:52.333068 3754 tablet_bootstrap.cc:654] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:52.337942 3754 tablet_bootstrap.cc:492] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505: No bootstrap required, opened a new log
I20260926 13:54:52.338297 3754 ts_tablet_manager.cc:1403] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:54:52.340309 3754 raft_consensus.cc:359] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5c35396fea479d9bf2da9540918505" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40873 } }
I20260926 13:54:52.340705 3754 raft_consensus.cc:385] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:52.340946 3754 raft_consensus.cc:740] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc5c35396fea479d9bf2da9540918505, State: Initialized, Role: FOLLOWER
I20260926 13:54:52.341459 3754 consensus_queue.cc:260] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5c35396fea479d9bf2da9540918505" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40873 } }
I20260926 13:54:52.341897 3754 raft_consensus.cc:399] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:52.342106 3754 raft_consensus.cc:493] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:52.342341 3754 raft_consensus.cc:3060] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:52.346170 3754 raft_consensus.cc:515] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5c35396fea479d9bf2da9540918505" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40873 } }
I20260926 13:54:52.346673 3754 leader_election.cc:304] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc5c35396fea479d9bf2da9540918505; no voters:
I20260926 13:54:52.348680 3754 leader_election.cc:290] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:52.349135 3756 raft_consensus.cc:2804] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:52.351613 3742 heartbeater.cc:499] Master 127.3.127.190:34379 was elected leader, sending a full tablet report...
I20260926 13:54:52.351969 3754 ts_tablet_manager.cc:1434] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
I20260926 13:54:52.352705 3756 raft_consensus.cc:697] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 1 LEADER]: Becoming Leader. State: Replica: dc5c35396fea479d9bf2da9540918505, State: Running, Role: LEADER
I20260926 13:54:52.353417 3756 consensus_queue.cc:237] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5c35396fea479d9bf2da9540918505" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40873 } }
I20260926 13:54:52.364603 3613 catalog_manager.cc:5838] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc5c35396fea479d9bf2da9540918505 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "dc5c35396fea479d9bf2da9540918505" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc5c35396fea479d9bf2da9540918505" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40873 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:52.800522 3582 scanners.cc:360] slow scan reporting is disabled: set --show_slow_scans to enable
I20260926 13:54:52.801213 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:54:52.816104 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:54:52.816933 3582 tablet_replica.cc:333] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505: stopping tablet replica
I20260926 13:54:52.817588 3582 raft_consensus.cc:2243] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:52.818136 3582 raft_consensus.cc:2272] T 3e515955eab842a4bfed8b404494fe76 P dc5c35396fea479d9bf2da9540918505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:52.969494 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:54:52.977777 3582 master.cc:562] Master@127.3.127.190:34379 shutting down...
I20260926 13:54:53.080368 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:53.080883 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:53.081183 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P f97967663fae4b489bbd73398d2e66bc: stopping tablet replica
I20260926 13:54:53.098742 3582 master.cc:584] Master@127.3.127.190:34379 shutdown complete.
[ OK ] ScanTokenTest.SlowScansListTest (2530 ms)
[ RUN ] ScanTokenTest.TestScanTokens
I20260926 13:54:53.118117 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:34435
I20260926 13:54:53.119069 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:53.123524 3784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:53.123989 3785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:53.126484 3787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:53.126890 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:53.127748 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:53.127985 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:53.128134 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430893128118 us; error 0 us; skew 500 ppm
I20260926 13:54:53.128592 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:53.131017 3582 webserver.cc:533] Webserver started at http://127.3.127.190:43075/ using document root <none> and password file <none>
I20260926 13:54:53.131404 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:53.131561 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:53.131781 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:53.132686 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "7a3dbc8910984b129bab94781dbd62b9"
format_stamp: "Formatted at 2026-09-26 13:54:53 on dist-test-slave-fk7n"
I20260926 13:54:53.136863 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260926 13:54:53.139918 3792 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:53.140625 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:54:53.140885 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "7a3dbc8910984b129bab94781dbd62b9"
format_stamp: "Formatted at 2026-09-26 13:54:53 on dist-test-slave-fk7n"
I20260926 13:54:53.141120 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:53.153245 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:53.154067 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:53.202260 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:34435
I20260926 13:54:53.202512 3843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:34435 every 8 connection(s)
I20260926 13:54:53.206590 3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.218621 3844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9: Bootstrap starting.
I20260926 13:54:53.222340 3844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.225819 3844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9: No bootstrap required, opened a new log
I20260926 13:54:53.227523 3844 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a3dbc8910984b129bab94781dbd62b9" member_type: VOTER }
I20260926 13:54:53.227881 3844 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.228082 3844 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3dbc8910984b129bab94781dbd62b9, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.228582 3844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a3dbc8910984b129bab94781dbd62b9" member_type: VOTER }
I20260926 13:54:53.229055 3844 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.229271 3844 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.229511 3844 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.232999 3844 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a3dbc8910984b129bab94781dbd62b9" member_type: VOTER }
I20260926 13:54:53.233446 3844 leader_election.cc:304] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a3dbc8910984b129bab94781dbd62b9; no voters:
I20260926 13:54:53.234527 3844 leader_election.cc:290] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.234838 3847 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.236289 3847 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 1 LEADER]: Becoming Leader. State: Replica: 7a3dbc8910984b129bab94781dbd62b9, State: Running, Role: LEADER
I20260926 13:54:53.237216 3844 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:54:53.236991 3847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a3dbc8910984b129bab94781dbd62b9" member_type: VOTER }
I20260926 13:54:53.239636 3848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a3dbc8910984b129bab94781dbd62b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a3dbc8910984b129bab94781dbd62b9" member_type: VOTER } }
I20260926 13:54:53.240110 3848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:53.249260 3849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a3dbc8910984b129bab94781dbd62b9. Latest consensus state: current_term: 1 leader_uuid: "7a3dbc8910984b129bab94781dbd62b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a3dbc8910984b129bab94781dbd62b9" member_type: VOTER } }
I20260926 13:54:53.249581 3852 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:54:53.249891 3849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:53.256892 3852 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:54:53.258251 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:54:53.266172 3852 catalog_manager.cc:1396] Generated new cluster ID: 9af28b7005844778bf728cbe722b55bf
I20260926 13:54:53.266429 3852 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:54:53.306279 3852 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:54:53.307363 3852 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:54:53.324270 3852 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9: Generated new TSK 0
I20260926 13:54:53.324723 3852 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:54:53.388216 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:53.393698 3866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:53.394871 3867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:53.397161 3869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:53.397889 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:53.398572 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:53.398773 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:53.398916 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430893398899 us; error 0 us; skew 500 ppm
I20260926 13:54:53.399356 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:53.401741 3582 webserver.cc:533] Webserver started at http://127.3.127.129:41319/ using document root <none> and password file <none>
I20260926 13:54:53.402130 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:53.402297 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:53.402585 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:53.403563 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "4153223657254bf29cb23b2ab7e003cc"
format_stamp: "Formatted at 2026-09-26 13:54:53 on dist-test-slave-fk7n"
I20260926 13:54:53.407733 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:54:53.410712 3874 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:53.411458 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:54:53.411761 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "4153223657254bf29cb23b2ab7e003cc"
format_stamp: "Formatted at 2026-09-26 13:54:53 on dist-test-slave-fk7n"
I20260926 13:54:53.412082 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:53.431283 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:53.432483 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:53.434156 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:54:53.436962 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:54:53.437199 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:53.437474 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:54:53.437673 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:53.481123 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:36433
I20260926 13:54:53.481170 3936 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:36433 every 8 connection(s)
I20260926 13:54:53.501307 3937 heartbeater.cc:344] Connected to a master server at 127.3.127.190:34435
I20260926 13:54:53.501636 3937 heartbeater.cc:461] Registering TS with master...
I20260926 13:54:53.502229 3937 heartbeater.cc:507] Master 127.3.127.190:34435 requested a full tablet report, sending...
I20260926 13:54:53.504051 3809 ts_manager.cc:194] Registered new tserver with Master: 4153223657254bf29cb23b2ab7e003cc (127.3.127.129:36433)
I20260926 13:54:53.504841 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.013677928s
I20260926 13:54:53.505741 3809 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42970
I20260926 13:54:53.527621 3809 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42978:
name: "table"
schema {
columns {
name: "col"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\000\000\000\000\000\000\000""\004\001\000\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
hash_schema {
columns {
name: "col"
}
num_buckets: 4
seed: 0
}
}
I20260926 13:54:53.575098 3902 tablet_service.cc:1511] Processing CreateTablet for tablet 6a34d4a9d88b4a51b0f670ac37a1f4f7 (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION VALUES < 0
I20260926 13:54:53.575385 3901 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd4359d3fc84f898afddb00dd042c2f (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 0 <= VALUES
I20260926 13:54:53.576411 3902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a34d4a9d88b4a51b0f670ac37a1f4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.577404 3896 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5aa7333ff840c1aa2b00e108b7bae3 (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 3, RANGE (col) PARTITION VALUES < 0
I20260926 13:54:53.577567 3895 tablet_service.cc:1511] Processing CreateTablet for tablet d60940e43e5b48e1aacdc6d67c24eb42 (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 3, RANGE (col) PARTITION 0 <= VALUES
I20260926 13:54:53.578537 3896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5aa7333ff840c1aa2b00e108b7bae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.579039 3895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60940e43e5b48e1aacdc6d67c24eb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.580226 3897 tablet_service.cc:1511] Processing CreateTablet for tablet 2d320ae7a27b4d6e85e0835dc76ed2ba (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 2, RANGE (col) PARTITION 0 <= VALUES
I20260926 13:54:53.581393 3897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d320ae7a27b4d6e85e0835dc76ed2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.585726 3898 tablet_service.cc:1511] Processing CreateTablet for tablet 0613b8c13834478fb9c11e589b66a00e (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 2, RANGE (col) PARTITION VALUES < 0
I20260926 13:54:53.586886 3898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0613b8c13834478fb9c11e589b66a00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.589661 3899 tablet_service.cc:1511] Processing CreateTablet for tablet b76fbdfb4c044f1eb5992d038c2b69f5 (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 0 <= VALUES
I20260926 13:54:53.590780 3899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76fbdfb4c044f1eb5992d038c2b69f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.593684 3900 tablet_service.cc:1511] Processing CreateTablet for tablet d0237ad455e349e785d178a14d0b3203 (DEFAULT_TABLE table=table [id=ba87937a3ec64636a31faaddb9e2ac4e]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION VALUES < 0
I20260926 13:54:53.594821 3900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0237ad455e349e785d178a14d0b3203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.597023 3901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd4359d3fc84f898afddb00dd042c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:53.634739 3949 tablet_bootstrap.cc:492] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.638939 3949 tablet_bootstrap.cc:654] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.642966 3949 tablet_bootstrap.cc:492] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.643253 3949 ts_tablet_manager.cc:1403] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260926 13:54:53.645023 3949 raft_consensus.cc:359] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.645387 3949 raft_consensus.cc:385] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.645587 3949 raft_consensus.cc:740] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.646061 3949 consensus_queue.cc:260] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.646476 3949 raft_consensus.cc:399] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.646688 3949 raft_consensus.cc:493] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.646919 3949 raft_consensus.cc:3060] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.650612 3949 raft_consensus.cc:515] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.651085 3949 leader_election.cc:304] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.652186 3949 leader_election.cc:290] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.652612 3951 raft_consensus.cc:2804] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.653849 3937 heartbeater.cc:499] Master 127.3.127.190:34435 was elected leader, sending a full tablet report...
I20260926 13:54:53.654390 3949 ts_tablet_manager.cc:1434] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260926 13:54:53.655261 3949 tablet_bootstrap.cc:492] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.655197 3951 raft_consensus.cc:697] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.655884 3951 consensus_queue.cc:237] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.660324 3949 tablet_bootstrap.cc:654] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.670360 3809 catalog_manager.cc:5838] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:53.688854 3949 tablet_bootstrap.cc:492] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.689234 3949 ts_tablet_manager.cc:1403] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.034s user 0.013s sys 0.020s
I20260926 13:54:53.691066 3949 raft_consensus.cc:359] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.691435 3949 raft_consensus.cc:385] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.691664 3949 raft_consensus.cc:740] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.692292 3949 consensus_queue.cc:260] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.692836 3949 raft_consensus.cc:399] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.693059 3949 raft_consensus.cc:493] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.693305 3949 raft_consensus.cc:3060] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.697260 3949 raft_consensus.cc:515] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.697741 3949 leader_election.cc:304] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.698185 3949 leader_election.cc:290] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.698452 3953 raft_consensus.cc:2804] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.698886 3953 raft_consensus.cc:697] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.699554 3949 ts_tablet_manager.cc:1434] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:54:53.699478 3953 consensus_queue.cc:237] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.700208 3949 tablet_bootstrap.cc:492] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.705437 3809 catalog_manager.cc:5838] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:53.706238 3949 tablet_bootstrap.cc:654] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.711563 3949 tablet_bootstrap.cc:492] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.711920 3949 ts_tablet_manager.cc:1403] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260926 13:54:53.714085 3949 raft_consensus.cc:359] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.714501 3949 raft_consensus.cc:385] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.714727 3949 raft_consensus.cc:740] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.715255 3949 consensus_queue.cc:260] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.715724 3949 raft_consensus.cc:399] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.715962 3949 raft_consensus.cc:493] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.716228 3949 raft_consensus.cc:3060] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.725940 3949 raft_consensus.cc:515] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.726485 3949 leader_election.cc:304] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.727020 3949 leader_election.cc:290] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.727164 3953 raft_consensus.cc:2804] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.727622 3953 raft_consensus.cc:697] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.728438 3949 ts_tablet_manager.cc:1434] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.016s user 0.007s sys 0.004s
I20260926 13:54:53.728240 3953 consensus_queue.cc:237] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.729095 3949 tablet_bootstrap.cc:492] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.734072 3809 catalog_manager.cc:5838] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:53.735443 3949 tablet_bootstrap.cc:654] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.740159 3949 tablet_bootstrap.cc:492] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.740517 3949 ts_tablet_manager.cc:1403] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260926 13:54:53.742846 3949 raft_consensus.cc:359] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.743319 3949 raft_consensus.cc:385] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.743496 3949 raft_consensus.cc:740] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.743958 3949 consensus_queue.cc:260] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.744338 3949 raft_consensus.cc:399] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.744601 3949 raft_consensus.cc:493] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.744930 3949 raft_consensus.cc:3060] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.750085 3949 raft_consensus.cc:515] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.750605 3949 leader_election.cc:304] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.751057 3949 leader_election.cc:290] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.751199 3953 raft_consensus.cc:2804] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.751753 3953 raft_consensus.cc:697] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.752568 3949 ts_tablet_manager.cc:1434] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.012s user 0.005s sys 0.003s
I20260926 13:54:53.752424 3953 consensus_queue.cc:237] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.753424 3949 tablet_bootstrap.cc:492] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.758728 3809 catalog_manager.cc:5838] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:53.760362 3949 tablet_bootstrap.cc:654] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.764931 3949 tablet_bootstrap.cc:492] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.765326 3949 ts_tablet_manager.cc:1403] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.005s
I20260926 13:54:53.767918 3949 raft_consensus.cc:359] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.768435 3949 raft_consensus.cc:385] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.768708 3949 raft_consensus.cc:740] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.769454 3949 consensus_queue.cc:260] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.770068 3949 raft_consensus.cc:399] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.770367 3949 raft_consensus.cc:493] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.770694 3949 raft_consensus.cc:3060] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.777366 3949 raft_consensus.cc:515] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.778004 3949 leader_election.cc:304] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.778599 3949 leader_election.cc:290] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.778731 3953 raft_consensus.cc:2804] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.779145 3953 raft_consensus.cc:697] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.779717 3953 consensus_queue.cc:237] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.780465 3949 ts_tablet_manager.cc:1434] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260926 13:54:53.781322 3949 tablet_bootstrap.cc:492] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.784842 3809 catalog_manager.cc:5838] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:53.787175 3949 tablet_bootstrap.cc:654] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.791344 3949 tablet_bootstrap.cc:492] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.791678 3949 ts_tablet_manager.cc:1403] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260926 13:54:53.793768 3949 raft_consensus.cc:359] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.794127 3949 raft_consensus.cc:385] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.794365 3949 raft_consensus.cc:740] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.794879 3949 consensus_queue.cc:260] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.795279 3949 raft_consensus.cc:399] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.795481 3949 raft_consensus.cc:493] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.795756 3949 raft_consensus.cc:3060] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.800274 3949 raft_consensus.cc:515] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.800874 3949 leader_election.cc:304] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.801260 3949 leader_election.cc:290] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.801394 3953 raft_consensus.cc:2804] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.801816 3953 raft_consensus.cc:697] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.802682 3949 ts_tablet_manager.cc:1434] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260926 13:54:53.802459 3953 consensus_queue.cc:237] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.803423 3949 tablet_bootstrap.cc:492] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.809401 3949 tablet_bootstrap.cc:654] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.809196 3809 catalog_manager.cc:5838] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:53.815428 3949 tablet_bootstrap.cc:492] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.815721 3949 ts_tablet_manager.cc:1403] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260926 13:54:53.818225 3949 raft_consensus.cc:359] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.818709 3949 raft_consensus.cc:385] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.819008 3949 raft_consensus.cc:740] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.819675 3949 consensus_queue.cc:260] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.820197 3949 raft_consensus.cc:399] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.820448 3949 raft_consensus.cc:493] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.820740 3949 raft_consensus.cc:3060] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.825537 3949 raft_consensus.cc:515] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.826021 3949 leader_election.cc:304] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.826429 3949 leader_election.cc:290] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.826588 3953 raft_consensus.cc:2804] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.827046 3953 raft_consensus.cc:697] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.827788 3949 ts_tablet_manager.cc:1434] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260926 13:54:53.827698 3953 consensus_queue.cc:237] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.828452 3949 tablet_bootstrap.cc:492] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc: Bootstrap starting.
I20260926 13:54:53.833621 3949 tablet_bootstrap.cc:654] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:53.836153 3808 catalog_manager.cc:5838] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:53.837905 3949 tablet_bootstrap.cc:492] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc: No bootstrap required, opened a new log
I20260926 13:54:53.838187 3949 ts_tablet_manager.cc:1403] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:54:53.840361 3949 raft_consensus.cc:359] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.840704 3949 raft_consensus.cc:385] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:53.840932 3949 raft_consensus.cc:740] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Initialized, Role: FOLLOWER
I20260926 13:54:53.841392 3949 consensus_queue.cc:260] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.841912 3949 raft_consensus.cc:399] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:53.842154 3949 raft_consensus.cc:493] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:53.842403 3949 raft_consensus.cc:3060] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:53.847072 3949 raft_consensus.cc:515] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.847504 3949 leader_election.cc:304] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4153223657254bf29cb23b2ab7e003cc; no voters:
I20260926 13:54:53.847929 3949 leader_election.cc:290] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:53.848057 3953 raft_consensus.cc:2804] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:53.848937 3953 raft_consensus.cc:697] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Becoming Leader. State: Replica: 4153223657254bf29cb23b2ab7e003cc, State: Running, Role: LEADER
I20260926 13:54:53.849342 3949 ts_tablet_manager.cc:1434] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260926 13:54:53.849673 3953 consensus_queue.cc:237] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } }
I20260926 13:54:53.856074 3808 catalog_manager.cc:5838] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4153223657254bf29cb23b2ab7e003cc (127.3.127.129). New cstate: current_term: 1 leader_uuid: "4153223657254bf29cb23b2ab7e003cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4153223657254bf29cb23b2ab7e003cc" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 36433 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:56.038880 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:54:56.058899 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:54:56.059551 3582 tablet_replica.cc:333] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.060241 3582 raft_consensus.cc:2243] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.060813 3582 raft_consensus.cc:2272] T 2d320ae7a27b4d6e85e0835dc76ed2ba P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.062875 3582 tablet_replica.cc:333] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.063539 3582 raft_consensus.cc:2243] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.064018 3582 raft_consensus.cc:2272] T 6a34d4a9d88b4a51b0f670ac37a1f4f7 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.065943 3582 tablet_replica.cc:333] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.066584 3582 raft_consensus.cc:2243] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.067049 3582 raft_consensus.cc:2272] T b76fbdfb4c044f1eb5992d038c2b69f5 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.068909 3582 tablet_replica.cc:333] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.069537 3582 raft_consensus.cc:2243] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.069996 3582 raft_consensus.cc:2272] T 0613b8c13834478fb9c11e589b66a00e P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.071794 3582 tablet_replica.cc:333] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.072386 3582 raft_consensus.cc:2243] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.072883 3582 raft_consensus.cc:2272] T 0b5aa7333ff840c1aa2b00e108b7bae3 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.074663 3582 tablet_replica.cc:333] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.075250 3582 raft_consensus.cc:2243] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.075711 3582 raft_consensus.cc:2272] T 0bd4359d3fc84f898afddb00dd042c2f P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.077584 3582 tablet_replica.cc:333] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.078137 3582 raft_consensus.cc:2243] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.078593 3582 raft_consensus.cc:2272] T d0237ad455e349e785d178a14d0b3203 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.080368 3582 tablet_replica.cc:333] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc: stopping tablet replica
I20260926 13:54:56.080930 3582 raft_consensus.cc:2243] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.081377 3582 raft_consensus.cc:2272] T d60940e43e5b48e1aacdc6d67c24eb42 P 4153223657254bf29cb23b2ab7e003cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.108958 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:54:56.120278 3582 master.cc:562] Master@127.3.127.190:34435 shutting down...
I20260926 13:54:56.133736 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.134161 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.134436 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7a3dbc8910984b129bab94781dbd62b9: stopping tablet replica
I20260926 13:54:56.153857 3582 master.cc:584] Master@127.3.127.190:34435 shutdown complete.
[ OK ] ScanTokenTest.TestScanTokens (3066 ms)
[ RUN ] ScanTokenTest.TestScanTokens_NonUniquePrimaryKey
I20260926 13:54:56.185801 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:39923
I20260926 13:54:56.187060 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:56.192497 4339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:56.193300 4338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:56.196178 4341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:56.196277 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:56.197247 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:56.197420 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:56.197582 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430896197566 us; error 0 us; skew 500 ppm
I20260926 13:54:56.198046 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:56.200466 3582 webserver.cc:533] Webserver started at http://127.3.127.190:39047/ using document root <none> and password file <none>
I20260926 13:54:56.200903 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:56.201076 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:56.201304 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:56.202255 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "8929ffca383b4fef99dccdd16c3d04c1"
format_stamp: "Formatted at 2026-09-26 13:54:56 on dist-test-slave-fk7n"
I20260926 13:54:56.206323 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:54:56.209352 4346 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.210084 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:54:56.210403 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "8929ffca383b4fef99dccdd16c3d04c1"
format_stamp: "Formatted at 2026-09-26 13:54:56 on dist-test-slave-fk7n"
I20260926 13:54:56.210738 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:56.237352 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:56.238606 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:56.280316 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:39923
I20260926 13:54:56.280375 4397 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:39923 every 8 connection(s)
I20260926 13:54:56.284849 4398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:56.293349 4398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1: Bootstrap starting.
I20260926 13:54:56.297115 4398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:56.300571 4398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1: No bootstrap required, opened a new log
I20260926 13:54:56.302286 4398 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8929ffca383b4fef99dccdd16c3d04c1" member_type: VOTER }
I20260926 13:54:56.302631 4398 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:56.302841 4398 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8929ffca383b4fef99dccdd16c3d04c1, State: Initialized, Role: FOLLOWER
I20260926 13:54:56.303310 4398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8929ffca383b4fef99dccdd16c3d04c1" member_type: VOTER }
I20260926 13:54:56.303711 4398 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:56.303915 4398 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:56.304152 4398 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:56.307703 4398 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8929ffca383b4fef99dccdd16c3d04c1" member_type: VOTER }
I20260926 13:54:56.308175 4398 leader_election.cc:304] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8929ffca383b4fef99dccdd16c3d04c1; no voters:
I20260926 13:54:56.309360 4398 leader_election.cc:290] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:56.309616 4401 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:56.311313 4401 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 1 LEADER]: Becoming Leader. State: Replica: 8929ffca383b4fef99dccdd16c3d04c1, State: Running, Role: LEADER
I20260926 13:54:56.311995 4401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8929ffca383b4fef99dccdd16c3d04c1" member_type: VOTER }
I20260926 13:54:56.312419 4398 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:54:56.314834 4402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8929ffca383b4fef99dccdd16c3d04c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8929ffca383b4fef99dccdd16c3d04c1" member_type: VOTER } }
I20260926 13:54:56.315450 4402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:56.314898 4403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8929ffca383b4fef99dccdd16c3d04c1. Latest consensus state: current_term: 1 leader_uuid: "8929ffca383b4fef99dccdd16c3d04c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8929ffca383b4fef99dccdd16c3d04c1" member_type: VOTER } }
I20260926 13:54:56.316570 4403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:56.319655 4406 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:54:56.326315 4406 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:54:56.328799 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:54:56.335542 4406 catalog_manager.cc:1396] Generated new cluster ID: eda293091e014200a88b1377620dc6c4
I20260926 13:54:56.335808 4406 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:54:56.366221 4406 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:54:56.367262 4406 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:54:56.398319 4406 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1: Generated new TSK 0
I20260926 13:54:56.398799 4406 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:54:56.459074 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:56.465375 4419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:56.466331 4420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:56.468914 4422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:56.469029 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:56.469998 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:56.470228 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:56.470399 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430896470385 us; error 0 us; skew 500 ppm
I20260926 13:54:56.471015 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:56.473409 3582 webserver.cc:533] Webserver started at http://127.3.127.129:40781/ using document root <none> and password file <none>
I20260926 13:54:56.473961 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:56.474175 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:56.474455 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:56.475744 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "615d67be44904603abff11f2a5632cab"
format_stamp: "Formatted at 2026-09-26 13:54:56 on dist-test-slave-fk7n"
I20260926 13:54:56.481093 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260926 13:54:56.484719 4427 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.485491 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260926 13:54:56.485782 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "615d67be44904603abff11f2a5632cab"
format_stamp: "Formatted at 2026-09-26 13:54:56 on dist-test-slave-fk7n"
I20260926 13:54:56.486109 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokens_NonUniquePrimaryKey.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:56.499476 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:56.500602 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:56.502208 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:54:56.504912 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:54:56.505154 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.505409 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:54:56.505595 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.549754 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:39159
I20260926 13:54:56.549837 4489 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:39159 every 8 connection(s)
I20260926 13:54:56.574995 4490 heartbeater.cc:344] Connected to a master server at 127.3.127.190:39923
I20260926 13:54:56.575299 4490 heartbeater.cc:461] Registering TS with master...
I20260926 13:54:56.575919 4490 heartbeater.cc:507] Master 127.3.127.190:39923 requested a full tablet report, sending...
I20260926 13:54:56.577822 4363 ts_manager.cc:194] Registered new tserver with Master: 615d67be44904603abff11f2a5632cab (127.3.127.129:39159)
I20260926 13:54:56.578284 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.018456453s
I20260926 13:54:56.580080 4363 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39990
I20260926 13:54:56.598865 4363 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39996:
name: "table"
schema {
columns {
name: "col"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "auto_incrementing_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
is_auto_incrementing: true
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "col"
}
num_buckets: 4
seed: 0
}
}
I20260926 13:54:56.643081 4455 tablet_service.cc:1511] Processing CreateTablet for tablet 12c8ebfc3faf43e7a668219fc00bdcad (DEFAULT_TABLE table=table [id=bd2640a8cc484bac90496f0248515069]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION UNBOUNDED
I20260926 13:54:56.643335 4454 tablet_service.cc:1511] Processing CreateTablet for tablet 06317194b5f649c283dbda797abb6414 (DEFAULT_TABLE table=table [id=bd2640a8cc484bac90496f0248515069]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION UNBOUNDED
I20260926 13:54:56.644147 4453 tablet_service.cc:1511] Processing CreateTablet for tablet 92aefe6fb1ff4f43be9da63016df4369 (DEFAULT_TABLE table=table [id=bd2640a8cc484bac90496f0248515069]), partition=HASH (col) PARTITION 2, RANGE (col) PARTITION UNBOUNDED
I20260926 13:54:56.644655 4455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c8ebfc3faf43e7a668219fc00bdcad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:56.645617 4453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aefe6fb1ff4f43be9da63016df4369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:56.645831 4452 tablet_service.cc:1511] Processing CreateTablet for tablet b4aeb135ec67476aba6ac5a8c3da3e33 (DEFAULT_TABLE table=table [id=bd2640a8cc484bac90496f0248515069]), partition=HASH (col) PARTITION 3, RANGE (col) PARTITION UNBOUNDED
I20260926 13:54:56.647163 4452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4aeb135ec67476aba6ac5a8c3da3e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:56.649116 4454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06317194b5f649c283dbda797abb6414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:56.669080 4502 tablet_bootstrap.cc:492] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab: Bootstrap starting.
I20260926 13:54:56.673326 4502 tablet.cc:504] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.674718 4502 tablet_bootstrap.cc:654] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:56.679021 4502 tablet_bootstrap.cc:492] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab: No bootstrap required, opened a new log
I20260926 13:54:56.679420 4502 ts_tablet_manager.cc:1403] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20260926 13:54:56.681981 4502 raft_consensus.cc:359] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.682478 4502 raft_consensus.cc:385] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:56.682726 4502 raft_consensus.cc:740] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615d67be44904603abff11f2a5632cab, State: Initialized, Role: FOLLOWER
I20260926 13:54:56.683292 4502 consensus_queue.cc:260] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.683852 4502 raft_consensus.cc:399] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:56.684157 4502 raft_consensus.cc:493] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:56.684453 4502 raft_consensus.cc:3060] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:56.690533 4502 raft_consensus.cc:515] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.691135 4502 leader_election.cc:304] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 615d67be44904603abff11f2a5632cab; no voters:
I20260926 13:54:56.692322 4502 leader_election.cc:290] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:56.692562 4504 raft_consensus.cc:2804] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:56.694047 4490 heartbeater.cc:499] Master 127.3.127.190:39923 was elected leader, sending a full tablet report...
I20260926 13:54:56.694486 4502 ts_tablet_manager.cc:1434] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab: Time spent starting tablet: real 0.015s user 0.013s sys 0.003s
I20260926 13:54:56.694702 4504 raft_consensus.cc:697] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Becoming Leader. State: Replica: 615d67be44904603abff11f2a5632cab, State: Running, Role: LEADER
I20260926 13:54:56.695273 4502 tablet_bootstrap.cc:492] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab: Bootstrap starting.
I20260926 13:54:56.695281 4504 consensus_queue.cc:237] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.700001 4502 tablet.cc:504] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.702694 4502 tablet_bootstrap.cc:654] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:56.702363 4363 catalog_manager.cc:5838] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab reported cstate change: term changed from 0 to 1, leader changed from <none> to 615d67be44904603abff11f2a5632cab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "615d67be44904603abff11f2a5632cab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:56.718925 4502 tablet_bootstrap.cc:492] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab: No bootstrap required, opened a new log
I20260926 13:54:56.719255 4502 ts_tablet_manager.cc:1403] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.010s
I20260926 13:54:56.721211 4502 raft_consensus.cc:359] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.721601 4502 raft_consensus.cc:385] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:56.721808 4502 raft_consensus.cc:740] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615d67be44904603abff11f2a5632cab, State: Initialized, Role: FOLLOWER
I20260926 13:54:56.722339 4502 consensus_queue.cc:260] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.722786 4502 raft_consensus.cc:399] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:56.723050 4502 raft_consensus.cc:493] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:56.723354 4502 raft_consensus.cc:3060] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:56.728134 4502 raft_consensus.cc:515] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.728626 4502 leader_election.cc:304] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 615d67be44904603abff11f2a5632cab; no voters:
I20260926 13:54:56.729118 4502 leader_election.cc:290] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:56.729251 4504 raft_consensus.cc:2804] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:56.730106 4504 raft_consensus.cc:697] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Becoming Leader. State: Replica: 615d67be44904603abff11f2a5632cab, State: Running, Role: LEADER
I20260926 13:54:56.730723 4502 ts_tablet_manager.cc:1434] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab: Time spent starting tablet: real 0.011s user 0.003s sys 0.008s
I20260926 13:54:56.730756 4504 consensus_queue.cc:237] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.731603 4502 tablet_bootstrap.cc:492] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab: Bootstrap starting.
I20260926 13:54:56.735702 4502 tablet.cc:504] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.736995 4502 tablet_bootstrap.cc:654] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:56.736502 4363 catalog_manager.cc:5838] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab reported cstate change: term changed from 0 to 1, leader changed from <none> to 615d67be44904603abff11f2a5632cab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "615d67be44904603abff11f2a5632cab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:56.741030 4502 tablet_bootstrap.cc:492] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab: No bootstrap required, opened a new log
I20260926 13:54:56.741415 4502 ts_tablet_manager.cc:1403] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260926 13:54:56.744941 4502 raft_consensus.cc:359] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.745525 4502 raft_consensus.cc:385] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:56.745802 4502 raft_consensus.cc:740] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615d67be44904603abff11f2a5632cab, State: Initialized, Role: FOLLOWER
I20260926 13:54:56.746424 4502 consensus_queue.cc:260] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.747028 4502 raft_consensus.cc:399] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:56.747318 4502 raft_consensus.cc:493] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:56.747625 4502 raft_consensus.cc:3060] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:56.753800 4502 raft_consensus.cc:515] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.754434 4502 leader_election.cc:304] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 615d67be44904603abff11f2a5632cab; no voters:
I20260926 13:54:56.755023 4502 leader_election.cc:290] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:56.755127 4504 raft_consensus.cc:2804] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:56.755558 4504 raft_consensus.cc:697] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Becoming Leader. State: Replica: 615d67be44904603abff11f2a5632cab, State: Running, Role: LEADER
I20260926 13:54:56.756178 4504 consensus_queue.cc:237] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.756589 4502 ts_tablet_manager.cc:1434] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab: Time spent starting tablet: real 0.015s user 0.011s sys 0.000s
I20260926 13:54:56.757405 4502 tablet_bootstrap.cc:492] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab: Bootstrap starting.
I20260926 13:54:56.761557 4362 catalog_manager.cc:5838] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab reported cstate change: term changed from 0 to 1, leader changed from <none> to 615d67be44904603abff11f2a5632cab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "615d67be44904603abff11f2a5632cab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:56.761889 4502 tablet.cc:504] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:56.763200 4502 tablet_bootstrap.cc:654] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:56.768661 4502 tablet_bootstrap.cc:492] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab: No bootstrap required, opened a new log
I20260926 13:54:56.769071 4502 ts_tablet_manager.cc:1403] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260926 13:54:56.771394 4502 raft_consensus.cc:359] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.771893 4502 raft_consensus.cc:385] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:56.772173 4502 raft_consensus.cc:740] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615d67be44904603abff11f2a5632cab, State: Initialized, Role: FOLLOWER
I20260926 13:54:56.772812 4502 consensus_queue.cc:260] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.773442 4502 raft_consensus.cc:399] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:56.773720 4502 raft_consensus.cc:493] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:56.774048 4502 raft_consensus.cc:3060] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:56.780285 4502 raft_consensus.cc:515] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.780941 4502 leader_election.cc:304] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 615d67be44904603abff11f2a5632cab; no voters:
I20260926 13:54:56.781505 4502 leader_election.cc:290] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:56.781618 4504 raft_consensus.cc:2804] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:56.782440 4504 raft_consensus.cc:697] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Becoming Leader. State: Replica: 615d67be44904603abff11f2a5632cab, State: Running, Role: LEADER
I20260926 13:54:56.783093 4502 ts_tablet_manager.cc:1434] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260926 13:54:56.782989 4504 consensus_queue.cc:237] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } }
I20260926 13:54:56.789319 4362 catalog_manager.cc:5838] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab reported cstate change: term changed from 0 to 1, leader changed from <none> to 615d67be44904603abff11f2a5632cab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "615d67be44904603abff11f2a5632cab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "615d67be44904603abff11f2a5632cab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:56.944444 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:54:56.958340 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:54:56.959018 3582 tablet_replica.cc:333] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab: stopping tablet replica
I20260926 13:54:56.959460 3582 raft_consensus.cc:2243] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.959822 3582 raft_consensus.cc:2272] T b4aeb135ec67476aba6ac5a8c3da3e33 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.961673 3582 tablet_replica.cc:333] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab: stopping tablet replica
I20260926 13:54:56.962071 3582 raft_consensus.cc:2243] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.962400 3582 raft_consensus.cc:2272] T 06317194b5f649c283dbda797abb6414 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.964186 3582 tablet_replica.cc:333] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab: stopping tablet replica
I20260926 13:54:56.964578 3582 raft_consensus.cc:2243] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.964951 3582 raft_consensus.cc:2272] T 12c8ebfc3faf43e7a668219fc00bdcad P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.966609 3582 tablet_replica.cc:333] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab: stopping tablet replica
I20260926 13:54:56.966980 3582 raft_consensus.cc:2243] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:56.967301 3582 raft_consensus.cc:2272] T 92aefe6fb1ff4f43be9da63016df4369 P 615d67be44904603abff11f2a5632cab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:56.987746 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:54:56.995913 3582 master.cc:562] Master@127.3.127.190:39923 shutting down...
I20260926 13:54:57.007604 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:57.008020 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:57.008292 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8929ffca383b4fef99dccdd16c3d04c1: stopping tablet replica
I20260926 13:54:57.024777 3582 master.cc:584] Master@127.3.127.190:39923 shutdown complete.
[ OK ] ScanTokenTest.TestScanTokens_NonUniquePrimaryKey (859 ms)
[ RUN ] ScanTokenTest.TestScanTokensWithQueryId
I20260926 13:54:57.043596 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:45223
I20260926 13:54:57.044487 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:57.048527 4517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:57.049714 4518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:57.050098 4520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:57.050420 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:57.051041 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:57.051201 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:57.051357 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430897051340 us; error 0 us; skew 500 ppm
I20260926 13:54:57.051828 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:57.053828 3582 webserver.cc:533] Webserver started at http://127.3.127.190:43165/ using document root <none> and password file <none>
I20260926 13:54:57.054250 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:57.054404 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:57.054641 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:57.055572 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b"
format_stamp: "Formatted at 2026-09-26 13:54:57 on dist-test-slave-fk7n"
I20260926 13:54:57.059442 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260926 13:54:57.062208 4525 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:57.062817 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:54:57.063058 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b"
format_stamp: "Formatted at 2026-09-26 13:54:57 on dist-test-slave-fk7n"
I20260926 13:54:57.063294 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:57.081707 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:57.082567 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:57.113376 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:45223
I20260926 13:54:57.113473 4576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:45223 every 8 connection(s)
I20260926 13:54:57.116701 4577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:57.125312 4577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b: Bootstrap starting.
I20260926 13:54:57.129060 4577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:57.132396 4577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b: No bootstrap required, opened a new log
I20260926 13:54:57.134157 4577 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" member_type: VOTER }
I20260926 13:54:57.134498 4577 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:57.134716 4577 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22b7ae6527804bc785bfdc4b0b9c5e4b, State: Initialized, Role: FOLLOWER
I20260926 13:54:57.135243 4577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" member_type: VOTER }
I20260926 13:54:57.135659 4577 raft_consensus.cc:399] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:57.135875 4577 raft_consensus.cc:493] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:57.136121 4577 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:57.139809 4577 raft_consensus.cc:515] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" member_type: VOTER }
I20260926 13:54:57.140264 4577 leader_election.cc:304] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22b7ae6527804bc785bfdc4b0b9c5e4b; no voters:
I20260926 13:54:57.141281 4577 leader_election.cc:290] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:57.141534 4580 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:57.142668 4580 raft_consensus.cc:697] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 1 LEADER]: Becoming Leader. State: Replica: 22b7ae6527804bc785bfdc4b0b9c5e4b, State: Running, Role: LEADER
I20260926 13:54:57.143240 4580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" member_type: VOTER }
I20260926 13:54:57.143769 4577 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:54:57.145684 4581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" member_type: VOTER } }
I20260926 13:54:57.145735 4582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22b7ae6527804bc785bfdc4b0b9c5e4b. Latest consensus state: current_term: 1 leader_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22b7ae6527804bc785bfdc4b0b9c5e4b" member_type: VOTER } }
I20260926 13:54:57.146366 4581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:57.146421 4582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:57.148886 4586 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:54:57.153242 4586 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:54:57.157354 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:54:57.160791 4586 catalog_manager.cc:1396] Generated new cluster ID: 2b74abbb523a43c1a7b8bb399e49c7df
I20260926 13:54:57.161043 4586 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:54:57.179853 4586 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:54:57.180971 4586 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:54:57.192301 4586 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b: Generated new TSK 0
I20260926 13:54:57.192854 4586 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:54:57.223728 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:57.228890 4598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:57.229749 4599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:57.231098 4601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:57.231246 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:57.232026 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:57.232203 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:57.232363 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430897232340 us; error 0 us; skew 500 ppm
I20260926 13:54:57.232877 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:57.234828 3582 webserver.cc:533] Webserver started at http://127.3.127.129:44253/ using document root <none> and password file <none>
I20260926 13:54:57.235247 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:57.235424 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:57.235651 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:57.236605 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "662d7f738d62482e902b35b751103e63"
format_stamp: "Formatted at 2026-09-26 13:54:57 on dist-test-slave-fk7n"
I20260926 13:54:57.240499 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260926 13:54:57.243266 4606 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:57.244056 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:54:57.244369 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "662d7f738d62482e902b35b751103e63"
format_stamp: "Formatted at 2026-09-26 13:54:57 on dist-test-slave-fk7n"
I20260926 13:54:57.244601 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithQueryId.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:57.270066 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:57.270895 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:57.272109 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:54:57.274119 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:54:57.274294 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:57.274513 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:54:57.274648 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:57.307896 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:45485
I20260926 13:54:57.307998 4668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:45485 every 8 connection(s)
I20260926 13:54:57.329181 4669 heartbeater.cc:344] Connected to a master server at 127.3.127.190:45223
I20260926 13:54:57.329514 4669 heartbeater.cc:461] Registering TS with master...
I20260926 13:54:57.330166 4669 heartbeater.cc:507] Master 127.3.127.190:45223 requested a full tablet report, sending...
I20260926 13:54:57.331876 4542 ts_manager.cc:194] Registered new tserver with Master: 662d7f738d62482e902b35b751103e63 (127.3.127.129:45485)
I20260926 13:54:57.332393 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.021408775s
I20260926 13:54:57.333442 4542 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59860
I20260926 13:54:57.367780 4542 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59878:
name: "test_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
I20260926 13:54:57.395129 4634 tablet_service.cc:1511] Processing CreateTablet for tablet ea1b2c224a4347769ef6d62b3b2ddbba (DEFAULT_TABLE table=test_table [id=fa76a871157e40e1a1371eb8dc0b95b5]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:54:57.395295 4633 tablet_service.cc:1511] Processing CreateTablet for tablet f63e810bce43418882b12dab6c83a7b9 (DEFAULT_TABLE table=test_table [id=fa76a871157e40e1a1371eb8dc0b95b5]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:54:57.396049 4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1b2c224a4347769ef6d62b3b2ddbba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:57.396477 4633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f63e810bce43418882b12dab6c83a7b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:57.406695 4686 tablet_bootstrap.cc:492] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63: Bootstrap starting.
I20260926 13:54:57.410392 4686 tablet_bootstrap.cc:654] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:57.413915 4686 tablet_bootstrap.cc:492] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63: No bootstrap required, opened a new log
I20260926 13:54:57.414207 4686 ts_tablet_manager.cc:1403] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260926 13:54:57.415812 4686 raft_consensus.cc:359] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.416169 4686 raft_consensus.cc:385] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:57.416396 4686 raft_consensus.cc:740] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662d7f738d62482e902b35b751103e63, State: Initialized, Role: FOLLOWER
I20260926 13:54:57.416911 4686 consensus_queue.cc:260] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.417351 4686 raft_consensus.cc:399] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:57.417565 4686 raft_consensus.cc:493] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:57.417794 4686 raft_consensus.cc:3060] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:57.421502 4686 raft_consensus.cc:515] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.421967 4686 leader_election.cc:304] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 662d7f738d62482e902b35b751103e63; no voters:
I20260926 13:54:57.422958 4686 leader_election.cc:290] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:57.423230 4688 raft_consensus.cc:2804] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:57.424453 4688 raft_consensus.cc:697] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 1 LEADER]: Becoming Leader. State: Replica: 662d7f738d62482e902b35b751103e63, State: Running, Role: LEADER
I20260926 13:54:57.424563 4669 heartbeater.cc:499] Master 127.3.127.190:45223 was elected leader, sending a full tablet report...
I20260926 13:54:57.425033 4686 ts_tablet_manager.cc:1434] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63: Time spent starting tablet: real 0.011s user 0.006s sys 0.006s
I20260926 13:54:57.425168 4688 consensus_queue.cc:237] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.425725 4686 tablet_bootstrap.cc:492] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63: Bootstrap starting.
I20260926 13:54:57.430855 4686 tablet_bootstrap.cc:654] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:57.431705 4542 catalog_manager.cc:5838] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 662d7f738d62482e902b35b751103e63 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "662d7f738d62482e902b35b751103e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:57.434716 4686 tablet_bootstrap.cc:492] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63: No bootstrap required, opened a new log
I20260926 13:54:57.435102 4686 ts_tablet_manager.cc:1403] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260926 13:54:57.437098 4686 raft_consensus.cc:359] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.437471 4686 raft_consensus.cc:385] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:57.437671 4686 raft_consensus.cc:740] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662d7f738d62482e902b35b751103e63, State: Initialized, Role: FOLLOWER
I20260926 13:54:57.438422 4686 consensus_queue.cc:260] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.439019 4686 raft_consensus.cc:399] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:57.439306 4686 raft_consensus.cc:493] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:57.439633 4686 raft_consensus.cc:3060] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:57.444911 4686 raft_consensus.cc:515] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.445436 4686 leader_election.cc:304] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 662d7f738d62482e902b35b751103e63; no voters:
I20260926 13:54:57.445822 4686 leader_election.cc:290] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:57.445941 4688 raft_consensus.cc:2804] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:57.446358 4688 raft_consensus.cc:697] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 1 LEADER]: Becoming Leader. State: Replica: 662d7f738d62482e902b35b751103e63, State: Running, Role: LEADER
I20260926 13:54:57.447294 4686 ts_tablet_manager.cc:1434] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63: Time spent starting tablet: real 0.012s user 0.004s sys 0.009s
I20260926 13:54:57.447394 4688 consensus_queue.cc:237] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } }
I20260926 13:54:57.451757 4542 catalog_manager.cc:5838] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 662d7f738d62482e902b35b751103e63 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "662d7f738d62482e902b35b751103e63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662d7f738d62482e902b35b751103e63" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45485 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:58.172814 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:54:58.193158 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:54:58.193748 3582 tablet_replica.cc:333] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63: stopping tablet replica
I20260926 13:54:58.194271 3582 raft_consensus.cc:2243] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:58.194700 3582 raft_consensus.cc:2272] T f63e810bce43418882b12dab6c83a7b9 P 662d7f738d62482e902b35b751103e63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:58.197358 3582 tablet_replica.cc:333] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63: stopping tablet replica
I20260926 13:54:58.197767 3582 raft_consensus.cc:2243] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:58.198143 3582 raft_consensus.cc:2272] T ea1b2c224a4347769ef6d62b3b2ddbba P 662d7f738d62482e902b35b751103e63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:58.219436 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:54:58.228158 3582 master.cc:562] Master@127.3.127.190:45223 shutting down...
I20260926 13:54:58.246181 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:58.246603 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:58.246871 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 22b7ae6527804bc785bfdc4b0b9c5e4b: stopping tablet replica
I20260926 13:54:58.264313 3582 master.cc:584] Master@127.3.127.190:45223 shutdown complete.
[ OK ] ScanTokenTest.TestScanTokensWithQueryId (1239 ms)
[ RUN ] ScanTokenTest.TestScanTokensWithNonCoveringRange
I20260926 13:54:58.283685 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:32917
I20260926 13:54:58.284572 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:58.289003 4713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:58.290297 4714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:58.292495 4716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:58.298077 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:58.298753 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:58.298914 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:58.299059 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430898299044 us; error 0 us; skew 500 ppm
I20260926 13:54:58.299530 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:58.301980 3582 webserver.cc:533] Webserver started at http://127.3.127.190:43201/ using document root <none> and password file <none>
I20260926 13:54:58.302385 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:58.302536 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:58.302754 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:58.303681 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2"
format_stamp: "Formatted at 2026-09-26 13:54:58 on dist-test-slave-fk7n"
I20260926 13:54:58.307750 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:54:58.310767 4721 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:58.311506 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:54:58.311830 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2"
format_stamp: "Formatted at 2026-09-26 13:54:58 on dist-test-slave-fk7n"
I20260926 13:54:58.312152 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:58.330262 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:58.331463 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:58.371850 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:32917
I20260926 13:54:58.371897 4772 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:32917 every 8 connection(s)
I20260926 13:54:58.376333 4773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:58.385157 4773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2: Bootstrap starting.
I20260926 13:54:58.388885 4773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:58.392352 4773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2: No bootstrap required, opened a new log
I20260926 13:54:58.394124 4773 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" member_type: VOTER }
I20260926 13:54:58.394476 4773 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:58.394678 4773 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e05aaeb041749bd8f3bd5ecbe6630e2, State: Initialized, Role: FOLLOWER
I20260926 13:54:58.395155 4773 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" member_type: VOTER }
I20260926 13:54:58.395557 4773 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:58.395761 4773 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:58.395992 4773 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:58.399781 4773 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" member_type: VOTER }
I20260926 13:54:58.400233 4773 leader_election.cc:304] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e05aaeb041749bd8f3bd5ecbe6630e2; no voters:
I20260926 13:54:58.401376 4773 leader_election.cc:290] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:58.401773 4776 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:58.403213 4776 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9e05aaeb041749bd8f3bd5ecbe6630e2, State: Running, Role: LEADER
I20260926 13:54:58.403927 4776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" member_type: VOTER }
I20260926 13:54:58.404368 4773 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:54:58.407671 4777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" member_type: VOTER } }
I20260926 13:54:58.408177 4777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:58.409265 4778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e05aaeb041749bd8f3bd5ecbe6630e2. Latest consensus state: current_term: 1 leader_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e05aaeb041749bd8f3bd5ecbe6630e2" member_type: VOTER } }
I20260926 13:54:58.409734 4778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [sys.catalog]: This master's current role is: LEADER
I20260926 13:54:58.418388 4782 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:54:58.423498 4782 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:54:58.426928 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:54:58.432266 4782 catalog_manager.cc:1396] Generated new cluster ID: 2d72d18ed2a84f849fa39041ccdf51c5
I20260926 13:54:58.432490 4782 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:54:58.449371 4782 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:54:58.450827 4782 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:54:58.473505 4782 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2: Generated new TSK 0
I20260926 13:54:58.474078 4782 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:54:58.493008 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:58.498492 4794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:58.500073 4795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:58.502220 4797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:58.502365 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:58.503201 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:58.503386 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:58.503542 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430898503527 us; error 0 us; skew 500 ppm
I20260926 13:54:58.504006 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:58.506453 3582 webserver.cc:533] Webserver started at http://127.3.127.129:43665/ using document root <none> and password file <none>
I20260926 13:54:58.506878 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:58.507050 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:58.507290 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:58.508239 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "dbbcc33094eb41f5be1e606683292752"
format_stamp: "Formatted at 2026-09-26 13:54:58 on dist-test-slave-fk7n"
I20260926 13:54:58.512343 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:54:58.515494 4802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:58.516238 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:54:58.516539 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "dbbcc33094eb41f5be1e606683292752"
format_stamp: "Formatted at 2026-09-26 13:54:58 on dist-test-slave-fk7n"
I20260926 13:54:58.516901 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:58.537173 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:58.538327 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:58.539960 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:54:58.542670 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:54:58.542918 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:58.543174 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:54:58.543365 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:58.586715 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:38991
I20260926 13:54:58.586797 4864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:38991 every 8 connection(s)
I20260926 13:54:58.601830 4865 heartbeater.cc:344] Connected to a master server at 127.3.127.190:32917
I20260926 13:54:58.602157 4865 heartbeater.cc:461] Registering TS with master...
I20260926 13:54:58.602813 4865 heartbeater.cc:507] Master 127.3.127.190:32917 requested a full tablet report, sending...
I20260926 13:54:58.604609 4738 ts_manager.cc:194] Registered new tserver with Master: dbbcc33094eb41f5be1e606683292752 (127.3.127.129:38991)
I20260926 13:54:58.604730 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.014151451s
I20260926 13:54:58.606401 4738 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50704
I20260926 13:54:58.627234 4738 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50714:
name: "table"
schema {
columns {
name: "col"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001,\001\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000\006\001\310\000\000\000\000\000\000\000\007\001\220\001\000\000\000\000\000\000""\004\001,\001\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000\006\001\310\000\000\000\000\000\000\000\007\001\220\001\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
hash_schema {
columns {
name: "col"
}
num_buckets: 2
seed: 0
}
}
I20260926 13:54:58.671442 4830 tablet_service.cc:1511] Processing CreateTablet for tablet 53aa34b8e6be4d2389837956e833d3ec (DEFAULT_TABLE table=table [id=e9251694c0e54ab4b1e0a67e3ff4530c]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:54:58.671667 4829 tablet_service.cc:1511] Processing CreateTablet for tablet d367a5b8b099459baee06f9519c0ac5f (DEFAULT_TABLE table=table [id=e9251694c0e54ab4b1e0a67e3ff4530c]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 200 <= VALUES < 300
I20260926 13:54:58.671888 4828 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9c4ca8cf944eafbe00ca96a30c95ee (DEFAULT_TABLE table=table [id=e9251694c0e54ab4b1e0a67e3ff4530c]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 300 <= VALUES < 400
I20260926 13:54:58.672735 4830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53aa34b8e6be4d2389837956e833d3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:58.673316 4829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d367a5b8b099459baee06f9519c0ac5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:58.673602 4827 tablet_service.cc:1511] Processing CreateTablet for tablet 1f70825b101d4eb3b79ad99be3c3fe0f (DEFAULT_TABLE table=table [id=e9251694c0e54ab4b1e0a67e3ff4530c]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:54:58.674789 4827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f70825b101d4eb3b79ad99be3c3fe0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:58.676507 4828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9c4ca8cf944eafbe00ca96a30c95ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:58.678392 4826 tablet_service.cc:1511] Processing CreateTablet for tablet b0c19584f46646b0bb1c448f687095c0 (DEFAULT_TABLE table=table [id=e9251694c0e54ab4b1e0a67e3ff4530c]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 200 <= VALUES < 300
I20260926 13:54:58.679579 4826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c19584f46646b0bb1c448f687095c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:58.685904 4825 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2ca4f3e5084da7ad5038bec5fb2a34 (DEFAULT_TABLE table=table [id=e9251694c0e54ab4b1e0a67e3ff4530c]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 300 <= VALUES < 400
I20260926 13:54:58.687124 4825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2ca4f3e5084da7ad5038bec5fb2a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:58.704474 4877 tablet_bootstrap.cc:492] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752: Bootstrap starting.
I20260926 13:54:58.712455 4877 tablet_bootstrap.cc:654] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:58.716243 4877 tablet_bootstrap.cc:492] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752: No bootstrap required, opened a new log
I20260926 13:54:58.716560 4877 ts_tablet_manager.cc:1403] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260926 13:54:58.718253 4877 raft_consensus.cc:359] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.718636 4877 raft_consensus.cc:385] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:58.718894 4877 raft_consensus.cc:740] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Initialized, Role: FOLLOWER
I20260926 13:54:58.719440 4877 consensus_queue.cc:260] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.719928 4877 raft_consensus.cc:399] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:58.720196 4877 raft_consensus.cc:493] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:58.720470 4877 raft_consensus.cc:3060] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:58.724674 4877 raft_consensus.cc:515] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.725199 4877 leader_election.cc:304] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbbcc33094eb41f5be1e606683292752; no voters:
I20260926 13:54:58.726395 4877 leader_election.cc:290] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:58.726701 4879 raft_consensus.cc:2804] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:58.728119 4865 heartbeater.cc:499] Master 127.3.127.190:32917 was elected leader, sending a full tablet report...
I20260926 13:54:58.728689 4877 ts_tablet_manager.cc:1434] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260926 13:54:58.729592 4877 tablet_bootstrap.cc:492] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752: Bootstrap starting.
I20260926 13:54:58.729859 4879 raft_consensus.cc:697] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Becoming Leader. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Running, Role: LEADER
I20260926 13:54:58.730561 4879 consensus_queue.cc:237] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.735224 4877 tablet_bootstrap.cc:654] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:58.745368 4738 catalog_manager.cc:5838] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbbcc33094eb41f5be1e606683292752 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "dbbcc33094eb41f5be1e606683292752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:58.745973 4877 tablet_bootstrap.cc:492] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752: No bootstrap required, opened a new log
I20260926 13:54:58.747675 4877 ts_tablet_manager.cc:1403] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.005s
I20260926 13:54:58.750010 4877 raft_consensus.cc:359] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.750504 4877 raft_consensus.cc:385] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:58.750784 4877 raft_consensus.cc:740] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Initialized, Role: FOLLOWER
I20260926 13:54:58.751667 4877 consensus_queue.cc:260] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.752389 4877 raft_consensus.cc:399] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:58.752737 4877 raft_consensus.cc:493] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:58.753079 4877 raft_consensus.cc:3060] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:58.759377 4877 raft_consensus.cc:515] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.759971 4877 leader_election.cc:304] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbbcc33094eb41f5be1e606683292752; no voters:
I20260926 13:54:58.760540 4877 leader_election.cc:290] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:58.760695 4879 raft_consensus.cc:2804] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:58.761221 4879 raft_consensus.cc:697] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Becoming Leader. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Running, Role: LEADER
I20260926 13:54:58.761927 4877 ts_tablet_manager.cc:1434] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260926 13:54:58.761905 4879 consensus_queue.cc:237] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.762832 4877 tablet_bootstrap.cc:492] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752: Bootstrap starting.
I20260926 13:54:58.768405 4877 tablet_bootstrap.cc:654] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:58.774362 4877 tablet_bootstrap.cc:492] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752: No bootstrap required, opened a new log
I20260926 13:54:58.774670 4877 ts_tablet_manager.cc:1403] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260926 13:54:58.774502 4738 catalog_manager.cc:5838] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbbcc33094eb41f5be1e606683292752 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "dbbcc33094eb41f5be1e606683292752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:58.776376 4877 raft_consensus.cc:359] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.776823 4877 raft_consensus.cc:385] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:58.777098 4877 raft_consensus.cc:740] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Initialized, Role: FOLLOWER
I20260926 13:54:58.777730 4877 consensus_queue.cc:260] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.778316 4877 raft_consensus.cc:399] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:58.778596 4877 raft_consensus.cc:493] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:58.778908 4877 raft_consensus.cc:3060] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:58.784595 4877 raft_consensus.cc:515] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.785153 4877 leader_election.cc:304] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbbcc33094eb41f5be1e606683292752; no voters:
I20260926 13:54:58.785580 4877 leader_election.cc:290] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:58.785735 4879 raft_consensus.cc:2804] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:58.786664 4879 raft_consensus.cc:697] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Becoming Leader. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Running, Role: LEADER
I20260926 13:54:58.786867 4877 ts_tablet_manager.cc:1434] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20260926 13:54:58.787523 4877 tablet_bootstrap.cc:492] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752: Bootstrap starting.
I20260926 13:54:58.787319 4879 consensus_queue.cc:237] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.792683 4877 tablet_bootstrap.cc:654] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:58.793277 4738 catalog_manager.cc:5838] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbbcc33094eb41f5be1e606683292752 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "dbbcc33094eb41f5be1e606683292752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:58.796434 4877 tablet_bootstrap.cc:492] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752: No bootstrap required, opened a new log
I20260926 13:54:58.796859 4877 ts_tablet_manager.cc:1403] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752: Time spent bootstrapping tablet: real 0.009s user 0.009s sys 0.000s
I20260926 13:54:58.798815 4877 raft_consensus.cc:359] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.799211 4877 raft_consensus.cc:385] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:58.799431 4877 raft_consensus.cc:740] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Initialized, Role: FOLLOWER
I20260926 13:54:58.799964 4877 consensus_queue.cc:260] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.800465 4877 raft_consensus.cc:399] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:58.800673 4877 raft_consensus.cc:493] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:58.800967 4877 raft_consensus.cc:3060] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:58.806268 4877 raft_consensus.cc:515] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.806861 4877 leader_election.cc:304] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbbcc33094eb41f5be1e606683292752; no voters:
I20260926 13:54:58.807412 4877 leader_election.cc:290] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:58.807551 4879 raft_consensus.cc:2804] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:58.807996 4879 raft_consensus.cc:697] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Becoming Leader. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Running, Role: LEADER
I20260926 13:54:58.808665 4879 consensus_queue.cc:237] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.809015 4877 ts_tablet_manager.cc:1434] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260926 13:54:58.810725 4877 tablet_bootstrap.cc:492] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752: Bootstrap starting.
I20260926 13:54:58.816560 4877 tablet_bootstrap.cc:654] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752: Neither blocks nor log segments found. Creating new log.
I20260926 13:54:58.821185 4877 tablet_bootstrap.cc:492] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752: No bootstrap required, opened a new log
I20260926 13:54:58.821578 4877 ts_tablet_manager.cc:1403] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260926 13:54:58.821532 4738 catalog_manager.cc:5838] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbbcc33094eb41f5be1e606683292752 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "dbbcc33094eb41f5be1e606683292752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:58.823961 4877 raft_consensus.cc:359] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.824458 4877 raft_consensus.cc:385] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:58.824721 4877 raft_consensus.cc:740] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Initialized, Role: FOLLOWER
I20260926 13:54:58.825378 4877 consensus_queue.cc:260] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.825932 4877 raft_consensus.cc:399] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:58.826122 4877 raft_consensus.cc:493] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:58.826324 4877 raft_consensus.cc:3060] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:58.830801 4877 raft_consensus.cc:515] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.831276 4877 leader_election.cc:304] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbbcc33094eb41f5be1e606683292752; no voters:
I20260926 13:54:58.831763 4877 leader_election.cc:290] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:58.831887 4879 raft_consensus.cc:2804] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:58.832353 4879 raft_consensus.cc:697] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Becoming Leader. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Running, Role: LEADER
I20260926 13:54:58.832989 4879 consensus_queue.cc:237] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.833705 4877 ts_tablet_manager.cc:1434] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260926 13:54:58.834487 4877 tablet_bootstrap.cc:492] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752: Bootstrap starting.
I20260926 13:54:58.838553 4877 tablet_bootstrap.cc:654] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752: Neither blocks nor log segments found. Creating new log.
W20260926 13:54:58.841523 4866 tablet.cc:2433] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260926 13:54:58.846541 4877 tablet_bootstrap.cc:492] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752: No bootstrap required, opened a new log
I20260926 13:54:58.846833 4877 ts_tablet_manager.cc:1403] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260926 13:54:58.846868 4738 catalog_manager.cc:5838] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbbcc33094eb41f5be1e606683292752 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "dbbcc33094eb41f5be1e606683292752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:58.848871 4877 raft_consensus.cc:359] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.849318 4877 raft_consensus.cc:385] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:54:58.849550 4877 raft_consensus.cc:740] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Initialized, Role: FOLLOWER
I20260926 13:54:58.850111 4877 consensus_queue.cc:260] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.850636 4877 raft_consensus.cc:399] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:54:58.850878 4877 raft_consensus.cc:493] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:54:58.851135 4877 raft_consensus.cc:3060] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:54:58.856609 4877 raft_consensus.cc:515] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.857163 4877 leader_election.cc:304] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbbcc33094eb41f5be1e606683292752; no voters:
I20260926 13:54:58.857554 4877 leader_election.cc:290] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:54:58.857705 4879 raft_consensus.cc:2804] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:54:58.858625 4877 ts_tablet_manager.cc:1434] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260926 13:54:58.858605 4879 raft_consensus.cc:697] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Becoming Leader. State: Replica: dbbcc33094eb41f5be1e606683292752, State: Running, Role: LEADER
I20260926 13:54:58.859308 4879 consensus_queue.cc:237] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } }
I20260926 13:54:58.864620 4738 catalog_manager.cc:5838] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbbcc33094eb41f5be1e606683292752 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "dbbcc33094eb41f5be1e606683292752" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbbcc33094eb41f5be1e606683292752" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 38991 } health_report { overall_health: HEALTHY } } }
I20260926 13:54:59.747363 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:54:59.764257 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:54:59.764868 3582 tablet_replica.cc:333] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752: stopping tablet replica
I20260926 13:54:59.765407 3582 raft_consensus.cc:2243] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:59.765821 3582 raft_consensus.cc:2272] T 4c2ca4f3e5084da7ad5038bec5fb2a34 P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:59.767752 3582 tablet_replica.cc:333] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752: stopping tablet replica
I20260926 13:54:59.768208 3582 raft_consensus.cc:2243] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:59.768568 3582 raft_consensus.cc:2272] T 1f9c4ca8cf944eafbe00ca96a30c95ee P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:59.770358 3582 tablet_replica.cc:333] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752: stopping tablet replica
I20260926 13:54:59.770795 3582 raft_consensus.cc:2243] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:59.771148 3582 raft_consensus.cc:2272] T d367a5b8b099459baee06f9519c0ac5f P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:59.772943 3582 tablet_replica.cc:333] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752: stopping tablet replica
I20260926 13:54:59.773363 3582 raft_consensus.cc:2243] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:59.773716 3582 raft_consensus.cc:2272] T 53aa34b8e6be4d2389837956e833d3ec P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:59.775506 3582 tablet_replica.cc:333] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752: stopping tablet replica
I20260926 13:54:59.775919 3582 raft_consensus.cc:2243] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:59.776283 3582 raft_consensus.cc:2272] T 1f70825b101d4eb3b79ad99be3c3fe0f P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:59.778071 3582 tablet_replica.cc:333] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752: stopping tablet replica
I20260926 13:54:59.778460 3582 raft_consensus.cc:2243] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:59.778815 3582 raft_consensus.cc:2272] T b0c19584f46646b0bb1c448f687095c0 P dbbcc33094eb41f5be1e606683292752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:59.801299 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:54:59.811992 3582 master.cc:562] Master@127.3.127.190:32917 shutting down...
I20260926 13:54:59.827448 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:54:59.827909 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:54:59.828212 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9e05aaeb041749bd8f3bd5ecbe6630e2: stopping tablet replica
I20260926 13:54:59.849886 3582 master.cc:584] Master@127.3.127.190:32917 shutdown complete.
[ OK ] ScanTokenTest.TestScanTokensWithNonCoveringRange (1588 ms)
[ RUN ] ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange
I20260926 13:54:59.872690 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:39993
I20260926 13:54:59.873646 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:54:59.878144 5045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:59.879649 5046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:54:59.882069 5048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:54:59.882336 3582 server_base.cc:1061] running on GCE node
I20260926 13:54:59.883038 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:54:59.883219 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:54:59.883364 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430899883349 us; error 0 us; skew 500 ppm
I20260926 13:54:59.883826 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:54:59.886142 3582 webserver.cc:533] Webserver started at http://127.3.127.190:35763/ using document root <none> and password file <none>
I20260926 13:54:59.886545 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:54:59.886706 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:54:59.886924 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:54:59.887845 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "e253c821c0804010a84da6c14a5cf398"
format_stamp: "Formatted at 2026-09-26 13:54:59 on dist-test-slave-fk7n"
I20260926 13:54:59.891942 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260926 13:54:59.894987 5053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:54:59.895690 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:54:59.895922 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "e253c821c0804010a84da6c14a5cf398"
format_stamp: "Formatted at 2026-09-26 13:54:59 on dist-test-slave-fk7n"
I20260926 13:54:59.896173 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:54:59.928050 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:54:59.929097 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:54:59.973052 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:39993
I20260926 13:54:59.973131 5104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:39993 every 8 connection(s)
I20260926 13:54:59.977138 5105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:54:59.990955 5105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398: Bootstrap starting.
I20260926 13:54:59.996567 5105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:00.000964 5105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398: No bootstrap required, opened a new log
I20260926 13:55:00.003455 5105 raft_consensus.cc:359] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e253c821c0804010a84da6c14a5cf398" member_type: VOTER }
I20260926 13:55:00.003933 5105 raft_consensus.cc:385] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:00.004215 5105 raft_consensus.cc:740] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e253c821c0804010a84da6c14a5cf398, State: Initialized, Role: FOLLOWER
I20260926 13:55:00.004853 5105 consensus_queue.cc:260] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e253c821c0804010a84da6c14a5cf398" member_type: VOTER }
I20260926 13:55:00.005426 5105 raft_consensus.cc:399] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:00.005719 5105 raft_consensus.cc:493] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:00.006036 5105 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:00.011901 5105 raft_consensus.cc:515] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e253c821c0804010a84da6c14a5cf398" member_type: VOTER }
I20260926 13:55:00.012496 5105 leader_election.cc:304] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e253c821c0804010a84da6c14a5cf398; no voters:
I20260926 13:55:00.013725 5105 leader_election.cc:290] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:00.013932 5108 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:00.015841 5108 raft_consensus.cc:697] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 1 LEADER]: Becoming Leader. State: Replica: e253c821c0804010a84da6c14a5cf398, State: Running, Role: LEADER
I20260926 13:55:00.016485 5108 consensus_queue.cc:237] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e253c821c0804010a84da6c14a5cf398" member_type: VOTER }
I20260926 13:55:00.017014 5105 sys_catalog.cc:565] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:00.018813 5110 sys_catalog.cc:455] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e253c821c0804010a84da6c14a5cf398. Latest consensus state: current_term: 1 leader_uuid: "e253c821c0804010a84da6c14a5cf398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e253c821c0804010a84da6c14a5cf398" member_type: VOTER } }
I20260926 13:55:00.019328 5110 sys_catalog.cc:458] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:00.020496 5109 sys_catalog.cc:455] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e253c821c0804010a84da6c14a5cf398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e253c821c0804010a84da6c14a5cf398" member_type: VOTER } }
I20260926 13:55:00.021034 5109 sys_catalog.cc:458] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:00.030128 5112 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:00.034986 5112 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:00.038843 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:00.043362 5112 catalog_manager.cc:1396] Generated new cluster ID: c3461877382a484c850f7bb2c4f9fe72
I20260926 13:55:00.043617 5112 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:00.065091 5112 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:00.066568 5112 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:00.087311 5112 catalog_manager.cc:6219] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398: Generated new TSK 0
I20260926 13:55:00.087913 5112 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:00.104537 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:00.109871 5126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:00.110929 5127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:00.113771 5129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:00.113907 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:00.114699 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:00.114908 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:00.115097 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430900115078 us; error 0 us; skew 500 ppm
I20260926 13:55:00.115561 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:00.117997 3582 webserver.cc:533] Webserver started at http://127.3.127.129:39525/ using document root <none> and password file <none>
I20260926 13:55:00.118422 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:00.118641 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:00.118901 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:00.119894 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "118e7061736e4f8b940e48fcf68ece7b"
format_stamp: "Formatted at 2026-09-26 13:55:00 on dist-test-slave-fk7n"
I20260926 13:55:00.124045 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260926 13:55:00.127082 5134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:00.127836 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:00.128156 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "118e7061736e4f8b940e48fcf68ece7b"
format_stamp: "Formatted at 2026-09-26 13:55:00 on dist-test-slave-fk7n"
I20260926 13:55:00.128484 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:00.139873 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:00.141085 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:00.142709 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:00.145478 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:00.145715 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:00.145969 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:00.146175 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:00.189759 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:45481
I20260926 13:55:00.189822 5196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:45481 every 8 connection(s)
I20260926 13:55:00.212323 5197 heartbeater.cc:344] Connected to a master server at 127.3.127.190:39993
I20260926 13:55:00.212657 5197 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:00.213302 5197 heartbeater.cc:507] Master 127.3.127.190:39993 requested a full tablet report, sending...
I20260926 13:55:00.215116 5070 ts_manager.cc:194] Registered new tserver with Master: 118e7061736e4f8b940e48fcf68ece7b (127.3.127.129:45481)
I20260926 13:55:00.215857 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.016008522s
I20260926 13:55:00.217149 5070 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37550
I20260926 13:55:00.237294 5070 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37552:
name: "table"
schema {
columns {
name: "col"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "col"
}
num_buckets: 2
seed: 0
}
custom_hash_schema_ranges {
range_bounds {
rows: "\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
hash_schema {
columns {
name: "col"
}
num_buckets: 4
seed: 0
}
}
custom_hash_schema_ranges {
range_bounds {
rows: "\006\001d\000\000\000\000\000\000\000\007\001\310\000\000\000\000\000\000\000""\006\001d\000\000\000\000\000\000\000\007\001\310\000\000\000\000\000\000\000"
indirect_data: """"
}
hash_schema {
columns {
name: "col"
}
num_buckets: 2
seed: 0
}
}
}
I20260926 13:55:00.285279 5162 tablet_service.cc:1511] Processing CreateTablet for tablet 25cfff33401a4946a9e434b6cdcbea6b (DEFAULT_TABLE table=table [id=446a0d6142b8463f86d913708e1a72f7]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:00.286595 5162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25cfff33401a4946a9e434b6cdcbea6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:00.286324 5161 tablet_service.cc:1511] Processing CreateTablet for tablet 6af66947d0414ddeb891bc217548a53d (DEFAULT_TABLE table=table [id=446a0d6142b8463f86d913708e1a72f7]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 100 <= VALUES < 200
I20260926 13:55:00.287518 5161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af66947d0414ddeb891bc217548a53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:00.288666 5158 tablet_service.cc:1511] Processing CreateTablet for tablet d1de5a093dae4d9dbb8206d18dda9efe (DEFAULT_TABLE table=table [id=446a0d6142b8463f86d913708e1a72f7]), partition=HASH (col) PARTITION 2, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:00.289906 5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1de5a093dae4d9dbb8206d18dda9efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:00.287533 5157 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca777284d024314ba43ad154b4d605e (DEFAULT_TABLE table=table [id=446a0d6142b8463f86d913708e1a72f7]), partition=HASH (col) PARTITION 3, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:00.291445 5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca777284d024314ba43ad154b4d605e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:00.293906 5159 tablet_service.cc:1511] Processing CreateTablet for tablet 479f869d9ded4d88bdb85f8e709d0725 (DEFAULT_TABLE table=table [id=446a0d6142b8463f86d913708e1a72f7]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 100 <= VALUES < 200
I20260926 13:55:00.295060 5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479f869d9ded4d88bdb85f8e709d0725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:00.297940 5160 tablet_service.cc:1511] Processing CreateTablet for tablet 74c50713660d46d6a697131606446e8d (DEFAULT_TABLE table=table [id=446a0d6142b8463f86d913708e1a72f7]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:00.299142 5160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c50713660d46d6a697131606446e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:00.308868 5209 tablet_bootstrap.cc:492] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b: Bootstrap starting.
I20260926 13:55:00.315236 5209 tablet_bootstrap.cc:654] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:00.325974 5209 tablet_bootstrap.cc:492] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b: No bootstrap required, opened a new log
I20260926 13:55:00.326370 5209 ts_tablet_manager.cc:1403] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.011s
I20260926 13:55:00.328336 5209 raft_consensus.cc:359] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.328727 5209 raft_consensus.cc:385] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:00.329035 5209 raft_consensus.cc:740] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Initialized, Role: FOLLOWER
I20260926 13:55:00.329785 5209 consensus_queue.cc:260] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.330439 5209 raft_consensus.cc:399] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:00.330824 5209 raft_consensus.cc:493] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:00.331141 5209 raft_consensus.cc:3060] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:00.337101 5209 raft_consensus.cc:515] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.337750 5209 leader_election.cc:304] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118e7061736e4f8b940e48fcf68ece7b; no voters:
I20260926 13:55:00.339650 5209 leader_election.cc:290] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:00.340008 5211 raft_consensus.cc:2804] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:00.341333 5197 heartbeater.cc:499] Master 127.3.127.190:39993 was elected leader, sending a full tablet report...
I20260926 13:55:00.341742 5211 raft_consensus.cc:697] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Becoming Leader. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Running, Role: LEADER
I20260926 13:55:00.342553 5209 ts_tablet_manager.cc:1434] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260926 13:55:00.342432 5211 consensus_queue.cc:237] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.343210 5209 tablet_bootstrap.cc:492] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b: Bootstrap starting.
I20260926 13:55:00.350771 5209 tablet_bootstrap.cc:654] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:00.353134 5069 catalog_manager.cc:5838] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 118e7061736e4f8b940e48fcf68ece7b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "118e7061736e4f8b940e48fcf68ece7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:00.354681 5209 tablet_bootstrap.cc:492] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b: No bootstrap required, opened a new log
I20260926 13:55:00.355007 5209 ts_tablet_manager.cc:1403] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260926 13:55:00.357234 5209 raft_consensus.cc:359] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.357738 5209 raft_consensus.cc:385] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:00.358001 5209 raft_consensus.cc:740] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Initialized, Role: FOLLOWER
I20260926 13:55:00.358530 5209 consensus_queue.cc:260] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.359016 5209 raft_consensus.cc:399] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:00.359313 5209 raft_consensus.cc:493] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:00.359568 5209 raft_consensus.cc:3060] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:00.365145 5209 raft_consensus.cc:515] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.365774 5209 leader_election.cc:304] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118e7061736e4f8b940e48fcf68ece7b; no voters:
I20260926 13:55:00.366354 5209 leader_election.cc:290] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:00.366634 5213 raft_consensus.cc:2804] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:00.367067 5213 raft_consensus.cc:697] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Becoming Leader. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Running, Role: LEADER
I20260926 13:55:00.367641 5209 ts_tablet_manager.cc:1434] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260926 13:55:00.367695 5213 consensus_queue.cc:237] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.368251 5209 tablet_bootstrap.cc:492] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b: Bootstrap starting.
I20260926 13:55:00.373644 5209 tablet_bootstrap.cc:654] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:00.380163 5069 catalog_manager.cc:5838] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 118e7061736e4f8b940e48fcf68ece7b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "118e7061736e4f8b940e48fcf68ece7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:00.382089 5209 tablet_bootstrap.cc:492] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b: No bootstrap required, opened a new log
I20260926 13:55:00.382570 5209 ts_tablet_manager.cc:1403] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
I20260926 13:55:00.384354 5209 raft_consensus.cc:359] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.384820 5209 raft_consensus.cc:385] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:00.385114 5209 raft_consensus.cc:740] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Initialized, Role: FOLLOWER
I20260926 13:55:00.385841 5209 consensus_queue.cc:260] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.386474 5209 raft_consensus.cc:399] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:00.386722 5209 raft_consensus.cc:493] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:00.386978 5209 raft_consensus.cc:3060] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:00.391395 5209 raft_consensus.cc:515] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.391860 5209 leader_election.cc:304] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118e7061736e4f8b940e48fcf68ece7b; no voters:
I20260926 13:55:00.392297 5209 leader_election.cc:290] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:00.392447 5213 raft_consensus.cc:2804] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:00.393122 5213 raft_consensus.cc:697] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Becoming Leader. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Running, Role: LEADER
I20260926 13:55:00.393915 5209 ts_tablet_manager.cc:1434] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260926 13:55:00.393772 5213 consensus_queue.cc:237] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.394728 5209 tablet_bootstrap.cc:492] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b: Bootstrap starting.
I20260926 13:55:00.399505 5069 catalog_manager.cc:5838] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 118e7061736e4f8b940e48fcf68ece7b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "118e7061736e4f8b940e48fcf68ece7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:00.400528 5209 tablet_bootstrap.cc:654] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:00.405504 5209 tablet_bootstrap.cc:492] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b: No bootstrap required, opened a new log
I20260926 13:55:00.405890 5209 ts_tablet_manager.cc:1403] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20260926 13:55:00.407864 5209 raft_consensus.cc:359] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.408277 5209 raft_consensus.cc:385] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:00.408488 5209 raft_consensus.cc:740] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Initialized, Role: FOLLOWER
I20260926 13:55:00.409024 5209 consensus_queue.cc:260] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.409463 5209 raft_consensus.cc:399] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:00.409745 5209 raft_consensus.cc:493] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:00.410048 5209 raft_consensus.cc:3060] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:00.415472 5209 raft_consensus.cc:515] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.415999 5209 leader_election.cc:304] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118e7061736e4f8b940e48fcf68ece7b; no voters:
I20260926 13:55:00.416523 5209 leader_election.cc:290] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:00.416680 5213 raft_consensus.cc:2804] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:00.417157 5213 raft_consensus.cc:697] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Becoming Leader. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Running, Role: LEADER
I20260926 13:55:00.417876 5209 ts_tablet_manager.cc:1434] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260926 13:55:00.417788 5213 consensus_queue.cc:237] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.418582 5209 tablet_bootstrap.cc:492] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b: Bootstrap starting.
I20260926 13:55:00.423596 5209 tablet_bootstrap.cc:654] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:00.425185 5069 catalog_manager.cc:5838] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 118e7061736e4f8b940e48fcf68ece7b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "118e7061736e4f8b940e48fcf68ece7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:00.431277 5209 tablet_bootstrap.cc:492] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b: No bootstrap required, opened a new log
I20260926 13:55:00.431715 5209 ts_tablet_manager.cc:1403] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.008s
I20260926 13:55:00.434252 5209 raft_consensus.cc:359] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.434780 5209 raft_consensus.cc:385] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:00.435060 5209 raft_consensus.cc:740] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Initialized, Role: FOLLOWER
I20260926 13:55:00.435717 5209 consensus_queue.cc:260] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.436405 5209 raft_consensus.cc:399] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:00.436815 5209 raft_consensus.cc:493] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:00.437218 5209 raft_consensus.cc:3060] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:00.443975 5209 raft_consensus.cc:515] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.444614 5209 leader_election.cc:304] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118e7061736e4f8b940e48fcf68ece7b; no voters:
I20260926 13:55:00.445246 5209 leader_election.cc:290] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:00.445366 5213 raft_consensus.cc:2804] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:00.445806 5213 raft_consensus.cc:697] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Becoming Leader. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Running, Role: LEADER
I20260926 13:55:00.446491 5213 consensus_queue.cc:237] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.446960 5209 ts_tablet_manager.cc:1434] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260926 13:55:00.447796 5209 tablet_bootstrap.cc:492] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b: Bootstrap starting.
I20260926 13:55:00.453668 5209 tablet_bootstrap.cc:654] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:00.454478 5069 catalog_manager.cc:5838] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 118e7061736e4f8b940e48fcf68ece7b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "118e7061736e4f8b940e48fcf68ece7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:00.457477 5209 tablet_bootstrap.cc:492] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b: No bootstrap required, opened a new log
I20260926 13:55:00.457834 5209 ts_tablet_manager.cc:1403] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260926 13:55:00.460632 5209 raft_consensus.cc:359] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.461110 5209 raft_consensus.cc:385] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:00.461356 5209 raft_consensus.cc:740] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Initialized, Role: FOLLOWER
I20260926 13:55:00.461912 5209 consensus_queue.cc:260] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.462440 5209 raft_consensus.cc:399] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:00.462697 5209 raft_consensus.cc:493] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:00.462972 5209 raft_consensus.cc:3060] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:00.468068 5209 raft_consensus.cc:515] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.468516 5209 leader_election.cc:304] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 118e7061736e4f8b940e48fcf68ece7b; no voters:
I20260926 13:55:00.468952 5209 leader_election.cc:290] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:00.469086 5213 raft_consensus.cc:2804] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:00.469491 5213 raft_consensus.cc:697] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Becoming Leader. State: Replica: 118e7061736e4f8b940e48fcf68ece7b, State: Running, Role: LEADER
I20260926 13:55:00.470130 5213 consensus_queue.cc:237] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } }
I20260926 13:55:00.470711 5209 ts_tablet_manager.cc:1434] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
I20260926 13:55:00.475808 5069 catalog_manager.cc:5838] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 118e7061736e4f8b940e48fcf68ece7b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "118e7061736e4f8b940e48fcf68ece7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "118e7061736e4f8b940e48fcf68ece7b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45481 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:01.348737 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:01.364586 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:01.365249 3582 tablet_replica.cc:333] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b: stopping tablet replica
I20260926 13:55:01.365757 3582 raft_consensus.cc:2243] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:01.366291 3582 raft_consensus.cc:2272] T 479f869d9ded4d88bdb85f8e709d0725 P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:01.368283 3582 tablet_replica.cc:333] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b: stopping tablet replica
I20260926 13:55:01.368705 3582 raft_consensus.cc:2243] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:01.369120 3582 raft_consensus.cc:2272] T 25cfff33401a4946a9e434b6cdcbea6b P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:01.371042 3582 tablet_replica.cc:333] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b: stopping tablet replica
I20260926 13:55:01.371444 3582 raft_consensus.cc:2243] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:01.371785 3582 raft_consensus.cc:2272] T 6af66947d0414ddeb891bc217548a53d P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:01.373665 3582 tablet_replica.cc:333] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b: stopping tablet replica
I20260926 13:55:01.374079 3582 raft_consensus.cc:2243] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:01.374462 3582 raft_consensus.cc:2272] T d1de5a093dae4d9dbb8206d18dda9efe P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:01.376330 3582 tablet_replica.cc:333] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b: stopping tablet replica
I20260926 13:55:01.376727 3582 raft_consensus.cc:2243] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:01.377162 3582 raft_consensus.cc:2272] T 74c50713660d46d6a697131606446e8d P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:01.379097 3582 tablet_replica.cc:333] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b: stopping tablet replica
I20260926 13:55:01.379469 3582 raft_consensus.cc:2243] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:01.379827 3582 raft_consensus.cc:2272] T 9ca777284d024314ba43ad154b4d605e P 118e7061736e4f8b940e48fcf68ece7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:01.402786 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:01.415619 3582 master.cc:562] Master@127.3.127.190:39993 shutting down...
I20260926 13:55:01.429840 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:01.430294 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:01.430603 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P e253c821c0804010a84da6c14a5cf398: stopping tablet replica
I20260926 13:55:01.449340 3582 master.cc:584] Master@127.3.127.190:39993 shutdown complete.
[ OK ] ScanTokenTest.ScanTokensWithCustomHashSchemasPerRange (1602 ms)
[ RUN ] ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange
I20260926 13:55:01.475796 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:34315
I20260926 13:55:01.476859 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:01.481686 5383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:01.482615 5384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:01.483250 5386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:01.483986 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:01.484699 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:01.484933 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:01.485056 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430901485045 us; error 0 us; skew 500 ppm
I20260926 13:55:01.485464 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:01.487627 3582 webserver.cc:533] Webserver started at http://127.3.127.190:46773/ using document root <none> and password file <none>
I20260926 13:55:01.487994 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:01.488137 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:01.488333 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:01.489346 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "75bdf53a911f46b5a55866efa9f24ad5"
format_stamp: "Formatted at 2026-09-26 13:55:01 on dist-test-slave-fk7n"
I20260926 13:55:01.493386 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260926 13:55:01.496254 5391 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:01.496918 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:01.497167 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "75bdf53a911f46b5a55866efa9f24ad5"
format_stamp: "Formatted at 2026-09-26 13:55:01 on dist-test-slave-fk7n"
I20260926 13:55:01.497416 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:01.519464 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:01.520558 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:01.554956 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:34315
I20260926 13:55:01.555048 5442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:34315 every 8 connection(s)
I20260926 13:55:01.558605 5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:01.567914 5443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5: Bootstrap starting.
I20260926 13:55:01.572192 5443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:01.576077 5443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5: No bootstrap required, opened a new log
I20260926 13:55:01.578025 5443 raft_consensus.cc:359] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75bdf53a911f46b5a55866efa9f24ad5" member_type: VOTER }
I20260926 13:55:01.578406 5443 raft_consensus.cc:385] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:01.578622 5443 raft_consensus.cc:740] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75bdf53a911f46b5a55866efa9f24ad5, State: Initialized, Role: FOLLOWER
I20260926 13:55:01.579149 5443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75bdf53a911f46b5a55866efa9f24ad5" member_type: VOTER }
I20260926 13:55:01.579581 5443 raft_consensus.cc:399] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:01.579783 5443 raft_consensus.cc:493] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:01.580006 5443 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:01.583734 5443 raft_consensus.cc:515] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75bdf53a911f46b5a55866efa9f24ad5" member_type: VOTER }
I20260926 13:55:01.584175 5443 leader_election.cc:304] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75bdf53a911f46b5a55866efa9f24ad5; no voters:
I20260926 13:55:01.585134 5443 leader_election.cc:290] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:01.585440 5446 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:01.586624 5446 raft_consensus.cc:697] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 75bdf53a911f46b5a55866efa9f24ad5, State: Running, Role: LEADER
I20260926 13:55:01.587212 5446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75bdf53a911f46b5a55866efa9f24ad5" member_type: VOTER }
I20260926 13:55:01.587699 5443 sys_catalog.cc:565] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:01.590003 5448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75bdf53a911f46b5a55866efa9f24ad5. Latest consensus state: current_term: 1 leader_uuid: "75bdf53a911f46b5a55866efa9f24ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75bdf53a911f46b5a55866efa9f24ad5" member_type: VOTER } }
I20260926 13:55:01.589974 5447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75bdf53a911f46b5a55866efa9f24ad5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75bdf53a911f46b5a55866efa9f24ad5" member_type: VOTER } }
I20260926 13:55:01.590607 5448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:01.590747 5447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:01.593438 5452 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:01.600081 5452 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:01.600980 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:01.607620 5452 catalog_manager.cc:1396] Generated new cluster ID: 82a2ccd3a8b94edcad836a4512987d7b
I20260926 13:55:01.607826 5452 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:01.623644 5452 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:01.624670 5452 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:01.636174 5452 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5: Generated new TSK 0
I20260926 13:55:01.636619 5452 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:01.666863 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:01.671943 5464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:01.672711 5465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:01.674006 5467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:01.674836 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:01.675586 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:01.675762 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:01.675927 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430901675901 us; error 0 us; skew 500 ppm
I20260926 13:55:01.676403 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:01.678411 3582 webserver.cc:533] Webserver started at http://127.3.127.129:38553/ using document root <none> and password file <none>
I20260926 13:55:01.678833 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:01.678990 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:01.679234 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:01.680245 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "c21f0c3458264ca5a3b62dd64133f0ca"
format_stamp: "Formatted at 2026-09-26 13:55:01 on dist-test-slave-fk7n"
I20260926 13:55:01.684270 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:55:01.687145 5472 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:01.687805 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:01.688043 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "c21f0c3458264ca5a3b62dd64133f0ca"
format_stamp: "Formatted at 2026-09-26 13:55:01 on dist-test-slave-fk7n"
I20260926 13:55:01.688282 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:01.710691 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:01.711621 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:01.712975 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:01.714973 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:01.715150 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:01.715353 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:01.715492 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:01.750887 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:35333
I20260926 13:55:01.751010 5534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:35333 every 8 connection(s)
I20260926 13:55:01.763792 5535 heartbeater.cc:344] Connected to a master server at 127.3.127.190:34315
I20260926 13:55:01.764104 5535 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:01.764719 5535 heartbeater.cc:507] Master 127.3.127.190:34315 requested a full tablet report, sending...
I20260926 13:55:01.766532 5408 ts_manager.cc:194] Registered new tserver with Master: c21f0c3458264ca5a3b62dd64133f0ca (127.3.127.129:35333)
I20260926 13:55:01.766563 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012774406s
I20260926 13:55:01.768122 5408 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37694
I20260926 13:55:01.785750 5408 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37698:
name: "table"
schema {
columns {
name: "col"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "col"
}
num_buckets: 2
seed: 0
}
custom_hash_schema_ranges {
range_bounds {
rows: "\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
hash_schema {
columns {
name: "col"
}
num_buckets: 4
seed: 0
}
}
custom_hash_schema_ranges {
range_bounds {
rows: "\006\001\310\000\000\000\000\000\000\000\007\001,\001\000\000\000\000\000\000""\006\001\310\000\000\000\000\000\000\000\007\001,\001\000\000\000\000\000\000"
indirect_data: """"
}
hash_schema {
columns {
name: "col"
}
num_buckets: 2
seed: 0
}
}
}
I20260926 13:55:01.822861 5500 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca26eeafb9048269be6f797c33392cc (DEFAULT_TABLE table=table [id=8195a03f97014fb39b7b7db8fbd5431e]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:01.823058 5499 tablet_service.cc:1511] Processing CreateTablet for tablet a1fdda35953b48dd94ebba4b0c3cd62e (DEFAULT_TABLE table=table [id=8195a03f97014fb39b7b7db8fbd5431e]), partition=HASH (col) PARTITION 0, RANGE (col) PARTITION 200 <= VALUES < 300
I20260926 13:55:01.823491 5498 tablet_service.cc:1511] Processing CreateTablet for tablet bf07ded037ce4e5c9ae7836829f414fd (DEFAULT_TABLE table=table [id=8195a03f97014fb39b7b7db8fbd5431e]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:01.823793 5497 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee592335ac14c8d8a8163ba11fb829d (DEFAULT_TABLE table=table [id=8195a03f97014fb39b7b7db8fbd5431e]), partition=HASH (col) PARTITION 1, RANGE (col) PARTITION 200 <= VALUES < 300
I20260926 13:55:01.824288 5500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca26eeafb9048269be6f797c33392cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:01.824832 5498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf07ded037ce4e5c9ae7836829f414fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:01.825350 5499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1fdda35953b48dd94ebba4b0c3cd62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:01.826489 5496 tablet_service.cc:1511] Processing CreateTablet for tablet 0b6f589285244a23b6712789bc0ff188 (DEFAULT_TABLE table=table [id=8195a03f97014fb39b7b7db8fbd5431e]), partition=HASH (col) PARTITION 2, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:01.827682 5496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b6f589285244a23b6712789bc0ff188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:01.833456 5497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee592335ac14c8d8a8163ba11fb829d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:01.834849 5495 tablet_service.cc:1511] Processing CreateTablet for tablet 0921327efbba4376b179a74be34db6c0 (DEFAULT_TABLE table=table [id=8195a03f97014fb39b7b7db8fbd5431e]), partition=HASH (col) PARTITION 3, RANGE (col) PARTITION 0 <= VALUES < 100
I20260926 13:55:01.836082 5495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0921327efbba4376b179a74be34db6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:01.851173 5547 tablet_bootstrap.cc:492] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca: Bootstrap starting.
I20260926 13:55:01.857331 5547 tablet_bootstrap.cc:654] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:01.861656 5547 tablet_bootstrap.cc:492] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca: No bootstrap required, opened a new log
I20260926 13:55:01.861964 5547 ts_tablet_manager.cc:1403] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260926 13:55:01.863754 5547 raft_consensus.cc:359] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.864141 5547 raft_consensus.cc:385] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:01.864341 5547 raft_consensus.cc:740] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Initialized, Role: FOLLOWER
I20260926 13:55:01.864872 5547 consensus_queue.cc:260] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.865309 5547 raft_consensus.cc:399] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:01.865520 5547 raft_consensus.cc:493] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:01.865749 5547 raft_consensus.cc:3060] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:01.870338 5547 raft_consensus.cc:515] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.870821 5547 leader_election.cc:304] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c21f0c3458264ca5a3b62dd64133f0ca; no voters:
I20260926 13:55:01.871830 5547 leader_election.cc:290] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:01.872202 5549 raft_consensus.cc:2804] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:01.873464 5535 heartbeater.cc:499] Master 127.3.127.190:34315 was elected leader, sending a full tablet report...
I20260926 13:55:01.873394 5549 raft_consensus.cc:697] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Becoming Leader. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Running, Role: LEADER
I20260926 13:55:01.874176 5549 consensus_queue.cc:237] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.874539 5547 ts_tablet_manager.cc:1434] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260926 13:55:01.875347 5547 tablet_bootstrap.cc:492] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca: Bootstrap starting.
I20260926 13:55:01.880936 5547 tablet_bootstrap.cc:654] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:01.883105 5407 catalog_manager.cc:5838] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c21f0c3458264ca5a3b62dd64133f0ca (127.3.127.129). New cstate: current_term: 1 leader_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:01.884968 5547 tablet_bootstrap.cc:492] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca: No bootstrap required, opened a new log
I20260926 13:55:01.885289 5547 ts_tablet_manager.cc:1403] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260926 13:55:01.887722 5547 raft_consensus.cc:359] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.888096 5547 raft_consensus.cc:385] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:01.888345 5547 raft_consensus.cc:740] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Initialized, Role: FOLLOWER
I20260926 13:55:01.888993 5547 consensus_queue.cc:260] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.889400 5547 raft_consensus.cc:399] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:01.889612 5547 raft_consensus.cc:493] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:01.889884 5547 raft_consensus.cc:3060] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:01.896018 5547 raft_consensus.cc:515] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.896641 5547 leader_election.cc:304] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c21f0c3458264ca5a3b62dd64133f0ca; no voters:
I20260926 13:55:01.897225 5547 leader_election.cc:290] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:01.897341 5549 raft_consensus.cc:2804] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:01.897747 5549 raft_consensus.cc:697] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Becoming Leader. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Running, Role: LEADER
I20260926 13:55:01.898386 5549 consensus_queue.cc:237] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.898785 5547 ts_tablet_manager.cc:1434] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260926 13:55:01.899662 5547 tablet_bootstrap.cc:492] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca: Bootstrap starting.
I20260926 13:55:01.904122 5407 catalog_manager.cc:5838] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c21f0c3458264ca5a3b62dd64133f0ca (127.3.127.129). New cstate: current_term: 1 leader_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:01.905427 5547 tablet_bootstrap.cc:654] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:01.909543 5547 tablet_bootstrap.cc:492] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca: No bootstrap required, opened a new log
I20260926 13:55:01.909847 5547 ts_tablet_manager.cc:1403] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260926 13:55:01.912277 5547 raft_consensus.cc:359] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.912791 5547 raft_consensus.cc:385] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:01.913064 5547 raft_consensus.cc:740] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Initialized, Role: FOLLOWER
I20260926 13:55:01.913571 5547 consensus_queue.cc:260] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.913992 5547 raft_consensus.cc:399] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:01.914209 5547 raft_consensus.cc:493] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:01.914454 5547 raft_consensus.cc:3060] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:01.918742 5547 raft_consensus.cc:515] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.919201 5547 leader_election.cc:304] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c21f0c3458264ca5a3b62dd64133f0ca; no voters:
I20260926 13:55:01.919634 5547 leader_election.cc:290] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:01.919759 5549 raft_consensus.cc:2804] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:01.920207 5549 raft_consensus.cc:697] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Becoming Leader. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Running, Role: LEADER
I20260926 13:55:01.920948 5547 ts_tablet_manager.cc:1434] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca: Time spent starting tablet: real 0.011s user 0.009s sys 0.003s
I20260926 13:55:01.920805 5549 consensus_queue.cc:237] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.921581 5547 tablet_bootstrap.cc:492] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca: Bootstrap starting.
I20260926 13:55:01.925638 5407 catalog_manager.cc:5838] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c21f0c3458264ca5a3b62dd64133f0ca (127.3.127.129). New cstate: current_term: 1 leader_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:01.926683 5547 tablet_bootstrap.cc:654] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:01.930423 5547 tablet_bootstrap.cc:492] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca: No bootstrap required, opened a new log
I20260926 13:55:01.930830 5547 ts_tablet_manager.cc:1403] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260926 13:55:01.932893 5547 raft_consensus.cc:359] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.933302 5547 raft_consensus.cc:385] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:01.933518 5547 raft_consensus.cc:740] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Initialized, Role: FOLLOWER
I20260926 13:55:01.934031 5547 consensus_queue.cc:260] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.934546 5547 raft_consensus.cc:399] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:01.934827 5547 raft_consensus.cc:493] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:01.935134 5547 raft_consensus.cc:3060] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:01.939967 5547 raft_consensus.cc:515] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.940404 5547 leader_election.cc:304] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c21f0c3458264ca5a3b62dd64133f0ca; no voters:
I20260926 13:55:01.940868 5547 leader_election.cc:290] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:01.940991 5549 raft_consensus.cc:2804] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:01.941418 5549 raft_consensus.cc:697] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Becoming Leader. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Running, Role: LEADER
I20260926 13:55:01.942142 5547 ts_tablet_manager.cc:1434] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260926 13:55:01.942030 5549 consensus_queue.cc:237] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.942777 5547 tablet_bootstrap.cc:492] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca: Bootstrap starting.
I20260926 13:55:01.947284 5408 catalog_manager.cc:5838] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c21f0c3458264ca5a3b62dd64133f0ca (127.3.127.129). New cstate: current_term: 1 leader_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:01.948802 5547 tablet_bootstrap.cc:654] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:01.952847 5547 tablet_bootstrap.cc:492] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca: No bootstrap required, opened a new log
I20260926 13:55:01.953226 5547 ts_tablet_manager.cc:1403] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260926 13:55:01.955328 5547 raft_consensus.cc:359] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.955821 5547 raft_consensus.cc:385] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:01.956099 5547 raft_consensus.cc:740] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Initialized, Role: FOLLOWER
I20260926 13:55:01.956635 5547 consensus_queue.cc:260] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.957100 5547 raft_consensus.cc:399] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:01.957332 5547 raft_consensus.cc:493] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:01.957653 5547 raft_consensus.cc:3060] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:01.962155 5547 raft_consensus.cc:515] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.962597 5547 leader_election.cc:304] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c21f0c3458264ca5a3b62dd64133f0ca; no voters:
I20260926 13:55:01.963011 5547 leader_election.cc:290] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:01.963126 5549 raft_consensus.cc:2804] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:01.963537 5549 raft_consensus.cc:697] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Becoming Leader. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Running, Role: LEADER
I20260926 13:55:01.964250 5547 ts_tablet_manager.cc:1434] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260926 13:55:01.964169 5549 consensus_queue.cc:237] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.964916 5547 tablet_bootstrap.cc:492] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca: Bootstrap starting.
I20260926 13:55:01.970376 5547 tablet_bootstrap.cc:654] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:01.970062 5408 catalog_manager.cc:5838] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c21f0c3458264ca5a3b62dd64133f0ca (127.3.127.129). New cstate: current_term: 1 leader_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:01.974363 5547 tablet_bootstrap.cc:492] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca: No bootstrap required, opened a new log
I20260926 13:55:01.974670 5547 ts_tablet_manager.cc:1403] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20260926 13:55:01.976716 5547 raft_consensus.cc:359] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.977099 5547 raft_consensus.cc:385] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:01.977296 5547 raft_consensus.cc:740] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Initialized, Role: FOLLOWER
I20260926 13:55:01.977835 5547 consensus_queue.cc:260] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.978354 5547 raft_consensus.cc:399] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:01.978634 5547 raft_consensus.cc:493] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:01.978922 5547 raft_consensus.cc:3060] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:01.982874 5547 raft_consensus.cc:515] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.983291 5547 leader_election.cc:304] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c21f0c3458264ca5a3b62dd64133f0ca; no voters:
I20260926 13:55:01.983695 5547 leader_election.cc:290] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:01.983810 5549 raft_consensus.cc:2804] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:01.984244 5549 raft_consensus.cc:697] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Becoming Leader. State: Replica: c21f0c3458264ca5a3b62dd64133f0ca, State: Running, Role: LEADER
I20260926 13:55:01.984882 5547 ts_tablet_manager.cc:1434] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260926 13:55:01.984855 5549 consensus_queue.cc:237] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } }
I20260926 13:55:01.989524 5408 catalog_manager.cc:5838] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c21f0c3458264ca5a3b62dd64133f0ca (127.3.127.129). New cstate: current_term: 1 leader_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c21f0c3458264ca5a3b62dd64133f0ca" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 35333 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:03.170013 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:03.184051 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:03.184598 3582 tablet_replica.cc:333] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca: stopping tablet replica
I20260926 13:55:03.185110 3582 raft_consensus.cc:2243] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.185509 3582 raft_consensus.cc:2272] T bf07ded037ce4e5c9ae7836829f414fd P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.186977 3582 tablet_replica.cc:333] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca: stopping tablet replica
I20260926 13:55:03.187423 3582 raft_consensus.cc:2243] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.187789 3582 raft_consensus.cc:2272] T 0921327efbba4376b179a74be34db6c0 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.189229 3582 tablet_replica.cc:333] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca: stopping tablet replica
I20260926 13:55:03.189661 3582 raft_consensus.cc:2243] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.190055 3582 raft_consensus.cc:2272] T a1fdda35953b48dd94ebba4b0c3cd62e P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.191440 3582 tablet_replica.cc:333] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca: stopping tablet replica
I20260926 13:55:03.191859 3582 raft_consensus.cc:2243] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.192211 3582 raft_consensus.cc:2272] T 0ca26eeafb9048269be6f797c33392cc P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.193584 3582 tablet_replica.cc:333] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca: stopping tablet replica
I20260926 13:55:03.193984 3582 raft_consensus.cc:2243] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.194330 3582 raft_consensus.cc:2272] T 4ee592335ac14c8d8a8163ba11fb829d P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.195675 3582 tablet_replica.cc:333] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca: stopping tablet replica
I20260926 13:55:03.196090 3582 raft_consensus.cc:2243] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.196441 3582 raft_consensus.cc:2272] T 0b6f589285244a23b6712789bc0ff188 P c21f0c3458264ca5a3b62dd64133f0ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.219122 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:03.234311 3582 master.cc:562] Master@127.3.127.190:34315 shutting down...
I20260926 13:55:03.256206 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.256727 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.257103 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 75bdf53a911f46b5a55866efa9f24ad5: stopping tablet replica
I20260926 13:55:03.275068 3582 master.cc:584] Master@127.3.127.190:34315 shutdown complete.
[ OK ] ScanTokenTest.TestScanTokensWithCustomHashSchemasPerNonCoveringRange (1819 ms)
[ RUN ] ScanTokenTest.TestConcurrentAlterTable
I20260926 13:55:03.295116 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:44573
I20260926 13:55:03.296059 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:03.300287 5805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:03.300884 5806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:03.302579 5808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:03.302721 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:03.303390 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:03.303558 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:03.303697 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430903303681 us; error 0 us; skew 500 ppm
I20260926 13:55:03.304157 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:03.306187 3582 webserver.cc:533] Webserver started at http://127.3.127.190:35163/ using document root <none> and password file <none>
I20260926 13:55:03.306583 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:03.306740 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:03.306965 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:03.307884 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "3a6c06adace746928808ee7bbcd49353"
format_stamp: "Formatted at 2026-09-26 13:55:03 on dist-test-slave-fk7n"
I20260926 13:55:03.311738 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260926 13:55:03.314550 5813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:03.315162 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:55:03.315394 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "3a6c06adace746928808ee7bbcd49353"
format_stamp: "Formatted at 2026-09-26 13:55:03 on dist-test-slave-fk7n"
I20260926 13:55:03.315627 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:03.332228 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:03.333141 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:03.364255 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:44573
I20260926 13:55:03.364339 5864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:44573 every 8 connection(s)
I20260926 13:55:03.367621 5865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:03.376821 5865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: Bootstrap starting.
I20260926 13:55:03.380561 5865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:03.384212 5865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: No bootstrap required, opened a new log
I20260926 13:55:03.386219 5865 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6c06adace746928808ee7bbcd49353" member_type: VOTER }
I20260926 13:55:03.386555 5865 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:03.386780 5865 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6c06adace746928808ee7bbcd49353, State: Initialized, Role: FOLLOWER
I20260926 13:55:03.387308 5865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6c06adace746928808ee7bbcd49353" member_type: VOTER }
I20260926 13:55:03.387727 5865 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:03.387931 5865 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:03.388165 5865 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:03.391892 5865 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6c06adace746928808ee7bbcd49353" member_type: VOTER }
I20260926 13:55:03.392329 5865 leader_election.cc:304] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a6c06adace746928808ee7bbcd49353; no voters:
I20260926 13:55:03.393290 5865 leader_election.cc:290] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:03.393522 5868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:03.394640 5868 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 1 LEADER]: Becoming Leader. State: Replica: 3a6c06adace746928808ee7bbcd49353, State: Running, Role: LEADER
I20260926 13:55:03.395133 5868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6c06adace746928808ee7bbcd49353" member_type: VOTER }
I20260926 13:55:03.395788 5865 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:03.397686 5869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a6c06adace746928808ee7bbcd49353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6c06adace746928808ee7bbcd49353" member_type: VOTER } }
I20260926 13:55:03.397699 5870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a6c06adace746928808ee7bbcd49353. Latest consensus state: current_term: 1 leader_uuid: "3a6c06adace746928808ee7bbcd49353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a6c06adace746928808ee7bbcd49353" member_type: VOTER } }
I20260926 13:55:03.398342 5869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:03.398346 5870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:03.401126 5874 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:03.405769 5874 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:03.410504 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:03.413241 5874 catalog_manager.cc:1396] Generated new cluster ID: c11bf797306f46e69bc86d9268fc9189
I20260926 13:55:03.413498 5874 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:03.429101 5874 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:03.430203 5874 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:03.443503 5874 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: Generated new TSK 0
I20260926 13:55:03.443948 5874 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:03.476464 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:03.481644 5886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:03.482394 5887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:03.483784 5889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:03.484042 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:03.484781 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:03.484988 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:03.485126 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430903485111 us; error 0 us; skew 500 ppm
I20260926 13:55:03.485600 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:03.487509 3582 webserver.cc:533] Webserver started at http://127.3.127.129:45079/ using document root <none> and password file <none>
I20260926 13:55:03.487917 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:03.488085 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:03.488312 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:03.489302 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "6c58476b029f44abb1dfeaedecc72b61"
format_stamp: "Formatted at 2026-09-26 13:55:03 on dist-test-slave-fk7n"
I20260926 13:55:03.493345 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260926 13:55:03.496097 5894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:03.496784 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:03.497058 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "6c58476b029f44abb1dfeaedecc72b61"
format_stamp: "Formatted at 2026-09-26 13:55:03 on dist-test-slave-fk7n"
I20260926 13:55:03.497323 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentAlterTable.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:03.535140 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:03.536022 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:03.537317 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:03.539294 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:03.539479 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:03.539690 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:03.539841 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:03.574278 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:45875
I20260926 13:55:03.574358 5956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:45875 every 8 connection(s)
I20260926 13:55:03.586440 5957 heartbeater.cc:344] Connected to a master server at 127.3.127.190:44573
I20260926 13:55:03.586735 5957 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:03.587347 5957 heartbeater.cc:507] Master 127.3.127.190:44573 requested a full tablet report, sending...
I20260926 13:55:03.589098 5830 ts_manager.cc:194] Registered new tserver with Master: 6c58476b029f44abb1dfeaedecc72b61 (127.3.127.129:45875)
I20260926 13:55:03.589895 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012776046s
I20260926 13:55:03.590637 5830 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54290
I20260926 13:55:03.608336 5830 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54292:
name: "scan-token-alter"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "a"
type: INT64
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
I20260926 13:55:03.632558 5922 tablet_service.cc:1511] Processing CreateTablet for tablet 91abb5240f004e76b6996f93d8699160 (DEFAULT_TABLE table=scan-token-alter [id=a7863d86374e4f85a158df03cbc18660]), partition=
I20260926 13:55:03.633337 5922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91abb5240f004e76b6996f93d8699160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:03.643219 5969 tablet_bootstrap.cc:492] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Bootstrap starting.
I20260926 13:55:03.647009 5969 tablet_bootstrap.cc:654] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:03.650486 5969 tablet_bootstrap.cc:492] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: No bootstrap required, opened a new log
I20260926 13:55:03.650851 5969 ts_tablet_manager.cc:1403] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260926 13:55:03.652627 5969 raft_consensus.cc:359] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c58476b029f44abb1dfeaedecc72b61" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45875 } }
I20260926 13:55:03.653033 5969 raft_consensus.cc:385] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:03.653235 5969 raft_consensus.cc:740] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c58476b029f44abb1dfeaedecc72b61, State: Initialized, Role: FOLLOWER
I20260926 13:55:03.653756 5969 consensus_queue.cc:260] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c58476b029f44abb1dfeaedecc72b61" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45875 } }
I20260926 13:55:03.654194 5969 raft_consensus.cc:399] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:03.654433 5969 raft_consensus.cc:493] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:03.654680 5969 raft_consensus.cc:3060] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:03.658933 5969 raft_consensus.cc:515] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c58476b029f44abb1dfeaedecc72b61" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45875 } }
I20260926 13:55:03.659415 5969 leader_election.cc:304] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c58476b029f44abb1dfeaedecc72b61; no voters:
I20260926 13:55:03.660475 5969 leader_election.cc:290] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:03.660728 5971 raft_consensus.cc:2804] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:03.661921 5971 raft_consensus.cc:697] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 1 LEADER]: Becoming Leader. State: Replica: 6c58476b029f44abb1dfeaedecc72b61, State: Running, Role: LEADER
I20260926 13:55:03.662078 5957 heartbeater.cc:499] Master 127.3.127.190:44573 was elected leader, sending a full tablet report...
I20260926 13:55:03.662643 5969 ts_tablet_manager.cc:1434] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260926 13:55:03.662585 5971 consensus_queue.cc:237] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c58476b029f44abb1dfeaedecc72b61" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45875 } }
I20260926 13:55:03.667791 5830 catalog_manager.cc:5838] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c58476b029f44abb1dfeaedecc72b61 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6c58476b029f44abb1dfeaedecc72b61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c58476b029f44abb1dfeaedecc72b61" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45875 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:03.689769 5830 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54292:
table { table_name: "scan-token-alter" } alter_schema_steps { type: DROP_COLUMN drop_column { name: "a" } } modify_external_catalogs: true
I20260926 13:55:03.703467 5976 tablet.cc:1751] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Alter schema from (
10:key INT64 NOT NULL,
11:a INT64 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT64 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260926 13:55:03.705426 5976 tablet.cc:1649] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: MemRowSet was empty: no flush needed.
I20260926 13:55:03.721453 5830 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: scan-token-alter [id=a7863d86374e4f85a158df03cbc18660] alter complete (version 1)
I20260926 13:55:03.741596 5829 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54292:
table { table_name: "scan-token-alter" } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "a" type: STRING is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
I20260926 13:55:03.752662 5976 tablet.cc:1751] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Alter schema from (
10:key INT64 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT64 NOT NULL,
12:a STRING NULLABLE,
PRIMARY KEY (key)
) version 2
I20260926 13:55:03.754004 5976 tablet.cc:1649] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: MemRowSet was empty: no flush needed.
I20260926 13:55:03.769292 5829 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: scan-token-alter [id=a7863d86374e4f85a158df03cbc18660] alter complete (version 2)
I20260926 13:55:03.777000 5829 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54292:
table { table_name: "scan-token-alter" } alter_schema_steps { type: DROP_COLUMN drop_column { name: "a" } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "a" type: INT64 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
I20260926 13:55:03.787966 5976 tablet.cc:1751] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Alter schema from (
10:key INT64 NOT NULL,
12:a STRING NULLABLE,
PRIMARY KEY (key)
) version 2 to (
10:key INT64 NOT NULL,
13:a INT64 NULLABLE,
PRIMARY KEY (key)
) version 3
I20260926 13:55:03.789397 5976 tablet.cc:1649] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: MemRowSet was empty: no flush needed.
I20260926 13:55:03.804612 5830 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: scan-token-alter [id=a7863d86374e4f85a158df03cbc18660] alter complete (version 3)
I20260926 13:55:03.813709 5830 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54292:
table { table_name: "scan-token-alter" } alter_schema_steps { type: DROP_COLUMN drop_column { name: "a" } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "a" type: INT64 is_nullable: false read_default_value: "\000\000\000\000\000\000\000\000" encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
I20260926 13:55:03.825328 5976 tablet.cc:1751] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: Alter schema from (
10:key INT64 NOT NULL,
13:a INT64 NULLABLE,
PRIMARY KEY (key)
) version 3 to (
10:key INT64 NOT NULL,
14:a INT64 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260926 13:55:03.826629 5976 tablet.cc:1649] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: MemRowSet was empty: no flush needed.
I20260926 13:55:03.842027 5830 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: scan-token-alter [id=a7863d86374e4f85a158df03cbc18660] alter complete (version 4)
I20260926 13:55:03.848908 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:03.862108 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:03.862753 3582 tablet_replica.cc:333] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61: stopping tablet replica
I20260926 13:55:03.863224 3582 raft_consensus.cc:2243] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.863591 3582 raft_consensus.cc:2272] T 91abb5240f004e76b6996f93d8699160 P 6c58476b029f44abb1dfeaedecc72b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.872722 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:03.879730 3582 master.cc:562] Master@127.3.127.190:44573 shutting down...
I20260926 13:55:03.891824 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:03.892197 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:03.892520 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a6c06adace746928808ee7bbcd49353: stopping tablet replica
I20260926 13:55:03.910948 3582 master.cc:584] Master@127.3.127.190:44573 shutdown complete.
[ OK ] ScanTokenTest.TestConcurrentAlterTable (634 ms)
[ RUN ] ScanTokenTest.TestConcurrentRenameTable
I20260926 13:55:03.929937 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:36637
I20260926 13:55:03.930843 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:03.934934 5978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:03.935467 5979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:03.936287 5981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:03.937157 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:03.937716 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:03.937891 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:03.938000 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430903937990 us; error 0 us; skew 500 ppm
I20260926 13:55:03.938400 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:03.940241 3582 webserver.cc:533] Webserver started at http://127.3.127.190:32959/ using document root <none> and password file <none>
I20260926 13:55:03.940608 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:03.940778 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:03.941030 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:03.941927 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "440cdfec341f48b09754c81335326646"
format_stamp: "Formatted at 2026-09-26 13:55:03 on dist-test-slave-fk7n"
I20260926 13:55:03.945727 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260926 13:55:03.948501 5986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:03.949182 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:03.949394 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "440cdfec341f48b09754c81335326646"
format_stamp: "Formatted at 2026-09-26 13:55:03 on dist-test-slave-fk7n"
I20260926 13:55:03.949606 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:03.971413 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:03.972231 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:04.003049 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:36637
I20260926 13:55:04.003139 6037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:36637 every 8 connection(s)
I20260926 13:55:04.006373 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:04.015288 6038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646: Bootstrap starting.
I20260926 13:55:04.019057 6038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:04.022383 6038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646: No bootstrap required, opened a new log
I20260926 13:55:04.024117 6038 raft_consensus.cc:359] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "440cdfec341f48b09754c81335326646" member_type: VOTER }
I20260926 13:55:04.024487 6038 raft_consensus.cc:385] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:04.024688 6038 raft_consensus.cc:740] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 440cdfec341f48b09754c81335326646, State: Initialized, Role: FOLLOWER
I20260926 13:55:04.025218 6038 consensus_queue.cc:260] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "440cdfec341f48b09754c81335326646" member_type: VOTER }
I20260926 13:55:04.025632 6038 raft_consensus.cc:399] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:04.025831 6038 raft_consensus.cc:493] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:04.026062 6038 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:04.029937 6038 raft_consensus.cc:515] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "440cdfec341f48b09754c81335326646" member_type: VOTER }
I20260926 13:55:04.030390 6038 leader_election.cc:304] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 440cdfec341f48b09754c81335326646; no voters:
I20260926 13:55:04.031332 6038 leader_election.cc:290] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:04.031550 6041 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:04.032701 6041 raft_consensus.cc:697] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 1 LEADER]: Becoming Leader. State: Replica: 440cdfec341f48b09754c81335326646, State: Running, Role: LEADER
I20260926 13:55:04.033253 6041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "440cdfec341f48b09754c81335326646" member_type: VOTER }
I20260926 13:55:04.033834 6038 sys_catalog.cc:565] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:04.035663 6042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "440cdfec341f48b09754c81335326646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "440cdfec341f48b09754c81335326646" member_type: VOTER } }
I20260926 13:55:04.035708 6043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 440cdfec341f48b09754c81335326646. Latest consensus state: current_term: 1 leader_uuid: "440cdfec341f48b09754c81335326646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "440cdfec341f48b09754c81335326646" member_type: VOTER } }
I20260926 13:55:04.036291 6042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:04.036288 6043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:04.038929 6046 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:04.044359 6046 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:04.046399 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:04.052004 6046 catalog_manager.cc:1396] Generated new cluster ID: 17ebdcb76e5c404892c2bb3b1a25a5b2
I20260926 13:55:04.052250 6046 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:04.076301 6046 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:04.077457 6046 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:04.097026 6046 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646: Generated new TSK 0
I20260926 13:55:04.097548 6046 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:04.112607 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:04.117708 6059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:04.118391 6060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:04.120368 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:04.120535 6062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:04.121371 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:04.121563 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:04.121764 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430904121717 us; error 0 us; skew 500 ppm
I20260926 13:55:04.122227 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:04.124208 3582 webserver.cc:533] Webserver started at http://127.3.127.129:42773/ using document root <none> and password file <none>
I20260926 13:55:04.124617 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:04.124810 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:04.125041 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:04.125982 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "9b99d5aa63704dc899f73c5405eb883d"
format_stamp: "Formatted at 2026-09-26 13:55:04 on dist-test-slave-fk7n"
I20260926 13:55:04.129896 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260926 13:55:04.132704 6067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:04.133359 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:04.133599 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "9b99d5aa63704dc899f73c5405eb883d"
format_stamp: "Formatted at 2026-09-26 13:55:04 on dist-test-slave-fk7n"
I20260926 13:55:04.133859 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestConcurrentRenameTable.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:04.157063 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:04.157984 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:04.159264 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:04.161284 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:04.161473 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:04.161700 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:04.161854 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:04.195501 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:34177
I20260926 13:55:04.195585 6129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:34177 every 8 connection(s)
I20260926 13:55:04.207746 6130 heartbeater.cc:344] Connected to a master server at 127.3.127.190:36637
I20260926 13:55:04.208057 6130 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:04.208640 6130 heartbeater.cc:507] Master 127.3.127.190:36637 requested a full tablet report, sending...
I20260926 13:55:04.210366 6003 ts_manager.cc:194] Registered new tserver with Master: 9b99d5aa63704dc899f73c5405eb883d (127.3.127.129:34177)
I20260926 13:55:04.211256 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.01283733s
I20260926 13:55:04.211879 6003 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40262
I20260926 13:55:04.230518 6003 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40270:
name: "scan-token-rename"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "a"
type: INT64
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
I20260926 13:55:04.255956 6095 tablet_service.cc:1511] Processing CreateTablet for tablet 66fa4604e8f0466b98f1f0a46ffa315d (DEFAULT_TABLE table=scan-token-rename [id=dd9d6044f500434a9e7c53e9ab7149dc]), partition=
I20260926 13:55:04.256706 6095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fa4604e8f0466b98f1f0a46ffa315d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:04.266970 6142 tablet_bootstrap.cc:492] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d: Bootstrap starting.
I20260926 13:55:04.270879 6142 tablet_bootstrap.cc:654] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:04.274410 6142 tablet_bootstrap.cc:492] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d: No bootstrap required, opened a new log
I20260926 13:55:04.274813 6142 ts_tablet_manager.cc:1403] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260926 13:55:04.276638 6142 raft_consensus.cc:359] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b99d5aa63704dc899f73c5405eb883d" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34177 } }
I20260926 13:55:04.277073 6142 raft_consensus.cc:385] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:04.277271 6142 raft_consensus.cc:740] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b99d5aa63704dc899f73c5405eb883d, State: Initialized, Role: FOLLOWER
I20260926 13:55:04.277735 6142 consensus_queue.cc:260] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b99d5aa63704dc899f73c5405eb883d" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34177 } }
I20260926 13:55:04.278178 6142 raft_consensus.cc:399] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:04.278385 6142 raft_consensus.cc:493] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:04.278610 6142 raft_consensus.cc:3060] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:04.283175 6142 raft_consensus.cc:515] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b99d5aa63704dc899f73c5405eb883d" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34177 } }
I20260926 13:55:04.283694 6142 leader_election.cc:304] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b99d5aa63704dc899f73c5405eb883d; no voters:
I20260926 13:55:04.284709 6142 leader_election.cc:290] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:04.285003 6144 raft_consensus.cc:2804] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:04.286162 6144 raft_consensus.cc:697] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 1 LEADER]: Becoming Leader. State: Replica: 9b99d5aa63704dc899f73c5405eb883d, State: Running, Role: LEADER
I20260926 13:55:04.286664 6130 heartbeater.cc:499] Master 127.3.127.190:36637 was elected leader, sending a full tablet report...
I20260926 13:55:04.286918 6144 consensus_queue.cc:237] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b99d5aa63704dc899f73c5405eb883d" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34177 } }
I20260926 13:55:04.287209 6142 ts_tablet_manager.cc:1434] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260926 13:55:04.292328 6003 catalog_manager.cc:5838] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b99d5aa63704dc899f73c5405eb883d (127.3.127.129). New cstate: current_term: 1 leader_uuid: "9b99d5aa63704dc899f73c5405eb883d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b99d5aa63704dc899f73c5405eb883d" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34177 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:04.312217 6003 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40270:
table { table_name: "scan-token-rename" } new_table_name: "scan-token-rename-renamed" modify_external_catalogs: true
I20260926 13:55:04.323974 6149 tablet.cc:1751] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d: Alter schema from (
10:key INT64 NOT NULL,
11:a INT64 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT64 NOT NULL,
11:a INT64 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260926 13:55:04.339532 6002 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646: scan-token-rename-renamed [id=dd9d6044f500434a9e7c53e9ab7149dc] alter complete (version 1)
I20260926 13:55:04.358072 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:04.374523 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:04.375627 3582 tablet_replica.cc:333] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d: stopping tablet replica
I20260926 13:55:04.376231 3582 raft_consensus.cc:2243] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:04.376741 3582 raft_consensus.cc:2272] T 66fa4604e8f0466b98f1f0a46ffa315d P 9b99d5aa63704dc899f73c5405eb883d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:04.396006 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:04.403261 3582 master.cc:562] Master@127.3.127.190:36637 shutting down...
I20260926 13:55:04.417248 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:04.417670 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:04.418048 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 440cdfec341f48b09754c81335326646: stopping tablet replica
I20260926 13:55:04.426932 3582 master.cc:584] Master@127.3.127.190:36637 shutdown complete.
[ OK ] ScanTokenTest.TestConcurrentRenameTable (520 ms)
[ RUN ] ScanTokenTest.TestMasterRequestsWithMetadata
I20260926 13:55:04.451891 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:37661
I20260926 13:55:04.453230 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:04.458504 6152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:04.459033 6153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:04.460806 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:04.461521 6155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:04.462308 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:04.462486 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:04.462625 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430904462608 us; error 0 us; skew 500 ppm
I20260926 13:55:04.463112 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:04.465442 3582 webserver.cc:533] Webserver started at http://127.3.127.190:46493/ using document root <none> and password file <none>
I20260926 13:55:04.465847 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:04.466009 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:04.466233 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:04.467180 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "a43020e012584f75a7013a4e772b338a"
format_stamp: "Formatted at 2026-09-26 13:55:04 on dist-test-slave-fk7n"
I20260926 13:55:04.471350 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260926 13:55:04.474530 6160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:04.475277 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:55:04.475523 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "a43020e012584f75a7013a4e772b338a"
format_stamp: "Formatted at 2026-09-26 13:55:04 on dist-test-slave-fk7n"
I20260926 13:55:04.475803 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:04.496846 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:04.497686 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:04.540235 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:37661
I20260926 13:55:04.540331 6211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:37661 every 8 connection(s)
I20260926 13:55:04.544154 6212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:04.553323 6212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a: Bootstrap starting.
I20260926 13:55:04.557137 6212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:04.560671 6212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a: No bootstrap required, opened a new log
I20260926 13:55:04.562460 6212 raft_consensus.cc:359] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43020e012584f75a7013a4e772b338a" member_type: VOTER }
I20260926 13:55:04.562789 6212 raft_consensus.cc:385] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:04.562999 6212 raft_consensus.cc:740] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43020e012584f75a7013a4e772b338a, State: Initialized, Role: FOLLOWER
I20260926 13:55:04.563498 6212 consensus_queue.cc:260] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43020e012584f75a7013a4e772b338a" member_type: VOTER }
I20260926 13:55:04.563891 6212 raft_consensus.cc:399] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:04.564093 6212 raft_consensus.cc:493] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:04.564338 6212 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:04.568101 6212 raft_consensus.cc:515] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43020e012584f75a7013a4e772b338a" member_type: VOTER }
I20260926 13:55:04.568554 6212 leader_election.cc:304] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a43020e012584f75a7013a4e772b338a; no voters:
I20260926 13:55:04.569733 6212 leader_election.cc:290] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:04.569999 6215 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:04.571558 6215 raft_consensus.cc:697] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 1 LEADER]: Becoming Leader. State: Replica: a43020e012584f75a7013a4e772b338a, State: Running, Role: LEADER
I20260926 13:55:04.572256 6215 consensus_queue.cc:237] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43020e012584f75a7013a4e772b338a" member_type: VOTER }
I20260926 13:55:04.572790 6212 sys_catalog.cc:565] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:04.574761 6216 sys_catalog.cc:455] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a43020e012584f75a7013a4e772b338a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43020e012584f75a7013a4e772b338a" member_type: VOTER } }
I20260926 13:55:04.575215 6216 sys_catalog.cc:458] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:04.584291 6220 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:04.584602 6217 sys_catalog.cc:455] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a43020e012584f75a7013a4e772b338a. Latest consensus state: current_term: 1 leader_uuid: "a43020e012584f75a7013a4e772b338a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43020e012584f75a7013a4e772b338a" member_type: VOTER } }
I20260926 13:55:04.585153 6217 sys_catalog.cc:458] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:04.590893 6220 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:04.595255 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:04.600534 6220 catalog_manager.cc:1396] Generated new cluster ID: f34d82bc398a4751b9b62b88f27dc673
I20260926 13:55:04.600769 6220 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:04.626534 6220 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:04.627612 6220 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:04.643163 6220 catalog_manager.cc:6219] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a: Generated new TSK 0
I20260926 13:55:04.643627 6220 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:04.661870 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:04.668409 6234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:04.669241 6235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:04.670902 6237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:04.671427 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:04.672366 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:04.672603 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:04.672820 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430904672802 us; error 0 us; skew 500 ppm
I20260926 13:55:04.673471 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:04.675983 3582 webserver.cc:533] Webserver started at http://127.3.127.129:41873/ using document root <none> and password file <none>
I20260926 13:55:04.676540 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:04.676791 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:04.677096 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:04.678435 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "9a117da3f1b641f8991144ec20a4043b"
format_stamp: "Formatted at 2026-09-26 13:55:04 on dist-test-slave-fk7n"
I20260926 13:55:04.683849 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260926 13:55:04.687680 6242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:04.688426 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:04.688668 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "9a117da3f1b641f8991144ec20a4043b"
format_stamp: "Formatted at 2026-09-26 13:55:04 on dist-test-slave-fk7n"
I20260926 13:55:04.688962 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsWithMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:04.702698 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:04.703521 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:04.704885 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:04.707082 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:04.707268 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:04.707463 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:04.707608 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:04.753665 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:34417
I20260926 13:55:04.753811 6304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:34417 every 8 connection(s)
I20260926 13:55:04.768343 6305 heartbeater.cc:344] Connected to a master server at 127.3.127.190:37661
I20260926 13:55:04.768656 6305 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:04.769327 6305 heartbeater.cc:507] Master 127.3.127.190:37661 requested a full tablet report, sending...
I20260926 13:55:04.771116 6177 ts_manager.cc:194] Registered new tserver with Master: 9a117da3f1b641f8991144ec20a4043b (127.3.127.129:34417)
I20260926 13:55:04.771824 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015103609s
I20260926 13:55:04.773164 6177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52266
I20260926 13:55:04.793430 6177 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52276:
name: "scan-token-requests"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "a"
type: INT64
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
I20260926 13:55:04.822289 6270 tablet_service.cc:1511] Processing CreateTablet for tablet ec5ba012c64e4ca7aeba21ee4de27904 (DEFAULT_TABLE table=scan-token-requests [id=2e03f6c310ba4fa188c4a86594cdcd5a]), partition=
I20260926 13:55:04.823236 6270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5ba012c64e4ca7aeba21ee4de27904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:04.834379 6317 tablet_bootstrap.cc:492] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b: Bootstrap starting.
I20260926 13:55:04.839624 6317 tablet_bootstrap.cc:654] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:04.843791 6317 tablet_bootstrap.cc:492] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b: No bootstrap required, opened a new log
I20260926 13:55:04.844183 6317 ts_tablet_manager.cc:1403] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:55:04.846546 6317 raft_consensus.cc:359] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a117da3f1b641f8991144ec20a4043b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34417 } }
I20260926 13:55:04.847045 6317 raft_consensus.cc:385] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:04.847325 6317 raft_consensus.cc:740] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a117da3f1b641f8991144ec20a4043b, State: Initialized, Role: FOLLOWER
I20260926 13:55:04.847929 6317 consensus_queue.cc:260] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a117da3f1b641f8991144ec20a4043b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34417 } }
I20260926 13:55:04.848528 6317 raft_consensus.cc:399] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:04.848843 6317 raft_consensus.cc:493] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:04.849167 6317 raft_consensus.cc:3060] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:04.855471 6317 raft_consensus.cc:515] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a117da3f1b641f8991144ec20a4043b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34417 } }
I20260926 13:55:04.856110 6317 leader_election.cc:304] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a117da3f1b641f8991144ec20a4043b; no voters:
I20260926 13:55:04.857466 6317 leader_election.cc:290] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:04.857803 6319 raft_consensus.cc:2804] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:04.860013 6319 raft_consensus.cc:697] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 1 LEADER]: Becoming Leader. State: Replica: 9a117da3f1b641f8991144ec20a4043b, State: Running, Role: LEADER
I20260926 13:55:04.860529 6305 heartbeater.cc:499] Master 127.3.127.190:37661 was elected leader, sending a full tablet report...
I20260926 13:55:04.860733 6319 consensus_queue.cc:237] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a117da3f1b641f8991144ec20a4043b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34417 } }
I20260926 13:55:04.862776 6317 ts_tablet_manager.cc:1434] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b: Time spent starting tablet: real 0.018s user 0.015s sys 0.004s
I20260926 13:55:04.866727 6177 catalog_manager.cc:5838] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a117da3f1b641f8991144ec20a4043b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "9a117da3f1b641f8991144ec20a4043b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a117da3f1b641f8991144ec20a4043b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34417 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:04.929140 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:04.948793 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:04.949465 3582 tablet_replica.cc:333] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b: stopping tablet replica
I20260926 13:55:04.949985 3582 raft_consensus.cc:2243] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:04.950371 3582 raft_consensus.cc:2272] T ec5ba012c64e4ca7aeba21ee4de27904 P 9a117da3f1b641f8991144ec20a4043b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:04.959368 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:04.968940 3582 master.cc:562] Master@127.3.127.190:37661 shutting down...
I20260926 13:55:04.983461 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:04.983916 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:04.984304 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P a43020e012584f75a7013a4e772b338a: stopping tablet replica
I20260926 13:55:04.994421 3582 master.cc:584] Master@127.3.127.190:37661 shutdown complete.
[ OK ] ScanTokenTest.TestMasterRequestsWithMetadata (568 ms)
[ RUN ] ScanTokenTest.TestMasterRequestsNoMetadata
I20260926 13:55:05.020229 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:35753
I20260926 13:55:05.021522 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:05.026628 6330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:05.026882 6331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:05.029716 6334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:05.030186 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:05.031028 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:05.031188 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:05.031328 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430905031314 us; error 0 us; skew 500 ppm
I20260926 13:55:05.031785 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:05.034127 3582 webserver.cc:533] Webserver started at http://127.3.127.190:33939/ using document root <none> and password file <none>
I20260926 13:55:05.034529 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:05.034682 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:05.034909 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:05.035876 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "c4fba211783d4e1fb434b84334679708"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.040004 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260926 13:55:05.043074 6338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:05.043802 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:05.044040 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "c4fba211783d4e1fb434b84334679708"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.044281 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:05.060447 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:05.061369 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:05.112252 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:35753
I20260926 13:55:05.112351 6389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:35753 every 8 connection(s)
I20260926 13:55:05.116313 6390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:05.130698 6390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708: Bootstrap starting.
I20260926 13:55:05.136425 6390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:05.140177 6390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708: No bootstrap required, opened a new log
I20260926 13:55:05.142002 6390 raft_consensus.cc:359] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4fba211783d4e1fb434b84334679708" member_type: VOTER }
I20260926 13:55:05.142349 6390 raft_consensus.cc:385] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:05.142594 6390 raft_consensus.cc:740] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4fba211783d4e1fb434b84334679708, State: Initialized, Role: FOLLOWER
I20260926 13:55:05.143114 6390 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4fba211783d4e1fb434b84334679708" member_type: VOTER }
I20260926 13:55:05.143515 6390 raft_consensus.cc:399] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:05.143719 6390 raft_consensus.cc:493] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:05.143954 6390 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:05.148034 6390 raft_consensus.cc:515] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4fba211783d4e1fb434b84334679708" member_type: VOTER }
I20260926 13:55:05.148487 6390 leader_election.cc:304] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4fba211783d4e1fb434b84334679708; no voters:
I20260926 13:55:05.149631 6390 leader_election.cc:290] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:05.149902 6393 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:05.151490 6393 raft_consensus.cc:697] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 1 LEADER]: Becoming Leader. State: Replica: c4fba211783d4e1fb434b84334679708, State: Running, Role: LEADER
I20260926 13:55:05.152138 6393 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4fba211783d4e1fb434b84334679708" member_type: VOTER }
I20260926 13:55:05.152702 6390 sys_catalog.cc:565] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:05.154790 6395 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4fba211783d4e1fb434b84334679708. Latest consensus state: current_term: 1 leader_uuid: "c4fba211783d4e1fb434b84334679708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4fba211783d4e1fb434b84334679708" member_type: VOTER } }
I20260926 13:55:05.155285 6395 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:05.156409 6394 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4fba211783d4e1fb434b84334679708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4fba211783d4e1fb434b84334679708" member_type: VOTER } }
I20260926 13:55:05.156951 6394 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:05.164047 6398 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:05.170418 6398 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:05.171377 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:05.179803 6398 catalog_manager.cc:1396] Generated new cluster ID: d0dc4b9b2e7d40c0b57d272891cecb59
I20260926 13:55:05.180020 6398 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:05.210316 6398 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:05.211413 6398 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:05.236285 6398 catalog_manager.cc:6219] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708: Generated new TSK 0
I20260926 13:55:05.236840 6398 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:05.301532 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:05.307142 6411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:05.307667 6412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:05.310318 6414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:05.310506 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:05.311311 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:05.311492 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:05.311653 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430905311637 us; error 0 us; skew 500 ppm
I20260926 13:55:05.312135 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:05.314560 3582 webserver.cc:533] Webserver started at http://127.3.127.129:37923/ using document root <none> and password file <none>
I20260926 13:55:05.314993 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:05.315166 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:05.315404 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:05.316386 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "ce2e10b954004e3a854545368bb217a9"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.320554 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260926 13:55:05.323650 6419 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:05.324396 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:05.324635 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "ce2e10b954004e3a854545368bb217a9"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.324918 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.TestMasterRequestsNoMetadata.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:05.336022 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:05.336887 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:05.338276 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:05.340685 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:05.340950 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260926 13:55:05.341179 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:05.341322 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:05.392799 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:46411
I20260926 13:55:05.392889 6481 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:46411 every 8 connection(s)
I20260926 13:55:05.408319 6482 heartbeater.cc:344] Connected to a master server at 127.3.127.190:35753
I20260926 13:55:05.408643 6482 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:05.409348 6482 heartbeater.cc:507] Master 127.3.127.190:35753 requested a full tablet report, sending...
I20260926 13:55:05.411263 6355 ts_manager.cc:194] Registered new tserver with Master: ce2e10b954004e3a854545368bb217a9 (127.3.127.129:46411)
I20260926 13:55:05.411445 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015483434s
I20260926 13:55:05.413491 6355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40668
I20260926 13:55:05.432523 6355 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40682:
name: "scan-token-requests-no-meta"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "a"
type: INT64
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
I20260926 13:55:05.462651 6447 tablet_service.cc:1511] Processing CreateTablet for tablet 0023232dc7e24ac99f124013ca5f30a1 (DEFAULT_TABLE table=scan-token-requests-no-meta [id=52e668a60b334a39a62e09dbd2887d64]), partition=
I20260926 13:55:05.463476 6447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0023232dc7e24ac99f124013ca5f30a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:05.475415 6494 tablet_bootstrap.cc:492] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9: Bootstrap starting.
I20260926 13:55:05.479387 6494 tablet_bootstrap.cc:654] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:05.483052 6494 tablet_bootstrap.cc:492] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9: No bootstrap required, opened a new log
I20260926 13:55:05.483361 6494 ts_tablet_manager.cc:1403] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260926 13:55:05.485100 6494 raft_consensus.cc:359] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2e10b954004e3a854545368bb217a9" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 46411 } }
I20260926 13:55:05.485487 6494 raft_consensus.cc:385] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:05.485783 6494 raft_consensus.cc:740] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2e10b954004e3a854545368bb217a9, State: Initialized, Role: FOLLOWER
I20260926 13:55:05.486397 6494 consensus_queue.cc:260] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2e10b954004e3a854545368bb217a9" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 46411 } }
I20260926 13:55:05.487005 6494 raft_consensus.cc:399] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:05.487284 6494 raft_consensus.cc:493] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:05.487614 6494 raft_consensus.cc:3060] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:05.491860 6494 raft_consensus.cc:515] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2e10b954004e3a854545368bb217a9" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 46411 } }
I20260926 13:55:05.492334 6494 leader_election.cc:304] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce2e10b954004e3a854545368bb217a9; no voters:
I20260926 13:55:05.493568 6494 leader_election.cc:290] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:05.493847 6496 raft_consensus.cc:2804] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:05.495252 6482 heartbeater.cc:499] Master 127.3.127.190:35753 was elected leader, sending a full tablet report...
I20260926 13:55:05.495847 6494 ts_tablet_manager.cc:1434] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260926 13:55:05.496901 6496 raft_consensus.cc:697] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 1 LEADER]: Becoming Leader. State: Replica: ce2e10b954004e3a854545368bb217a9, State: Running, Role: LEADER
I20260926 13:55:05.498215 6496 consensus_queue.cc:237] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2e10b954004e3a854545368bb217a9" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 46411 } }
I20260926 13:55:05.504925 6355 catalog_manager.cc:5838] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce2e10b954004e3a854545368bb217a9 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "ce2e10b954004e3a854545368bb217a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2e10b954004e3a854545368bb217a9" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 46411 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:05.574311 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:05.598492 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:05.599422 3582 tablet_replica.cc:333] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9: stopping tablet replica
I20260926 13:55:05.599851 3582 raft_consensus.cc:2243] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:05.600242 3582 raft_consensus.cc:2272] T 0023232dc7e24ac99f124013ca5f30a1 P ce2e10b954004e3a854545368bb217a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:05.619123 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:05.629212 3582 master.cc:562] Master@127.3.127.190:35753 shutting down...
I20260926 13:55:05.644667 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:05.645148 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:05.645582 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P c4fba211783d4e1fb434b84334679708: stopping tablet replica
I20260926 13:55:05.654820 3582 master.cc:584] Master@127.3.127.190:35753 shutdown complete.
[ OK ] ScanTokenTest.TestMasterRequestsNoMetadata (654 ms)
[ RUN ] ScanTokenTest.ToggleFaultToleranceForScanConfiguration
I20260926 13:55:05.673538 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:38825
I20260926 13:55:05.674438 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:05.678928 6507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:05.679252 6508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:05.683136 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:05.684403 6510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:05.685290 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:05.685585 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:05.685813 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430905685793 us; error 0 us; skew 500 ppm
I20260926 13:55:05.686443 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:05.689430 3582 webserver.cc:533] Webserver started at http://127.3.127.190:40497/ using document root <none> and password file <none>
I20260926 13:55:05.689989 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:05.690243 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:05.690570 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:05.691576 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "f78f5cb7dd31420a834d4a72e8f048e1"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.695801 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:55:05.698859 6515 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:05.699590 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:05.699900 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "f78f5cb7dd31420a834d4a72e8f048e1"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.700233 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:05.721874 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:05.723061 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:05.764961 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:38825
I20260926 13:55:05.765019 6566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:38825 every 8 connection(s)
I20260926 13:55:05.769577 6567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:05.778705 6567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1: Bootstrap starting.
I20260926 13:55:05.782617 6567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:05.786196 6567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1: No bootstrap required, opened a new log
I20260926 13:55:05.787940 6567 raft_consensus.cc:359] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" member_type: VOTER }
I20260926 13:55:05.788296 6567 raft_consensus.cc:385] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:05.788501 6567 raft_consensus.cc:740] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f78f5cb7dd31420a834d4a72e8f048e1, State: Initialized, Role: FOLLOWER
I20260926 13:55:05.789016 6567 consensus_queue.cc:260] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" member_type: VOTER }
I20260926 13:55:05.789429 6567 raft_consensus.cc:399] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:05.789629 6567 raft_consensus.cc:493] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:05.789857 6567 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:05.793805 6567 raft_consensus.cc:515] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" member_type: VOTER }
I20260926 13:55:05.794260 6567 leader_election.cc:304] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f78f5cb7dd31420a834d4a72e8f048e1; no voters:
I20260926 13:55:05.795411 6567 leader_election.cc:290] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:05.795696 6570 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:05.797317 6570 raft_consensus.cc:697] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 1 LEADER]: Becoming Leader. State: Replica: f78f5cb7dd31420a834d4a72e8f048e1, State: Running, Role: LEADER
I20260926 13:55:05.798013 6570 consensus_queue.cc:237] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" member_type: VOTER }
I20260926 13:55:05.798470 6567 sys_catalog.cc:565] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:05.800455 6571 sys_catalog.cc:455] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" member_type: VOTER } }
I20260926 13:55:05.800959 6571 sys_catalog.cc:458] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:05.801378 6572 sys_catalog.cc:455] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f78f5cb7dd31420a834d4a72e8f048e1. Latest consensus state: current_term: 1 leader_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f78f5cb7dd31420a834d4a72e8f048e1" member_type: VOTER } }
I20260926 13:55:05.802309 6572 sys_catalog.cc:458] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:05.814572 6575 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:05.821380 6575 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:05.831482 6575 catalog_manager.cc:1396] Generated new cluster ID: 270e156c0e6a4a408180b5ae110285ca
I20260926 13:55:05.831774 6575 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:05.832135 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:05.854415 6575 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:05.855960 6575 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:05.874629 6575 catalog_manager.cc:6219] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1: Generated new TSK 0
I20260926 13:55:05.875147 6575 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:05.897806 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:05.903355 6588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:05.904459 6589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:05.907423 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:05.907481 6591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:05.908424 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:05.908608 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:05.908797 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430905908780 us; error 0 us; skew 500 ppm
I20260926 13:55:05.909262 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:05.911643 3582 webserver.cc:533] Webserver started at http://127.3.127.129:36103/ using document root <none> and password file <none>
I20260926 13:55:05.912057 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:05.912227 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:05.912458 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:05.913451 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "f5fe26bd02ad45a6942cf68f6c290bb8"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.917568 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260926 13:55:05.920598 6596 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:05.921336 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:05.921571 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "f5fe26bd02ad45a6942cf68f6c290bb8"
format_stamp: "Formatted at 2026-09-26 13:55:05 on dist-test-slave-fk7n"
I20260926 13:55:05.921806 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenTest.ToggleFaultToleranceForScanConfiguration.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:05.956656 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:05.957551 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:05.958945 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:05.961215 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:05.961380 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:05.961596 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:05.961735 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.010782 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:34839
I20260926 13:55:06.010874 6658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:34839 every 8 connection(s)
I20260926 13:55:06.025828 6659 heartbeater.cc:344] Connected to a master server at 127.3.127.190:38825
I20260926 13:55:06.026142 6659 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:06.026769 6659 heartbeater.cc:507] Master 127.3.127.190:38825 requested a full tablet report, sending...
I20260926 13:55:06.028677 6532 ts_manager.cc:194] Registered new tserver with Master: f5fe26bd02ad45a6942cf68f6c290bb8 (127.3.127.129:34839)
I20260926 13:55:06.028790 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.014854129s
I20260926 13:55:06.030925 6532 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35434
I20260926 13:55:06.049630 6532 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35442:
name: "fault_tolerance_toggle"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
}
}
I20260926 13:55:06.077508 6624 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7b54e1a8a648178c645319489fe7e7 (DEFAULT_TABLE table=fault_tolerance_toggle [id=a19f0c3630b64d619f98cec86dac4550]), partition=
I20260926 13:55:06.078387 6624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7b54e1a8a648178c645319489fe7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:06.089131 6671 tablet_bootstrap.cc:492] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8: Bootstrap starting.
I20260926 13:55:06.093457 6671 tablet_bootstrap.cc:654] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:06.097048 6671 tablet_bootstrap.cc:492] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8: No bootstrap required, opened a new log
I20260926 13:55:06.097398 6671 ts_tablet_manager.cc:1403] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260926 13:55:06.099050 6671 raft_consensus.cc:359] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fe26bd02ad45a6942cf68f6c290bb8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34839 } }
I20260926 13:55:06.099413 6671 raft_consensus.cc:385] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:06.099644 6671 raft_consensus.cc:740] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fe26bd02ad45a6942cf68f6c290bb8, State: Initialized, Role: FOLLOWER
I20260926 13:55:06.100219 6671 consensus_queue.cc:260] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fe26bd02ad45a6942cf68f6c290bb8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34839 } }
I20260926 13:55:06.100636 6671 raft_consensus.cc:399] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:06.100896 6671 raft_consensus.cc:493] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:06.101142 6671 raft_consensus.cc:3060] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:06.105893 6671 raft_consensus.cc:515] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fe26bd02ad45a6942cf68f6c290bb8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34839 } }
I20260926 13:55:06.106370 6671 leader_election.cc:304] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5fe26bd02ad45a6942cf68f6c290bb8; no voters:
I20260926 13:55:06.107546 6671 leader_election.cc:290] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:06.107841 6673 raft_consensus.cc:2804] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:06.109213 6659 heartbeater.cc:499] Master 127.3.127.190:38825 was elected leader, sending a full tablet report...
I20260926 13:55:06.109782 6671 ts_tablet_manager.cc:1434] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260926 13:55:06.110411 6673 raft_consensus.cc:697] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 1 LEADER]: Becoming Leader. State: Replica: f5fe26bd02ad45a6942cf68f6c290bb8, State: Running, Role: LEADER
I20260926 13:55:06.110906 6673 consensus_queue.cc:237] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fe26bd02ad45a6942cf68f6c290bb8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34839 } }
I20260926 13:55:06.116559 6532 catalog_manager.cc:5838] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5fe26bd02ad45a6942cf68f6c290bb8 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "f5fe26bd02ad45a6942cf68f6c290bb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fe26bd02ad45a6942cf68f6c290bb8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:06.133266 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:06.150580 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:06.152405 3582 tablet_replica.cc:333] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8: stopping tablet replica
I20260926 13:55:06.152948 3582 raft_consensus.cc:2243] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:06.153333 3582 raft_consensus.cc:2272] T 8d7b54e1a8a648178c645319489fe7e7 P f5fe26bd02ad45a6942cf68f6c290bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:06.171656 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:06.179195 3582 master.cc:562] Master@127.3.127.190:38825 shutting down...
I20260926 13:55:06.193240 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:06.193773 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:06.194213 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P f78f5cb7dd31420a834d4a72e8f048e1: stopping tablet replica
I20260926 13:55:06.215476 3582 master.cc:584] Master@127.3.127.190:38825 shutdown complete.
[ OK ] ScanTokenTest.ToggleFaultToleranceForScanConfiguration (562 ms)
[----------] 12 tests from ScanTokenTest (15648 ms total)
[----------] 1 test from ScanTokenStaleRaftMembershipTest
[ RUN ] ScanTokenStaleRaftMembershipTest.TabletLeaderChange
I20260926 13:55:06.237067 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:46695
I20260926 13:55:06.238085 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:06.242774 6678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:06.242949 6679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:06.246440 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:06.247157 6681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:06.247967 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:06.248210 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:06.248382 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430906248367 us; error 0 us; skew 500 ppm
I20260926 13:55:06.249033 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:06.251817 3582 webserver.cc:533] Webserver started at http://127.3.127.190:42503/ using document root <none> and password file <none>
I20260926 13:55:06.252424 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:06.252725 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:06.253149 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:06.254918 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "70f262e7b18347c782950f10ea966e21"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.260780 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260926 13:55:06.264694 6686 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.265476 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260926 13:55:06.265765 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "70f262e7b18347c782950f10ea966e21"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.266103 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:06.285529 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:06.286811 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:06.328074 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:46695
I20260926 13:55:06.328163 6737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:46695 every 8 connection(s)
I20260926 13:55:06.332739 6738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:06.342365 6738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21: Bootstrap starting.
I20260926 13:55:06.346278 6738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:06.349997 6738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21: No bootstrap required, opened a new log
I20260926 13:55:06.351795 6738 raft_consensus.cc:359] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f262e7b18347c782950f10ea966e21" member_type: VOTER }
I20260926 13:55:06.352136 6738 raft_consensus.cc:385] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:06.352345 6738 raft_consensus.cc:740] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70f262e7b18347c782950f10ea966e21, State: Initialized, Role: FOLLOWER
I20260926 13:55:06.352880 6738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f262e7b18347c782950f10ea966e21" member_type: VOTER }
I20260926 13:55:06.353279 6738 raft_consensus.cc:399] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:06.353485 6738 raft_consensus.cc:493] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:06.353726 6738 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:06.357731 6738 raft_consensus.cc:515] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f262e7b18347c782950f10ea966e21" member_type: VOTER }
I20260926 13:55:06.358193 6738 leader_election.cc:304] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70f262e7b18347c782950f10ea966e21; no voters:
I20260926 13:55:06.359375 6738 leader_election.cc:290] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:06.359654 6741 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:06.361274 6741 raft_consensus.cc:697] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 1 LEADER]: Becoming Leader. State: Replica: 70f262e7b18347c782950f10ea966e21, State: Running, Role: LEADER
I20260926 13:55:06.361966 6741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f262e7b18347c782950f10ea966e21" member_type: VOTER }
I20260926 13:55:06.362447 6738 sys_catalog.cc:565] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:06.364468 6742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70f262e7b18347c782950f10ea966e21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f262e7b18347c782950f10ea966e21" member_type: VOTER } }
I20260926 13:55:06.365037 6742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:06.365434 6743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70f262e7b18347c782950f10ea966e21. Latest consensus state: current_term: 1 leader_uuid: "70f262e7b18347c782950f10ea966e21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70f262e7b18347c782950f10ea966e21" member_type: VOTER } }
I20260926 13:55:06.365944 6743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:06.378743 6746 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:06.386992 6746 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:06.389694 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:06.397614 6746 catalog_manager.cc:1396] Generated new cluster ID: 433305d6d90a484a8a53c54f3906e276
I20260926 13:55:06.397878 6746 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:06.411650 6746 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:06.413062 6746 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:06.426723 6746 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21: Generated new TSK 0
I20260926 13:55:06.427259 6746 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:06.455807 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:06.460988 6759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:06.461902 6760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:06.462898 6762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:06.463107 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:06.463929 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:06.464103 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:06.464243 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430906464227 us; error 0 us; skew 500 ppm
I20260926 13:55:06.464731 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:06.466662 3582 webserver.cc:533] Webserver started at http://127.3.127.129:38367/ using document root <none> and password file <none>
I20260926 13:55:06.467089 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:06.467259 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:06.467494 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:06.468577 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "40bbf13e7102477393e7beb2300a4eb1"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.472605 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260926 13:55:06.475555 6767 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.476221 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260926 13:55:06.476482 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "40bbf13e7102477393e7beb2300a4eb1"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.476728 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:06.508226 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:06.509169 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:06.510488 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:06.512521 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:06.512704 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.512962 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:06.513120 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.547740 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:33117
I20260926 13:55:06.547842 6829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:33117 every 8 connection(s)
I20260926 13:55:06.552033 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:06.557782 6834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:06.558334 6835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:06.560637 6838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:06.561707 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:06.562629 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:06.562814 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:06.562978 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430906562961 us; error 0 us; skew 500 ppm
I20260926 13:55:06.563407 6830 heartbeater.cc:344] Connected to a master server at 127.3.127.190:46695
I20260926 13:55:06.563560 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:06.563699 6830 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:06.564606 6830 heartbeater.cc:507] Master 127.3.127.190:46695 requested a full tablet report, sending...
I20260926 13:55:06.565951 3582 webserver.cc:533] Webserver started at http://127.3.127.130:45439/ using document root <none> and password file <none>
I20260926 13:55:06.566499 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:06.566745 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:06.566700 6703 ts_manager.cc:194] Registered new tserver with Master: 40bbf13e7102477393e7beb2300a4eb1 (127.3.127.129:33117)
I20260926 13:55:06.567133 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:06.568585 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-1-root/instance:
uuid: "b593a679c7f547e0a4c26ec4db51bca5"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.568899 6703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36200
I20260926 13:55:06.572947 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260926 13:55:06.575891 6842 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.576555 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:06.576830 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-1-root
uuid: "b593a679c7f547e0a4c26ec4db51bca5"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.577085 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:06.606562 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:06.607486 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:06.608819 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:06.610802 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:06.610989 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.611204 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:06.611349 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.645623 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.130:40747
I20260926 13:55:06.645717 6904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.130:40747 every 8 connection(s)
I20260926 13:55:06.649837 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:06.655870 6908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:06.657770 6909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:06.659111 6911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:06.660276 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:06.660704 6905 heartbeater.cc:344] Connected to a master server at 127.3.127.190:46695
I20260926 13:55:06.661121 6905 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:06.661295 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:06.661543 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:06.661734 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430906661717 us; error 0 us; skew 500 ppm
I20260926 13:55:06.661877 6905 heartbeater.cc:507] Master 127.3.127.190:46695 requested a full tablet report, sending...
I20260926 13:55:06.662418 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:06.663952 6703 ts_manager.cc:194] Registered new tserver with Master: b593a679c7f547e0a4c26ec4db51bca5 (127.3.127.130:40747)
I20260926 13:55:06.664860 3582 webserver.cc:533] Webserver started at http://127.3.127.131:35467/ using document root <none> and password file <none>
I20260926 13:55:06.665292 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:06.665460 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:06.665401 6703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36208
I20260926 13:55:06.665800 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:06.666983 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-2-root/instance:
uuid: "a7dba2eacc194234a9350ece2fae0d86"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.671169 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260926 13:55:06.674014 6916 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.674692 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:55:06.674937 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-2-root
uuid: "a7dba2eacc194234a9350ece2fae0d86"
format_stamp: "Formatted at 2026-09-26 13:55:06 on dist-test-slave-fk7n"
I20260926 13:55:06.675179 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:06.687357 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:06.688283 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:06.689558 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:06.691504 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:06.691673 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.691880 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:06.692014 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:06.754209 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.131:36241
I20260926 13:55:06.754300 6978 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.131:36241 every 8 connection(s)
I20260926 13:55:06.767493 6979 heartbeater.cc:344] Connected to a master server at 127.3.127.190:46695
I20260926 13:55:06.767798 6979 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:06.768460 6979 heartbeater.cc:507] Master 127.3.127.190:46695 requested a full tablet report, sending...
I20260926 13:55:06.770128 6703 ts_manager.cc:194] Registered new tserver with Master: a7dba2eacc194234a9350ece2fae0d86 (127.3.127.131:36241)
I20260926 13:55:06.770437 3582 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011953354s
I20260926 13:55:06.771322 6703 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36216
I20260926 13:55:06.792536 6703 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36232:
name: "scan-token-stale-tablet-config"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "col"
type: INT64
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\006\001\000\234\377\377\377\377\377\377\377\007\001\000d\000\000\000\000\000\000\000""\006\001\000\234\377\377\377\377\377\377\377\007\001\000d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260926 13:55:06.794217 6703 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table scan-token-stale-tablet-config in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260926 13:55:06.831959 6870 tablet_service.cc:1511] Processing CreateTablet for tablet 990b0c8631b24f29ace76c176db90704 (DEFAULT_TABLE table=scan-token-stale-tablet-config [id=7f7c705cd7fe400b83cffb85a1cdebe5]), partition=RANGE (key) PARTITION -100 <= VALUES < 100
I20260926 13:55:06.833421 6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990b0c8631b24f29ace76c176db90704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:06.833534 6944 tablet_service.cc:1511] Processing CreateTablet for tablet 990b0c8631b24f29ace76c176db90704 (DEFAULT_TABLE table=scan-token-stale-tablet-config [id=7f7c705cd7fe400b83cffb85a1cdebe5]), partition=RANGE (key) PARTITION -100 <= VALUES < 100
I20260926 13:55:06.834666 6944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990b0c8631b24f29ace76c176db90704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:06.836776 6795 tablet_service.cc:1511] Processing CreateTablet for tablet 990b0c8631b24f29ace76c176db90704 (DEFAULT_TABLE table=scan-token-stale-tablet-config [id=7f7c705cd7fe400b83cffb85a1cdebe5]), partition=RANGE (key) PARTITION -100 <= VALUES < 100
I20260926 13:55:06.837996 6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 990b0c8631b24f29ace76c176db90704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:06.845775 6994 tablet_bootstrap.cc:492] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5: Bootstrap starting.
I20260926 13:55:06.851353 6994 tablet_bootstrap.cc:654] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:06.851626 6995 tablet_bootstrap.cc:492] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86: Bootstrap starting.
I20260926 13:55:06.853941 6996 tablet_bootstrap.cc:492] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1: Bootstrap starting.
I20260926 13:55:06.858457 6995 tablet_bootstrap.cc:654] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:06.859087 6994 tablet_bootstrap.cc:492] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5: No bootstrap required, opened a new log
I20260926 13:55:06.859210 6996 tablet_bootstrap.cc:654] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:06.859536 6994 ts_tablet_manager.cc:1403] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.006s
I20260926 13:55:06.862818 6994 raft_consensus.cc:359] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:06.863628 6994 raft_consensus.cc:385] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:06.863927 6994 raft_consensus.cc:740] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b593a679c7f547e0a4c26ec4db51bca5, State: Initialized, Role: FOLLOWER
I20260926 13:55:06.865059 6995 tablet_bootstrap.cc:492] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86: No bootstrap required, opened a new log
I20260926 13:55:06.864784 6994 consensus_queue.cc:260] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:06.865388 6995 ts_tablet_manager.cc:1403] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260926 13:55:06.865880 6996 tablet_bootstrap.cc:492] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1: No bootstrap required, opened a new log
I20260926 13:55:06.866380 6996 ts_tablet_manager.cc:1403] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.006s
I20260926 13:55:06.866711 6905 heartbeater.cc:499] Master 127.3.127.190:46695 was elected leader, sending a full tablet report...
I20260926 13:55:06.867257 6994 ts_tablet_manager.cc:1434] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260926 13:55:06.869035 6996 raft_consensus.cc:359] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:06.869225 6995 raft_consensus.cc:359] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:06.869736 6996 raft_consensus.cc:385] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:06.869875 6995 raft_consensus.cc:385] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:06.870046 6996 raft_consensus.cc:740] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40bbf13e7102477393e7beb2300a4eb1, State: Initialized, Role: FOLLOWER
I20260926 13:55:06.870208 6995 raft_consensus.cc:740] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7dba2eacc194234a9350ece2fae0d86, State: Initialized, Role: FOLLOWER
I20260926 13:55:06.870882 6996 consensus_queue.cc:260] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:06.870879 6995 consensus_queue.cc:260] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:06.875070 6995 ts_tablet_manager.cc:1434] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260926 13:55:06.875432 6830 heartbeater.cc:499] Master 127.3.127.190:46695 was elected leader, sending a full tablet report...
I20260926 13:55:06.875818 6979 heartbeater.cc:499] Master 127.3.127.190:46695 was elected leader, sending a full tablet report...
I20260926 13:55:06.877558 6996 ts_tablet_manager.cc:1434] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1: Time spent starting tablet: real 0.011s user 0.001s sys 0.006s
I20260926 13:55:07.132121 7000 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:07.132582 7000 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:07.134785 7000 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40bbf13e7102477393e7beb2300a4eb1 (127.3.127.129:33117), a7dba2eacc194234a9350ece2fae0d86 (127.3.127.131:36241)
I20260926 13:55:07.142584 6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40bbf13e7102477393e7beb2300a4eb1" is_pre_election: true
I20260926 13:55:07.143026 6954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7dba2eacc194234a9350ece2fae0d86" is_pre_election: true
I20260926 13:55:07.143386 6805 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 0.
I20260926 13:55:07.143618 6954 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 0.
I20260926 13:55:07.144625 6846 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40bbf13e7102477393e7beb2300a4eb1, b593a679c7f547e0a4c26ec4db51bca5; no voters:
I20260926 13:55:07.145274 7000 raft_consensus.cc:2804] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:07.145545 7000 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:07.145783 7000 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:07.150197 7000 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:07.151590 7000 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 1 election: Requested vote from peers 40bbf13e7102477393e7beb2300a4eb1 (127.3.127.129:33117), a7dba2eacc194234a9350ece2fae0d86 (127.3.127.131:36241)
I20260926 13:55:07.152307 6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40bbf13e7102477393e7beb2300a4eb1"
I20260926 13:55:07.152453 6954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7dba2eacc194234a9350ece2fae0d86"
I20260926 13:55:07.152772 6805 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:07.152920 6954 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:07.157158 6954 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 1.
I20260926 13:55:07.157177 6805 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 1.
I20260926 13:55:07.158169 6845 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7dba2eacc194234a9350ece2fae0d86, b593a679c7f547e0a4c26ec4db51bca5; no voters:
I20260926 13:55:07.158761 7000 raft_consensus.cc:2804] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:07.159474 7000 raft_consensus.cc:697] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 1 LEADER]: Becoming Leader. State: Replica: b593a679c7f547e0a4c26ec4db51bca5, State: Running, Role: LEADER
I20260926 13:55:07.160055 7000 consensus_queue.cc:237] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:07.166193 6702 catalog_manager.cc:5838] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b593a679c7f547e0a4c26ec4db51bca5 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "b593a679c7f547e0a4c26ec4db51bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } health_report { overall_health: UNKNOWN } } }
W20260926 13:55:07.230269 6860 tablet_service.cc:3036] Rejecting scan request for tablet 990b0c8631b24f29ace76c176db90704: Uninitialized: clean time has not yet been initialized
W20260926 13:55:07.240650 6934 tablet_service.cc:3036] Rejecting scan request for tablet 990b0c8631b24f29ace76c176db90704: Uninitialized: clean time has not yet been initialized
W20260926 13:55:07.250767 6785 tablet_service.cc:3036] Rejecting scan request for tablet 990b0c8631b24f29ace76c176db90704: Uninitialized: clean time has not yet been initialized
I20260926 13:55:07.608389 7000 consensus_queue.cc:1048] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:07.620582 7000 consensus_queue.cc:1048] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:07.685035 6880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "990b0c8631b24f29ace76c176db90704"
dest_uuid: "b593a679c7f547e0a4c26ec4db51bca5"
from {username='slave'} at 127.0.0.1:56786
I20260926 13:55:07.685740 6880 raft_consensus.cc:591] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 1 LEADER]: Received request to step down
I20260926 13:55:07.686049 6880 raft_consensus.cc:3055] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 1 LEADER]: Stepping down as leader of term 1
I20260926 13:55:07.686335 6880 raft_consensus.cc:740] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b593a679c7f547e0a4c26ec4db51bca5, State: Running, Role: LEADER
I20260926 13:55:07.687114 6880 consensus_queue.cc:260] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:07.688391 6880 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 1 FOLLOWER]: Advancing to term 2
W20260926 13:55:07.700460 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.712097 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.726591 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.740423 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.750777 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.762840 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.777302 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.789503 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.800859 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.819440 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.836724 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.854173 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.875317 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.893555 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.913853 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.937029 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.960167 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:07.984505 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.012866 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.038107 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.061601 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.092262 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.120844 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.148850 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.183614 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.214612 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.245261 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.283219 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.316708 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.353680 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.390992 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.425473 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.462148 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.506003 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.544651 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.584511 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.630757 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.674566 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.720114 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.770421 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.816365 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:08.864267 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
I20260926 13:55:09.633675 7024 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b593a679c7f547e0a4c26ec4db51bca5)
I20260926 13:55:09.634899 7024 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:09.638463 7024 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b593a679c7f547e0a4c26ec4db51bca5 (127.3.127.130:40747), 40bbf13e7102477393e7beb2300a4eb1 (127.3.127.129:33117)
I20260926 13:55:09.678054 7025 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b593a679c7f547e0a4c26ec4db51bca5)
I20260926 13:55:09.678701 7025 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:09.688328 7025 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b593a679c7f547e0a4c26ec4db51bca5 (127.3.127.130:40747), a7dba2eacc194234a9350ece2fae0d86 (127.3.127.131:36241)
W20260926 13:55:09.721863 6920 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s user 0.001s sys 0.012s
W20260926 13:55:09.722236 6920 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s user 0.002s sys 0.013s
W20260926 13:55:09.727710 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
I20260926 13:55:09.734040 6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "a7dba2eacc194234a9350ece2fae0d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40bbf13e7102477393e7beb2300a4eb1" is_pre_election: true
I20260926 13:55:09.734519 6805 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7dba2eacc194234a9350ece2fae0d86 in term 1.
I20260926 13:55:09.735397 6954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "40bbf13e7102477393e7beb2300a4eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7dba2eacc194234a9350ece2fae0d86" is_pre_election: true
I20260926 13:55:09.735644 6920 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40bbf13e7102477393e7beb2300a4eb1, a7dba2eacc194234a9350ece2fae0d86; no voters:
I20260926 13:55:09.735983 6954 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40bbf13e7102477393e7beb2300a4eb1 in term 1.
I20260926 13:55:09.736447 7024 raft_consensus.cc:2804] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:09.736722 7024 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b593a679c7f547e0a4c26ec4db51bca5)
I20260926 13:55:09.737092 7024 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:09.737200 6770 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40bbf13e7102477393e7beb2300a4eb1, a7dba2eacc194234a9350ece2fae0d86; no voters:
I20260926 13:55:09.739470 7025 raft_consensus.cc:2804] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:09.739740 7025 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b593a679c7f547e0a4c26ec4db51bca5)
I20260926 13:55:09.740072 7025 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:09.755609 7025 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:09.756537 7024 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:09.760927 6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "a7dba2eacc194234a9350ece2fae0d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40bbf13e7102477393e7beb2300a4eb1"
I20260926 13:55:09.761781 6805 raft_consensus.cc:2393] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7dba2eacc194234a9350ece2fae0d86 in current term 2: Already voted for candidate 40bbf13e7102477393e7beb2300a4eb1 in this term.
I20260926 13:55:09.763284 7024 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [CANDIDATE]: Term 2 election: Requested vote from peers b593a679c7f547e0a4c26ec4db51bca5 (127.3.127.130:40747), 40bbf13e7102477393e7beb2300a4eb1 (127.3.127.129:33117)
I20260926 13:55:09.769209 7025 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [CANDIDATE]: Term 2 election: Requested vote from peers b593a679c7f547e0a4c26ec4db51bca5 (127.3.127.130:40747), a7dba2eacc194234a9350ece2fae0d86 (127.3.127.131:36241)
I20260926 13:55:09.770200 6954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "40bbf13e7102477393e7beb2300a4eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7dba2eacc194234a9350ece2fae0d86"
I20260926 13:55:09.770941 6954 raft_consensus.cc:2393] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 40bbf13e7102477393e7beb2300a4eb1 in current term 2: Already voted for candidate a7dba2eacc194234a9350ece2fae0d86 in this term.
W20260926 13:55:09.776918 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
I20260926 13:55:09.779520 6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "a7dba2eacc194234a9350ece2fae0d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b593a679c7f547e0a4c26ec4db51bca5" is_pre_election: true
I20260926 13:55:09.779919 6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "a7dba2eacc194234a9350ece2fae0d86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b593a679c7f547e0a4c26ec4db51bca5"
I20260926 13:55:09.780099 6880 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7dba2eacc194234a9350ece2fae0d86 in term 2.
I20260926 13:55:09.781400 6917 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7dba2eacc194234a9350ece2fae0d86; no voters: 40bbf13e7102477393e7beb2300a4eb1, b593a679c7f547e0a4c26ec4db51bca5
I20260926 13:55:09.781994 7024 raft_consensus.cc:2749] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260926 13:55:09.784435 6880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "40bbf13e7102477393e7beb2300a4eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b593a679c7f547e0a4c26ec4db51bca5" is_pre_election: true
I20260926 13:55:09.784824 6879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "40bbf13e7102477393e7beb2300a4eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b593a679c7f547e0a4c26ec4db51bca5"
I20260926 13:55:09.785024 6880 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40bbf13e7102477393e7beb2300a4eb1 in term 2.
I20260926 13:55:09.786080 6768 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40bbf13e7102477393e7beb2300a4eb1; no voters: a7dba2eacc194234a9350ece2fae0d86, b593a679c7f547e0a4c26ec4db51bca5
I20260926 13:55:09.786675 7025 raft_consensus.cc:2749] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260926 13:55:09.827045 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:09.879910 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:09.931658 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:09.986090 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.042383 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.099617 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.157641 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.219573 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.275130 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.331755 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.396898 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.456580 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.520113 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.584944 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.607847 6901 debug-util.cc:398] Leaking SignalData structure 0x7b0800135940 after lost signal to thread 3585
W20260926 13:55:10.608592 6901 debug-util.cc:398] Leaking SignalData structure 0x7b0800062120 after lost signal to thread 6737
W20260926 13:55:10.649545 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.719379 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.789938 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.859988 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:10.927636 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:11.000489 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:11.072343 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:11.142752 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
W20260926 13:55:11.216297 6860 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:56798: Illegal state: replica b593a679c7f547e0a4c26ec4db51bca5 is not leader of this config: current role FOLLOWER
W20260926 13:55:11.289338 6785 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49048: Illegal state: replica 40bbf13e7102477393e7beb2300a4eb1 is not leader of this config: current role FOLLOWER
W20260926 13:55:11.362179 6934 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39410: Illegal state: replica a7dba2eacc194234a9350ece2fae0d86 is not leader of this config: current role FOLLOWER
I20260926 13:55:11.402096 7035 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:11.402730 7035 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:11.404769 7035 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40bbf13e7102477393e7beb2300a4eb1 (127.3.127.129:33117), a7dba2eacc194234a9350ece2fae0d86 (127.3.127.131:36241)
I20260926 13:55:11.406142 6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40bbf13e7102477393e7beb2300a4eb1" is_pre_election: true
I20260926 13:55:11.406401 6954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7dba2eacc194234a9350ece2fae0d86" is_pre_election: true
I20260926 13:55:11.406885 6805 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 2.
I20260926 13:55:11.407150 6954 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 2.
I20260926 13:55:11.408209 6846 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40bbf13e7102477393e7beb2300a4eb1, b593a679c7f547e0a4c26ec4db51bca5; no voters:
I20260926 13:55:11.408931 7035 raft_consensus.cc:2804] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260926 13:55:11.409273 7035 raft_consensus.cc:493] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:11.409518 7035 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 2 FOLLOWER]: Advancing to term 3
I20260926 13:55:11.415699 7035 raft_consensus.cc:515] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:11.417114 7035 leader_election.cc:290] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 3 election: Requested vote from peers 40bbf13e7102477393e7beb2300a4eb1 (127.3.127.129:33117), a7dba2eacc194234a9350ece2fae0d86 (127.3.127.131:36241)
I20260926 13:55:11.417892 6805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40bbf13e7102477393e7beb2300a4eb1"
I20260926 13:55:11.418098 6954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "990b0c8631b24f29ace76c176db90704" candidate_uuid: "b593a679c7f547e0a4c26ec4db51bca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7dba2eacc194234a9350ece2fae0d86"
I20260926 13:55:11.418426 6805 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 2 FOLLOWER]: Advancing to term 3
I20260926 13:55:11.418533 6954 raft_consensus.cc:3060] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 2 FOLLOWER]: Advancing to term 3
I20260926 13:55:11.423949 6954 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 3.
I20260926 13:55:11.424899 6845 leader_election.cc:304] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7dba2eacc194234a9350ece2fae0d86, b593a679c7f547e0a4c26ec4db51bca5; no voters:
I20260926 13:55:11.425508 7035 raft_consensus.cc:2804] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260926 13:55:11.426347 6805 raft_consensus.cc:2468] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b593a679c7f547e0a4c26ec4db51bca5 in term 3.
I20260926 13:55:11.426499 7035 raft_consensus.cc:697] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 3 LEADER]: Becoming Leader. State: Replica: b593a679c7f547e0a4c26ec4db51bca5, State: Running, Role: LEADER
I20260926 13:55:11.427667 7035 consensus_queue.cc:237] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } }
I20260926 13:55:11.442970 6702 catalog_manager.cc:5838] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b593a679c7f547e0a4c26ec4db51bca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b593a679c7f547e0a4c26ec4db51bca5" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 40747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:11.448568 6954 raft_consensus.cc:1275] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 3 FOLLOWER]: Refusing update from remote peer b593a679c7f547e0a4c26ec4db51bca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260926 13:55:11.449579 6805 raft_consensus.cc:1275] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 3 FOLLOWER]: Refusing update from remote peer b593a679c7f547e0a4c26ec4db51bca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260926 13:55:11.450443 7035 consensus_queue.cc:1048] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7dba2eacc194234a9350ece2fae0d86" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260926 13:55:11.452427 7035 consensus_queue.cc:1048] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40bbf13e7102477393e7beb2300a4eb1" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 33117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260926 13:55:11.486963 7038 mvcc.cc:204] Tried to move back new op lower bound from 7333605013280145408 to 7333605013214560256. Current Snapshot: MvccSnapshot[applied={T|T < 7333605013280145408}]
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/scan_token-test.cc:1801: Failure
Expected: (new_leader_tsd->uuid()) != (leader_tsd->uuid()), actual: "b593a679c7f547e0a4c26ec4db51bca5" vs "b593a679c7f547e0a4c26ec4db51bca5"
I20260926 13:55:11.541081 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:11.577618 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:11.578518 3582 tablet_replica.cc:333] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1: stopping tablet replica
I20260926 13:55:11.579217 3582 raft_consensus.cc:2243] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:11.579787 3582 raft_consensus.cc:2272] T 990b0c8631b24f29ace76c176db90704 P 40bbf13e7102477393e7beb2300a4eb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:11.593346 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:11.606323 3582 tablet_server.cc:179] TabletServer@127.3.127.130:0 shutting down...
I20260926 13:55:11.630507 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:11.631287 3582 tablet_replica.cc:333] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5: stopping tablet replica
I20260926 13:55:11.631999 3582 raft_consensus.cc:2243] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 3 LEADER]: Raft consensus shutting down.
I20260926 13:55:11.632894 3582 raft_consensus.cc:2272] T 990b0c8631b24f29ace76c176db90704 P b593a679c7f547e0a4c26ec4db51bca5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:12.642343 3582 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6901)
I20260926 13:55:12.794507 3582 tablet_server.cc:196] TabletServer@127.3.127.130:0 shutdown complete.
I20260926 13:55:12.804504 3582 tablet_server.cc:179] TabletServer@127.3.127.131:0 shutting down...
I20260926 13:55:12.821780 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:12.822441 3582 tablet_replica.cc:333] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86: stopping tablet replica
I20260926 13:55:12.822981 3582 raft_consensus.cc:2243] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:12.823446 3582 raft_consensus.cc:2272] T 990b0c8631b24f29ace76c176db90704 P a7dba2eacc194234a9350ece2fae0d86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:12.841104 3582 tablet_server.cc:196] TabletServer@127.3.127.131:0 shutdown complete.
I20260926 13:55:12.850373 3582 master.cc:562] Master@127.3.127.190:46695 shutting down...
I20260926 13:55:12.864880 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:12.865329 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:12.865639 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 70f262e7b18347c782950f10ea966e21: stopping tablet replica
I20260926 13:55:12.882696 3582 master.cc:584] Master@127.3.127.190:46695 shutdown complete.
I20260926 13:55:12.907035 3582 test_util.cc:182] -----------------------------------------------
I20260926 13:55:12.907202 3582 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.ScanTokenStaleRaftMembershipTest.TabletLeaderChange.1790430890430161-3582-0
[ FAILED ] ScanTokenStaleRaftMembershipTest.TabletLeaderChange (6673 ms)
[----------] 1 test from ScanTokenStaleRaftMembershipTest (6673 ms total)
[----------] 3 tests from Params/TimestampPropagationParamTest
[ RUN ] Params/TimestampPropagationParamTest.Test/0
I20260926 13:55:12.910123 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:43597
I20260926 13:55:12.911095 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:12.915964 7055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:12.916028 7056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:12.916630 7058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:12.918187 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:12.918936 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:12.919107 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:12.919216 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430912919206 us; error 0 us; skew 500 ppm
I20260926 13:55:12.919651 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:12.921763 3582 webserver.cc:533] Webserver started at http://127.3.127.190:34787/ using document root <none> and password file <none>
I20260926 13:55:12.922160 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:12.922303 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:12.922497 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:12.923471 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "d554d7f7f2884e1aa3529fdaef41bead"
format_stamp: "Formatted at 2026-09-26 13:55:12 on dist-test-slave-fk7n"
I20260926 13:55:12.927453 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:55:12.930292 7063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:12.930912 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:55:12.931138 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "d554d7f7f2884e1aa3529fdaef41bead"
format_stamp: "Formatted at 2026-09-26 13:55:12 on dist-test-slave-fk7n"
I20260926 13:55:12.931351 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:12.956453 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:12.957485 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:12.991350 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:43597
I20260926 13:55:12.991418 7114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:43597 every 8 connection(s)
I20260926 13:55:12.994863 7115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.004599 7115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead: Bootstrap starting.
I20260926 13:55:13.009263 7115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.013019 7115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead: No bootstrap required, opened a new log
I20260926 13:55:13.014914 7115 raft_consensus.cc:359] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d554d7f7f2884e1aa3529fdaef41bead" member_type: VOTER }
I20260926 13:55:13.015282 7115 raft_consensus.cc:385] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.015498 7115 raft_consensus.cc:740] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d554d7f7f2884e1aa3529fdaef41bead, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.016007 7115 consensus_queue.cc:260] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d554d7f7f2884e1aa3529fdaef41bead" member_type: VOTER }
I20260926 13:55:13.016420 7115 raft_consensus.cc:399] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.016623 7115 raft_consensus.cc:493] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.016896 7115 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.020728 7115 raft_consensus.cc:515] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d554d7f7f2884e1aa3529fdaef41bead" member_type: VOTER }
I20260926 13:55:13.021224 7115 leader_election.cc:304] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d554d7f7f2884e1aa3529fdaef41bead; no voters:
I20260926 13:55:13.022199 7115 leader_election.cc:290] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.022444 7118 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.023593 7118 raft_consensus.cc:697] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 1 LEADER]: Becoming Leader. State: Replica: d554d7f7f2884e1aa3529fdaef41bead, State: Running, Role: LEADER
I20260926 13:55:13.024185 7118 consensus_queue.cc:237] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d554d7f7f2884e1aa3529fdaef41bead" member_type: VOTER }
I20260926 13:55:13.024740 7115 sys_catalog.cc:565] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:13.028012 7119 sys_catalog.cc:455] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d554d7f7f2884e1aa3529fdaef41bead" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d554d7f7f2884e1aa3529fdaef41bead" member_type: VOTER } }
I20260926 13:55:13.028154 7120 sys_catalog.cc:455] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [sys.catalog]: SysCatalogTable state changed. Reason: New leader d554d7f7f2884e1aa3529fdaef41bead. Latest consensus state: current_term: 1 leader_uuid: "d554d7f7f2884e1aa3529fdaef41bead" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d554d7f7f2884e1aa3529fdaef41bead" member_type: VOTER } }
I20260926 13:55:13.028614 7119 sys_catalog.cc:458] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:13.028762 7120 sys_catalog.cc:458] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:13.031282 7124 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:13.035892 7124 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:13.040297 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:13.043972 7124 catalog_manager.cc:1396] Generated new cluster ID: 7dd0be67ba3e4fb7a02bded2912fd210
I20260926 13:55:13.044234 7124 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:13.060322 7124 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:13.061511 7124 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:13.083663 7124 catalog_manager.cc:6219] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead: Generated new TSK 0
I20260926 13:55:13.084173 7124 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:13.106864 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:13.112075 7136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:13.113096 7137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:13.114953 7139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:13.115038 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:13.115976 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:13.116159 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:13.116297 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430913116283 us; error 0 us; skew 500 ppm
I20260926 13:55:13.116719 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:13.118731 3582 webserver.cc:533] Webserver started at http://127.3.127.129:39487/ using document root <none> and password file <none>
I20260926 13:55:13.119117 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:13.119256 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:13.119442 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:13.120488 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "9949c83a198640b4bd9cc059b662d33e"
format_stamp: "Formatted at 2026-09-26 13:55:13 on dist-test-slave-fk7n"
I20260926 13:55:13.124645 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260926 13:55:13.127604 7144 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:13.128252 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:13.128490 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "9949c83a198640b4bd9cc059b662d33e"
format_stamp: "Formatted at 2026-09-26 13:55:13 on dist-test-slave-fk7n"
I20260926 13:55:13.128713 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_0.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:13.139575 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:13.140609 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:13.141917 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:13.143908 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:13.144068 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:13.144291 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:13.144431 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:13.180650 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:41861
I20260926 13:55:13.180789 7206 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:41861 every 8 connection(s)
I20260926 13:55:13.196461 7207 heartbeater.cc:344] Connected to a master server at 127.3.127.190:43597
I20260926 13:55:13.196806 7207 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:13.197445 7207 heartbeater.cc:507] Master 127.3.127.190:43597 requested a full tablet report, sending...
I20260926 13:55:13.199203 7080 ts_manager.cc:194] Registered new tserver with Master: 9949c83a198640b4bd9cc059b662d33e (127.3.127.129:41861)
I20260926 13:55:13.199659 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015988945s
I20260926 13:55:13.200830 7080 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39796
I20260926 13:55:13.218887 7080 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39802:
name: "p_ts_table"
schema {
columns {
name: "c_key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\000\000\000\000\000\000\000""\004\001\000\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
hash_schema {
columns {
name: "c_key"
}
num_buckets: 2
seed: 0
}
}
I20260926 13:55:13.254338 7172 tablet_service.cc:1511] Processing CreateTablet for tablet 54dc874fe59f4233b8c27d7cd504daab (DEFAULT_TABLE table=p_ts_table [id=4f0a13c69fe143fc8722b5cfcbcb8d42]), partition=HASH (c_key) PARTITION 0, RANGE (c_key) PARTITION VALUES < 0
I20260926 13:55:13.254578 7171 tablet_service.cc:1511] Processing CreateTablet for tablet fa4d77ab478f49dc91ebca923c330872 (DEFAULT_TABLE table=p_ts_table [id=4f0a13c69fe143fc8722b5cfcbcb8d42]), partition=HASH (c_key) PARTITION 0, RANGE (c_key) PARTITION 0 <= VALUES
I20260926 13:55:13.254804 7170 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea22869af574ba29c436f5d360c9bc7 (DEFAULT_TABLE table=p_ts_table [id=4f0a13c69fe143fc8722b5cfcbcb8d42]), partition=HASH (c_key) PARTITION 1, RANGE (c_key) PARTITION VALUES < 0
I20260926 13:55:13.255100 7169 tablet_service.cc:1511] Processing CreateTablet for tablet 236a18ffb826477c906a5cc3ed145a11 (DEFAULT_TABLE table=p_ts_table [id=4f0a13c69fe143fc8722b5cfcbcb8d42]), partition=HASH (c_key) PARTITION 1, RANGE (c_key) PARTITION 0 <= VALUES
I20260926 13:55:13.255717 7172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dc874fe59f4233b8c27d7cd504daab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.256336 7170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea22869af574ba29c436f5d360c9bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.256923 7169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236a18ffb826477c906a5cc3ed145a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.257450 7171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4d77ab478f49dc91ebca923c330872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.277662 7219 tablet_bootstrap.cc:492] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e: Bootstrap starting.
I20260926 13:55:13.283362 7219 tablet_bootstrap.cc:654] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.287667 7219 tablet_bootstrap.cc:492] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e: No bootstrap required, opened a new log
I20260926 13:55:13.288012 7219 ts_tablet_manager.cc:1403] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260926 13:55:13.290565 7219 raft_consensus.cc:359] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.291075 7219 raft_consensus.cc:385] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.291337 7219 raft_consensus.cc:740] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.292017 7219 consensus_queue.cc:260] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.292542 7219 raft_consensus.cc:399] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.292834 7219 raft_consensus.cc:493] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.293151 7219 raft_consensus.cc:3060] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.299809 7219 raft_consensus.cc:515] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.300462 7219 leader_election.cc:304] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9949c83a198640b4bd9cc059b662d33e; no voters:
I20260926 13:55:13.301913 7219 leader_election.cc:290] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.302138 7221 raft_consensus.cc:2804] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.303851 7207 heartbeater.cc:499] Master 127.3.127.190:43597 was elected leader, sending a full tablet report...
I20260926 13:55:13.304378 7219 ts_tablet_manager.cc:1434] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260926 13:55:13.303580 7221 raft_consensus.cc:697] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Becoming Leader. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Running, Role: LEADER
I20260926 13:55:13.305297 7219 tablet_bootstrap.cc:492] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e: Bootstrap starting.
I20260926 13:55:13.305392 7221 consensus_queue.cc:237] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.312069 7219 tablet_bootstrap.cc:654] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.313854 7080 catalog_manager.cc:5838] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9949c83a198640b4bd9cc059b662d33e (127.3.127.129). New cstate: current_term: 1 leader_uuid: "9949c83a198640b4bd9cc059b662d33e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.316787 7219 tablet_bootstrap.cc:492] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e: No bootstrap required, opened a new log
I20260926 13:55:13.317209 7219 ts_tablet_manager.cc:1403] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260926 13:55:13.319416 7219 raft_consensus.cc:359] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.319826 7219 raft_consensus.cc:385] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.320103 7219 raft_consensus.cc:740] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.320696 7219 consensus_queue.cc:260] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.321298 7219 raft_consensus.cc:399] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.321517 7219 raft_consensus.cc:493] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.321760 7219 raft_consensus.cc:3060] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.326591 7219 raft_consensus.cc:515] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.327062 7219 leader_election.cc:304] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9949c83a198640b4bd9cc059b662d33e; no voters:
I20260926 13:55:13.327483 7219 leader_election.cc:290] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.327627 7221 raft_consensus.cc:2804] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.328051 7221 raft_consensus.cc:697] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Becoming Leader. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Running, Role: LEADER
I20260926 13:55:13.329061 7219 ts_tablet_manager.cc:1434] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260926 13:55:13.328707 7221 consensus_queue.cc:237] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.329862 7219 tablet_bootstrap.cc:492] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e: Bootstrap starting.
I20260926 13:55:13.334496 7080 catalog_manager.cc:5838] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9949c83a198640b4bd9cc059b662d33e (127.3.127.129). New cstate: current_term: 1 leader_uuid: "9949c83a198640b4bd9cc059b662d33e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.335393 7219 tablet_bootstrap.cc:654] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.339360 7219 tablet_bootstrap.cc:492] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e: No bootstrap required, opened a new log
I20260926 13:55:13.339715 7219 ts_tablet_manager.cc:1403] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:55:13.342010 7219 raft_consensus.cc:359] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.342357 7219 raft_consensus.cc:385] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.342577 7219 raft_consensus.cc:740] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.343088 7219 consensus_queue.cc:260] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.343627 7219 raft_consensus.cc:399] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.343866 7219 raft_consensus.cc:493] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.344125 7219 raft_consensus.cc:3060] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.348713 7219 raft_consensus.cc:515] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.349323 7219 leader_election.cc:304] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9949c83a198640b4bd9cc059b662d33e; no voters:
I20260926 13:55:13.349749 7219 leader_election.cc:290] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.349968 7223 raft_consensus.cc:2804] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.350368 7223 raft_consensus.cc:697] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Becoming Leader. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Running, Role: LEADER
I20260926 13:55:13.351069 7219 ts_tablet_manager.cc:1434] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260926 13:55:13.350947 7223 consensus_queue.cc:237] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.351720 7219 tablet_bootstrap.cc:492] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e: Bootstrap starting.
I20260926 13:55:13.356227 7080 catalog_manager.cc:5838] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9949c83a198640b4bd9cc059b662d33e (127.3.127.129). New cstate: current_term: 1 leader_uuid: "9949c83a198640b4bd9cc059b662d33e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.356880 7219 tablet_bootstrap.cc:654] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.360766 7219 tablet_bootstrap.cc:492] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e: No bootstrap required, opened a new log
I20260926 13:55:13.361110 7219 ts_tablet_manager.cc:1403] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260926 13:55:13.363366 7219 raft_consensus.cc:359] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.363723 7219 raft_consensus.cc:385] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.363924 7219 raft_consensus.cc:740] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.364426 7219 consensus_queue.cc:260] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.365000 7219 raft_consensus.cc:399] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.365224 7219 raft_consensus.cc:493] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.365499 7219 raft_consensus.cc:3060] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.370276 7219 raft_consensus.cc:515] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.370738 7219 leader_election.cc:304] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9949c83a198640b4bd9cc059b662d33e; no voters:
I20260926 13:55:13.371181 7219 leader_election.cc:290] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.371301 7223 raft_consensus.cc:2804] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.371702 7223 raft_consensus.cc:697] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Becoming Leader. State: Replica: 9949c83a198640b4bd9cc059b662d33e, State: Running, Role: LEADER
I20260926 13:55:13.372483 7219 ts_tablet_manager.cc:1434] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20260926 13:55:13.372295 7223 consensus_queue.cc:237] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } }
I20260926 13:55:13.377197 7080 catalog_manager.cc:5838] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9949c83a198640b4bd9cc059b662d33e (127.3.127.129). New cstate: current_term: 1 leader_uuid: "9949c83a198640b4bd9cc059b662d33e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9949c83a198640b4bd9cc059b662d33e" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41861 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.409415 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:13.424353 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:13.425015 3582 tablet_replica.cc:333] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e: stopping tablet replica
I20260926 13:55:13.425484 3582 raft_consensus.cc:2243] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.425899 3582 raft_consensus.cc:2272] T 236a18ffb826477c906a5cc3ed145a11 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.427925 3582 tablet_replica.cc:333] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e: stopping tablet replica
I20260926 13:55:13.428354 3582 raft_consensus.cc:2243] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.428679 3582 raft_consensus.cc:2272] T fa4d77ab478f49dc91ebca923c330872 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.430677 3582 tablet_replica.cc:333] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e: stopping tablet replica
I20260926 13:55:13.431068 3582 raft_consensus.cc:2243] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.431380 3582 raft_consensus.cc:2272] T 4ea22869af574ba29c436f5d360c9bc7 P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.433259 3582 tablet_replica.cc:333] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e: stopping tablet replica
I20260926 13:55:13.433645 3582 raft_consensus.cc:2243] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.433954 3582 raft_consensus.cc:2272] T 54dc874fe59f4233b8c27d7cd504daab P 9949c83a198640b4bd9cc059b662d33e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.444761 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:13.453728 3582 master.cc:562] Master@127.3.127.190:43597 shutting down...
I20260926 13:55:13.465130 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.465543 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.465907 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P d554d7f7f2884e1aa3529fdaef41bead: stopping tablet replica
I20260926 13:55:13.484483 3582 master.cc:584] Master@127.3.127.190:43597 shutdown complete.
[ OK ] Params/TimestampPropagationParamTest.Test/0 (593 ms)
[ RUN ] Params/TimestampPropagationParamTest.Test/1
I20260926 13:55:13.503935 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:42351
I20260926 13:55:13.504886 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:13.508989 7232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:13.510212 7233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:13.510351 7235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:13.511406 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:13.512013 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:13.512174 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:13.512283 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430913512273 us; error 0 us; skew 500 ppm
I20260926 13:55:13.512693 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:13.514639 3582 webserver.cc:533] Webserver started at http://127.3.127.190:34513/ using document root <none> and password file <none>
I20260926 13:55:13.515021 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:13.515165 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:13.515354 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:13.516251 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe"
format_stamp: "Formatted at 2026-09-26 13:55:13 on dist-test-slave-fk7n"
I20260926 13:55:13.520112 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260926 13:55:13.522984 7240 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:13.523617 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:13.523836 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe"
format_stamp: "Formatted at 2026-09-26 13:55:13 on dist-test-slave-fk7n"
I20260926 13:55:13.524046 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:13.533542 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:13.534324 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:13.565539 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:42351
I20260926 13:55:13.565634 7291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:42351 every 8 connection(s)
I20260926 13:55:13.568928 7292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.578292 7292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe: Bootstrap starting.
I20260926 13:55:13.582194 7292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.585590 7292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe: No bootstrap required, opened a new log
I20260926 13:55:13.587316 7292 raft_consensus.cc:359] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" member_type: VOTER }
I20260926 13:55:13.587641 7292 raft_consensus.cc:385] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.587813 7292 raft_consensus.cc:740] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ab9a22bf524d0fa5cfe14cf52b1ebe, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.588258 7292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" member_type: VOTER }
I20260926 13:55:13.588632 7292 raft_consensus.cc:399] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.588827 7292 raft_consensus.cc:493] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.589035 7292 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.592823 7292 raft_consensus.cc:515] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" member_type: VOTER }
I20260926 13:55:13.593266 7292 leader_election.cc:304] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69ab9a22bf524d0fa5cfe14cf52b1ebe; no voters:
I20260926 13:55:13.594216 7292 leader_election.cc:290] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.594453 7295 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.595602 7295 raft_consensus.cc:697] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 1 LEADER]: Becoming Leader. State: Replica: 69ab9a22bf524d0fa5cfe14cf52b1ebe, State: Running, Role: LEADER
I20260926 13:55:13.596171 7295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" member_type: VOTER }
I20260926 13:55:13.596693 7292 sys_catalog.cc:565] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:13.607800 7297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69ab9a22bf524d0fa5cfe14cf52b1ebe. Latest consensus state: current_term: 1 leader_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" member_type: VOTER } }
I20260926 13:55:13.607800 7296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69ab9a22bf524d0fa5cfe14cf52b1ebe" member_type: VOTER } }
I20260926 13:55:13.608444 7297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:13.608469 7296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:13.610575 7300 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:13.616313 7300 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:13.619297 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:13.624724 7300 catalog_manager.cc:1396] Generated new cluster ID: be33f643ea3d4262b7bcfb047c339d1f
I20260926 13:55:13.625025 7300 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:13.642313 7300 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:13.643432 7300 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:13.657223 7300 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe: Generated new TSK 0
I20260926 13:55:13.657730 7300 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:13.685587 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:13.690711 7313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:13.691504 7314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:13.693689 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:13.693719 7316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:13.694532 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:13.694722 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:13.694877 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430913694860 us; error 0 us; skew 500 ppm
I20260926 13:55:13.695363 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:13.697443 3582 webserver.cc:533] Webserver started at http://127.3.127.129:40195/ using document root <none> and password file <none>
I20260926 13:55:13.697911 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:13.698114 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:13.698418 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:13.699411 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "47eb2210184347debfb716f8a821c6ab"
format_stamp: "Formatted at 2026-09-26 13:55:13 on dist-test-slave-fk7n"
I20260926 13:55:13.703372 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260926 13:55:13.706238 7321 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:13.706878 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:55:13.707149 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "47eb2210184347debfb716f8a821c6ab"
format_stamp: "Formatted at 2026-09-26 13:55:13 on dist-test-slave-fk7n"
I20260926 13:55:13.707396 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_1.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:13.726910 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:13.727828 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:13.729163 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:13.731177 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:13.731375 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:13.731597 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:13.731743 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:13.766530 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:45291
I20260926 13:55:13.766618 7383 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:45291 every 8 connection(s)
I20260926 13:55:13.779393 7384 heartbeater.cc:344] Connected to a master server at 127.3.127.190:42351
I20260926 13:55:13.779737 7384 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:13.780370 7384 heartbeater.cc:507] Master 127.3.127.190:42351 requested a full tablet report, sending...
I20260926 13:55:13.782104 7257 ts_manager.cc:194] Registered new tserver with Master: 47eb2210184347debfb716f8a821c6ab (127.3.127.129:45291)
I20260926 13:55:13.782388 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012864138s
I20260926 13:55:13.783699 7257 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35822
I20260926 13:55:13.801548 7257 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35838:
name: "p_ts_table"
schema {
columns {
name: "c_key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\000\000\000\000\000\000\000""\004\001\000\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
hash_schema {
columns {
name: "c_key"
}
num_buckets: 2
seed: 0
}
}
I20260926 13:55:13.833195 7349 tablet_service.cc:1511] Processing CreateTablet for tablet b10aaea6af9643248a19a272c99d7606 (DEFAULT_TABLE table=p_ts_table [id=8e0f768f356246c0adc552b50706df82]), partition=HASH (c_key) PARTITION 0, RANGE (c_key) PARTITION VALUES < 0
I20260926 13:55:13.833586 7348 tablet_service.cc:1511] Processing CreateTablet for tablet 06e7c2b67b0348e5a908c0a41829c0f1 (DEFAULT_TABLE table=p_ts_table [id=8e0f768f356246c0adc552b50706df82]), partition=HASH (c_key) PARTITION 0, RANGE (c_key) PARTITION 0 <= VALUES
I20260926 13:55:13.833896 7347 tablet_service.cc:1511] Processing CreateTablet for tablet 1e32951846e348c9b62c9bdbf8de71c5 (DEFAULT_TABLE table=p_ts_table [id=8e0f768f356246c0adc552b50706df82]), partition=HASH (c_key) PARTITION 1, RANGE (c_key) PARTITION VALUES < 0
I20260926 13:55:13.834475 7349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10aaea6af9643248a19a272c99d7606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.834281 7346 tablet_service.cc:1511] Processing CreateTablet for tablet 5087bac816224bcd97da8a543072f5cb (DEFAULT_TABLE table=p_ts_table [id=8e0f768f356246c0adc552b50706df82]), partition=HASH (c_key) PARTITION 1, RANGE (c_key) PARTITION 0 <= VALUES
I20260926 13:55:13.835076 7347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e32951846e348c9b62c9bdbf8de71c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.835594 7346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5087bac816224bcd97da8a543072f5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.836948 7348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e7c2b67b0348e5a908c0a41829c0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:13.851437 7396 tablet_bootstrap.cc:492] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab: Bootstrap starting.
I20260926 13:55:13.855818 7396 tablet_bootstrap.cc:654] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.859025 7396 tablet_bootstrap.cc:492] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab: No bootstrap required, opened a new log
I20260926 13:55:13.859318 7396 ts_tablet_manager.cc:1403] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260926 13:55:13.861184 7396 raft_consensus.cc:359] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.861673 7396 raft_consensus.cc:385] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.861932 7396 raft_consensus.cc:740] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.862422 7396 consensus_queue.cc:260] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.862839 7396 raft_consensus.cc:399] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.863058 7396 raft_consensus.cc:493] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.863284 7396 raft_consensus.cc:3060] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.867062 7396 raft_consensus.cc:515] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.867532 7396 leader_election.cc:304] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47eb2210184347debfb716f8a821c6ab; no voters:
I20260926 13:55:13.868499 7396 leader_election.cc:290] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.868783 7398 raft_consensus.cc:2804] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.870121 7384 heartbeater.cc:499] Master 127.3.127.190:42351 was elected leader, sending a full tablet report...
I20260926 13:55:13.870555 7396 ts_tablet_manager.cc:1434] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260926 13:55:13.870595 7398 raft_consensus.cc:697] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Becoming Leader. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Running, Role: LEADER
I20260926 13:55:13.871472 7396 tablet_bootstrap.cc:492] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab: Bootstrap starting.
I20260926 13:55:13.871323 7398 consensus_queue.cc:237] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.877156 7396 tablet_bootstrap.cc:654] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.878432 7257 catalog_manager.cc:5838] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 47eb2210184347debfb716f8a821c6ab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "47eb2210184347debfb716f8a821c6ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.881136 7396 tablet_bootstrap.cc:492] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab: No bootstrap required, opened a new log
I20260926 13:55:13.881454 7396 ts_tablet_manager.cc:1403] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.001s
I20260926 13:55:13.883404 7396 raft_consensus.cc:359] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.883870 7396 raft_consensus.cc:385] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.884155 7396 raft_consensus.cc:740] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.884853 7396 consensus_queue.cc:260] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.885447 7396 raft_consensus.cc:399] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.885666 7396 raft_consensus.cc:493] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.885903 7396 raft_consensus.cc:3060] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.889899 7396 raft_consensus.cc:515] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.890362 7396 leader_election.cc:304] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47eb2210184347debfb716f8a821c6ab; no voters:
I20260926 13:55:13.890780 7396 leader_election.cc:290] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.890931 7398 raft_consensus.cc:2804] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.891407 7398 raft_consensus.cc:697] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Becoming Leader. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Running, Role: LEADER
I20260926 13:55:13.892162 7396 ts_tablet_manager.cc:1434] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab: Time spent starting tablet: real 0.011s user 0.008s sys 0.003s
I20260926 13:55:13.892038 7398 consensus_queue.cc:237] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.892932 7396 tablet_bootstrap.cc:492] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab: Bootstrap starting.
I20260926 13:55:13.897626 7257 catalog_manager.cc:5838] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 47eb2210184347debfb716f8a821c6ab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "47eb2210184347debfb716f8a821c6ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.898236 7396 tablet_bootstrap.cc:654] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.902280 7396 tablet_bootstrap.cc:492] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab: No bootstrap required, opened a new log
I20260926 13:55:13.902591 7396 ts_tablet_manager.cc:1403] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:55:13.904703 7396 raft_consensus.cc:359] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.905187 7396 raft_consensus.cc:385] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.905398 7396 raft_consensus.cc:740] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.905912 7396 consensus_queue.cc:260] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.906363 7396 raft_consensus.cc:399] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.906642 7396 raft_consensus.cc:493] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.906893 7396 raft_consensus.cc:3060] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.911252 7396 raft_consensus.cc:515] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.911725 7396 leader_election.cc:304] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47eb2210184347debfb716f8a821c6ab; no voters:
I20260926 13:55:13.912179 7396 leader_election.cc:290] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.912315 7398 raft_consensus.cc:2804] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.912734 7398 raft_consensus.cc:697] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Becoming Leader. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Running, Role: LEADER
I20260926 13:55:13.913499 7396 ts_tablet_manager.cc:1434] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260926 13:55:13.913355 7398 consensus_queue.cc:237] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.914139 7396 tablet_bootstrap.cc:492] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab: Bootstrap starting.
I20260926 13:55:13.919613 7396 tablet_bootstrap.cc:654] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:13.919708 7257 catalog_manager.cc:5838] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 47eb2210184347debfb716f8a821c6ab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "47eb2210184347debfb716f8a821c6ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.923743 7396 tablet_bootstrap.cc:492] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab: No bootstrap required, opened a new log
I20260926 13:55:13.924057 7396 ts_tablet_manager.cc:1403] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:55:13.925971 7396 raft_consensus.cc:359] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.926371 7396 raft_consensus.cc:385] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:13.926571 7396 raft_consensus.cc:740] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Initialized, Role: FOLLOWER
I20260926 13:55:13.927106 7396 consensus_queue.cc:260] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.927644 7396 raft_consensus.cc:399] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:13.927861 7396 raft_consensus.cc:493] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:13.928115 7396 raft_consensus.cc:3060] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:13.932554 7396 raft_consensus.cc:515] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.933048 7396 leader_election.cc:304] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47eb2210184347debfb716f8a821c6ab; no voters:
I20260926 13:55:13.933480 7396 leader_election.cc:290] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:13.933604 7398 raft_consensus.cc:2804] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:13.934000 7398 raft_consensus.cc:697] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Becoming Leader. State: Replica: 47eb2210184347debfb716f8a821c6ab, State: Running, Role: LEADER
I20260926 13:55:13.934608 7398 consensus_queue.cc:237] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } }
I20260926 13:55:13.934798 7396 ts_tablet_manager.cc:1434] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260926 13:55:13.939419 7257 catalog_manager.cc:5838] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 47eb2210184347debfb716f8a821c6ab (127.3.127.129). New cstate: current_term: 1 leader_uuid: "47eb2210184347debfb716f8a821c6ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47eb2210184347debfb716f8a821c6ab" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45291 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:13.976591 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:13.989621 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:13.990248 3582 tablet_replica.cc:333] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab: stopping tablet replica
I20260926 13:55:13.990738 3582 raft_consensus.cc:2243] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.991124 3582 raft_consensus.cc:2272] T b10aaea6af9643248a19a272c99d7606 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.993113 3582 tablet_replica.cc:333] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab: stopping tablet replica
I20260926 13:55:13.993552 3582 raft_consensus.cc:2243] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.993893 3582 raft_consensus.cc:2272] T 5087bac816224bcd97da8a543072f5cb P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.995688 3582 tablet_replica.cc:333] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab: stopping tablet replica
I20260926 13:55:13.996112 3582 raft_consensus.cc:2243] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.996444 3582 raft_consensus.cc:2272] T 06e7c2b67b0348e5a908c0a41829c0f1 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:13.998250 3582 tablet_replica.cc:333] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab: stopping tablet replica
I20260926 13:55:13.998710 3582 raft_consensus.cc:2243] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:13.999058 3582 raft_consensus.cc:2272] T 1e32951846e348c9b62c9bdbf8de71c5 P 47eb2210184347debfb716f8a821c6ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:14.019204 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:14.028221 3582 master.cc:562] Master@127.3.127.190:42351 shutting down...
I20260926 13:55:14.039769 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:14.040246 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:14.040627 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 69ab9a22bf524d0fa5cfe14cf52b1ebe: stopping tablet replica
I20260926 13:55:14.058835 3582 master.cc:584] Master@127.3.127.190:42351 shutdown complete.
[ OK ] Params/TimestampPropagationParamTest.Test/1 (576 ms)
[ RUN ] Params/TimestampPropagationParamTest.Test/2
I20260926 13:55:14.080449 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:42217
I20260926 13:55:14.081430 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:14.085587 7409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:14.086795 7410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:14.087198 7412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:14.087559 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:14.088200 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:14.088361 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:14.088501 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430914088485 us; error 0 us; skew 500 ppm
I20260926 13:55:14.089048 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:14.091024 3582 webserver.cc:533] Webserver started at http://127.3.127.190:46113/ using document root <none> and password file <none>
I20260926 13:55:14.091434 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:14.091602 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:14.091833 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:14.092911 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.096814 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260926 13:55:14.100093 7417 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.100841 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260926 13:55:14.101076 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.101297 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:14.110981 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:14.111779 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:14.143113 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:42217
I20260926 13:55:14.143193 7468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:42217 every 8 connection(s)
I20260926 13:55:14.146502 7469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.155845 7469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1: Bootstrap starting.
I20260926 13:55:14.159726 7469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:14.163009 7469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1: No bootstrap required, opened a new log
I20260926 13:55:14.164716 7469 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" member_type: VOTER }
I20260926 13:55:14.165086 7469 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:14.165257 7469 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb46e976eaa4e5281d4fc4aef1d86a1, State: Initialized, Role: FOLLOWER
I20260926 13:55:14.165741 7469 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" member_type: VOTER }
I20260926 13:55:14.166147 7469 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:14.166327 7469 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:14.166524 7469 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:14.170256 7469 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" member_type: VOTER }
I20260926 13:55:14.170679 7469 leader_election.cc:304] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bb46e976eaa4e5281d4fc4aef1d86a1; no voters:
I20260926 13:55:14.171617 7469 leader_election.cc:290] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:14.171862 7472 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:14.173022 7472 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 1 LEADER]: Becoming Leader. State: Replica: 9bb46e976eaa4e5281d4fc4aef1d86a1, State: Running, Role: LEADER
I20260926 13:55:14.173635 7472 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" member_type: VOTER }
I20260926 13:55:14.174139 7469 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:14.176242 7473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" member_type: VOTER } }
I20260926 13:55:14.176304 7474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bb46e976eaa4e5281d4fc4aef1d86a1. Latest consensus state: current_term: 1 leader_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb46e976eaa4e5281d4fc4aef1d86a1" member_type: VOTER } }
I20260926 13:55:14.177002 7474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:14.177003 7473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:14.179831 7477 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:14.184031 7477 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:14.188794 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:14.191556 7477 catalog_manager.cc:1396] Generated new cluster ID: 01537880bbe94b3cb4629a871e1893d5
I20260926 13:55:14.191771 7477 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:14.210191 7477 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:14.211323 7477 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:14.224589 7477 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1: Generated new TSK 0
I20260926 13:55:14.225147 7477 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:14.254633 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:14.260057 7490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:14.262051 7491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:14.262461 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:14.263046 7493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:14.263809 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:14.264022 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:14.264176 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430914264159 us; error 0 us; skew 500 ppm
I20260926 13:55:14.264648 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:14.266672 3582 webserver.cc:533] Webserver started at http://127.3.127.129:38571/ using document root <none> and password file <none>
I20260926 13:55:14.267105 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:14.267280 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:14.267520 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:14.268637 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.272703 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260926 13:55:14.275732 7498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.276459 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:14.276712 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.277029 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.Params_TimestampPropagationParamTest.Test_2.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:14.313829 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:14.314792 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:14.316135 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:14.318288 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:14.318480 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.318697 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:14.318841 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.353012 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:34319
I20260926 13:55:14.353106 7560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:34319 every 8 connection(s)
I20260926 13:55:14.365726 7561 heartbeater.cc:344] Connected to a master server at 127.3.127.190:42217
I20260926 13:55:14.366032 7561 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:14.366631 7561 heartbeater.cc:507] Master 127.3.127.190:42217 requested a full tablet report, sending...
I20260926 13:55:14.368346 7434 ts_manager.cc:194] Registered new tserver with Master: cd6af087bdfa4e04b6bdc7029c39ebe5 (127.3.127.129:34319)
I20260926 13:55:14.368435 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012569926s
I20260926 13:55:14.369961 7434 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46944
I20260926 13:55:14.387504 7434 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46946:
name: "p_ts_table"
schema {
columns {
name: "c_key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\000\000\000\000\000\000\000""\004\001\000\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
hash_schema {
columns {
name: "c_key"
}
num_buckets: 2
seed: 0
}
}
I20260926 13:55:14.419480 7526 tablet_service.cc:1511] Processing CreateTablet for tablet 76c22b71decb4ba8be9d03720732836a (DEFAULT_TABLE table=p_ts_table [id=93c120b33543425e8f6ec33a68124da1]), partition=HASH (c_key) PARTITION 0, RANGE (c_key) PARTITION VALUES < 0
I20260926 13:55:14.419902 7525 tablet_service.cc:1511] Processing CreateTablet for tablet 89ce0b1ffc3e46918d530c112a1a8c0d (DEFAULT_TABLE table=p_ts_table [id=93c120b33543425e8f6ec33a68124da1]), partition=HASH (c_key) PARTITION 0, RANGE (c_key) PARTITION 0 <= VALUES
I20260926 13:55:14.420291 7524 tablet_service.cc:1511] Processing CreateTablet for tablet 3d035f033c3246428a4688cf51936aa5 (DEFAULT_TABLE table=p_ts_table [id=93c120b33543425e8f6ec33a68124da1]), partition=HASH (c_key) PARTITION 1, RANGE (c_key) PARTITION VALUES < 0
I20260926 13:55:14.420804 7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c22b71decb4ba8be9d03720732836a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.420560 7523 tablet_service.cc:1511] Processing CreateTablet for tablet 139c079771984475879d0d10aae0271c (DEFAULT_TABLE table=p_ts_table [id=93c120b33543425e8f6ec33a68124da1]), partition=HASH (c_key) PARTITION 1, RANGE (c_key) PARTITION 0 <= VALUES
I20260926 13:55:14.421378 7525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89ce0b1ffc3e46918d530c112a1a8c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.421981 7523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 139c079771984475879d0d10aae0271c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.423002 7524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d035f033c3246428a4688cf51936aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.437708 7573 tablet_bootstrap.cc:492] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5: Bootstrap starting.
I20260926 13:55:14.441958 7573 tablet_bootstrap.cc:654] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:14.445209 7573 tablet_bootstrap.cc:492] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5: No bootstrap required, opened a new log
I20260926 13:55:14.445539 7573 ts_tablet_manager.cc:1403] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260926 13:55:14.447398 7573 raft_consensus.cc:359] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.447764 7573 raft_consensus.cc:385] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:14.447988 7573 raft_consensus.cc:740] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Initialized, Role: FOLLOWER
I20260926 13:55:14.448459 7573 consensus_queue.cc:260] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.448918 7573 raft_consensus.cc:399] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:14.449129 7573 raft_consensus.cc:493] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:14.449354 7573 raft_consensus.cc:3060] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:14.453254 7573 raft_consensus.cc:515] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.453867 7573 leader_election.cc:304] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd6af087bdfa4e04b6bdc7029c39ebe5; no voters:
I20260926 13:55:14.454967 7573 leader_election.cc:290] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:14.455197 7575 raft_consensus.cc:2804] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:14.456385 7575 raft_consensus.cc:697] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Becoming Leader. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Running, Role: LEADER
I20260926 13:55:14.456575 7561 heartbeater.cc:499] Master 127.3.127.190:42217 was elected leader, sending a full tablet report...
I20260926 13:55:14.457159 7573 ts_tablet_manager.cc:1434] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260926 13:55:14.457087 7575 consensus_queue.cc:237] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.457883 7573 tablet_bootstrap.cc:492] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5: Bootstrap starting.
I20260926 13:55:14.463068 7573 tablet_bootstrap.cc:654] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:14.464226 7434 catalog_manager.cc:5838] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd6af087bdfa4e04b6bdc7029c39ebe5 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:14.466917 7573 tablet_bootstrap.cc:492] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5: No bootstrap required, opened a new log
I20260926 13:55:14.467252 7573 ts_tablet_manager.cc:1403] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20260926 13:55:14.469141 7573 raft_consensus.cc:359] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.469631 7573 raft_consensus.cc:385] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:14.469905 7573 raft_consensus.cc:740] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Initialized, Role: FOLLOWER
I20260926 13:55:14.470643 7573 consensus_queue.cc:260] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.471084 7573 raft_consensus.cc:399] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:14.471303 7573 raft_consensus.cc:493] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:14.471544 7573 raft_consensus.cc:3060] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:14.477013 7573 raft_consensus.cc:515] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.477497 7573 leader_election.cc:304] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd6af087bdfa4e04b6bdc7029c39ebe5; no voters:
I20260926 13:55:14.477922 7573 leader_election.cc:290] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:14.478067 7575 raft_consensus.cc:2804] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:14.478507 7575 raft_consensus.cc:697] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Becoming Leader. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Running, Role: LEADER
I20260926 13:55:14.479151 7575 consensus_queue.cc:237] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.479808 7573 ts_tablet_manager.cc:1434] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20260926 13:55:14.480618 7573 tablet_bootstrap.cc:492] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5: Bootstrap starting.
I20260926 13:55:14.484892 7573 tablet_bootstrap.cc:654] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:14.484598 7433 catalog_manager.cc:5838] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd6af087bdfa4e04b6bdc7029c39ebe5 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:14.488540 7573 tablet_bootstrap.cc:492] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5: No bootstrap required, opened a new log
I20260926 13:55:14.488951 7573 ts_tablet_manager.cc:1403] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.007s
I20260926 13:55:14.491303 7573 raft_consensus.cc:359] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.491773 7573 raft_consensus.cc:385] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:14.492051 7573 raft_consensus.cc:740] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Initialized, Role: FOLLOWER
I20260926 13:55:14.492623 7573 consensus_queue.cc:260] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.493091 7573 raft_consensus.cc:399] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:14.493302 7573 raft_consensus.cc:493] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:14.493539 7573 raft_consensus.cc:3060] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:14.498940 7573 raft_consensus.cc:515] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.499385 7573 leader_election.cc:304] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd6af087bdfa4e04b6bdc7029c39ebe5; no voters:
I20260926 13:55:14.499788 7573 leader_election.cc:290] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:14.499913 7575 raft_consensus.cc:2804] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:14.500394 7575 raft_consensus.cc:697] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Becoming Leader. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Running, Role: LEADER
I20260926 13:55:14.501101 7573 ts_tablet_manager.cc:1434] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260926 13:55:14.500965 7575 consensus_queue.cc:237] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.501724 7573 tablet_bootstrap.cc:492] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5: Bootstrap starting.
I20260926 13:55:14.506148 7433 catalog_manager.cc:5838] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd6af087bdfa4e04b6bdc7029c39ebe5 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:14.506472 7573 tablet_bootstrap.cc:654] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:14.510600 7573 tablet_bootstrap.cc:492] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5: No bootstrap required, opened a new log
I20260926 13:55:14.510942 7573 ts_tablet_manager.cc:1403] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260926 13:55:14.512848 7573 raft_consensus.cc:359] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.513320 7573 raft_consensus.cc:385] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:14.513522 7573 raft_consensus.cc:740] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Initialized, Role: FOLLOWER
I20260926 13:55:14.513991 7573 consensus_queue.cc:260] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.514415 7573 raft_consensus.cc:399] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:14.514623 7573 raft_consensus.cc:493] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:14.514886 7573 raft_consensus.cc:3060] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:14.519093 7573 raft_consensus.cc:515] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.519570 7573 leader_election.cc:304] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd6af087bdfa4e04b6bdc7029c39ebe5; no voters:
I20260926 13:55:14.519986 7573 leader_election.cc:290] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:14.520103 7575 raft_consensus.cc:2804] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:14.520537 7575 raft_consensus.cc:697] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Becoming Leader. State: Replica: cd6af087bdfa4e04b6bdc7029c39ebe5, State: Running, Role: LEADER
I20260926 13:55:14.521144 7575 consensus_queue.cc:237] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } }
I20260926 13:55:14.521332 7573 ts_tablet_manager.cc:1434] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260926 13:55:14.526003 7433 catalog_manager.cc:5838] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd6af087bdfa4e04b6bdc7029c39ebe5 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd6af087bdfa4e04b6bdc7029c39ebe5" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 34319 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:14.569394 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:14.582901 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:14.583642 3582 tablet_replica.cc:333] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5: stopping tablet replica
I20260926 13:55:14.584152 3582 raft_consensus.cc:2243] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:14.584535 3582 raft_consensus.cc:2272] T 139c079771984475879d0d10aae0271c P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:14.586615 3582 tablet_replica.cc:333] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5: stopping tablet replica
I20260926 13:55:14.587077 3582 raft_consensus.cc:2243] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:14.587423 3582 raft_consensus.cc:2272] T 89ce0b1ffc3e46918d530c112a1a8c0d P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:14.589272 3582 tablet_replica.cc:333] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5: stopping tablet replica
I20260926 13:55:14.589689 3582 raft_consensus.cc:2243] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:14.590029 3582 raft_consensus.cc:2272] T 3d035f033c3246428a4688cf51936aa5 P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:14.591887 3582 tablet_replica.cc:333] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5: stopping tablet replica
I20260926 13:55:14.592286 3582 raft_consensus.cc:2243] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:14.592648 3582 raft_consensus.cc:2272] T 76c22b71decb4ba8be9d03720732836a P cd6af087bdfa4e04b6bdc7029c39ebe5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:14.603379 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:14.612007 3582 master.cc:562] Master@127.3.127.190:42217 shutting down...
I20260926 13:55:14.624365 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:14.624794 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:14.625172 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9bb46e976eaa4e5281d4fc4aef1d86a1: stopping tablet replica
I20260926 13:55:14.643254 3582 master.cc:584] Master@127.3.127.190:42217 shutdown complete.
[ OK ] Params/TimestampPropagationParamTest.Test/2 (582 ms)
[----------] 3 tests from Params/TimestampPropagationParamTest (1752 ms total)
[----------] 7 tests from FirstRangeDropped/StaleScanTokensParamTest
[ RUN ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/0
I20260926 13:55:14.663019 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:38471
I20260926 13:55:14.663969 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:14.668116 7586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:14.669210 7587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:14.669952 7589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:14.670570 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:14.671211 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:14.671380 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:14.671540 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430914671523 us; error 0 us; skew 500 ppm
I20260926 13:55:14.672005 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:14.674084 3582 webserver.cc:533] Webserver started at http://127.3.127.190:35611/ using document root <none> and password file <none>
I20260926 13:55:14.674506 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:14.674669 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:14.674911 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:14.675850 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "07872c07d18c460da20e3e16dc0a1054"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.679773 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260926 13:55:14.682657 7594 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.683318 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:55:14.683557 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "07872c07d18c460da20e3e16dc0a1054"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.683791 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:14.702317 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:14.703207 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:14.734539 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:38471
I20260926 13:55:14.734632 7645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:38471 every 8 connection(s)
I20260926 13:55:14.737967 7646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.747669 7646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054: Bootstrap starting.
I20260926 13:55:14.751482 7646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:14.754879 7646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054: No bootstrap required, opened a new log
I20260926 13:55:14.756608 7646 raft_consensus.cc:359] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07872c07d18c460da20e3e16dc0a1054" member_type: VOTER }
I20260926 13:55:14.756968 7646 raft_consensus.cc:385] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:14.757181 7646 raft_consensus.cc:740] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07872c07d18c460da20e3e16dc0a1054, State: Initialized, Role: FOLLOWER
I20260926 13:55:14.757687 7646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07872c07d18c460da20e3e16dc0a1054" member_type: VOTER }
I20260926 13:55:14.758091 7646 raft_consensus.cc:399] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:14.758268 7646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:14.758467 7646 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:14.762452 7646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07872c07d18c460da20e3e16dc0a1054" member_type: VOTER }
I20260926 13:55:14.762889 7646 leader_election.cc:304] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07872c07d18c460da20e3e16dc0a1054; no voters:
I20260926 13:55:14.763907 7646 leader_election.cc:290] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:14.764146 7649 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:14.765354 7649 raft_consensus.cc:697] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 1 LEADER]: Becoming Leader. State: Replica: 07872c07d18c460da20e3e16dc0a1054, State: Running, Role: LEADER
I20260926 13:55:14.765929 7649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07872c07d18c460da20e3e16dc0a1054" member_type: VOTER }
I20260926 13:55:14.766676 7646 sys_catalog.cc:565] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:14.768518 7650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07872c07d18c460da20e3e16dc0a1054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07872c07d18c460da20e3e16dc0a1054" member_type: VOTER } }
I20260926 13:55:14.768579 7651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07872c07d18c460da20e3e16dc0a1054. Latest consensus state: current_term: 1 leader_uuid: "07872c07d18c460da20e3e16dc0a1054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07872c07d18c460da20e3e16dc0a1054" member_type: VOTER } }
I20260926 13:55:14.769191 7650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:14.769199 7651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:14.772064 7655 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:14.776510 7655 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:14.780463 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:14.784452 7655 catalog_manager.cc:1396] Generated new cluster ID: 9639342785c247d38128b21e8d7558ac
I20260926 13:55:14.784718 7655 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:14.798597 7655 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:14.799767 7655 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:14.813786 7655 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054: Generated new TSK 0
I20260926 13:55:14.814340 7655 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:14.846284 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:14.851377 7667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:14.852383 7668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:14.853834 7670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:14.854240 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:14.854923 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:14.855104 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:14.855244 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430914855229 us; error 0 us; skew 500 ppm
I20260926 13:55:14.855713 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:14.857676 3582 webserver.cc:533] Webserver started at http://127.3.127.129:40151/ using document root <none> and password file <none>
I20260926 13:55:14.858083 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:14.858248 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:14.858471 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:14.859436 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "b74f18fea378438abeab0cca20e90634"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.863373 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260926 13:55:14.866240 7675 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.866865 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260926 13:55:14.867107 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "b74f18fea378438abeab0cca20e90634"
format_stamp: "Formatted at 2026-09-26 13:55:14 on dist-test-slave-fk7n"
I20260926 13:55:14.867352 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:14.879372 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:14.880208 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:14.881465 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:14.883390 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:14.883575 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.883780 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:14.883920 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:14.919278 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:43575
I20260926 13:55:14.919364 7737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:43575 every 8 connection(s)
I20260926 13:55:14.931891 7738 heartbeater.cc:344] Connected to a master server at 127.3.127.190:38471
I20260926 13:55:14.932190 7738 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:14.932785 7738 heartbeater.cc:507] Master 127.3.127.190:38471 requested a full tablet report, sending...
I20260926 13:55:14.934525 7611 ts_manager.cc:194] Registered new tserver with Master: b74f18fea378438abeab0cca20e90634 (127.3.127.129:43575)
I20260926 13:55:14.934717 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012592778s
I20260926 13:55:14.936084 7611 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57048
I20260926 13:55:14.953811 7611 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57060:
name: "stale-scan-tokens-dfr"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260926 13:55:14.980577 7703 tablet_service.cc:1511] Processing CreateTablet for tablet f0d1024c47e14b42beaf8bd7519ad40f (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=3c06eb374203447799d19d6547b54b94]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:14.980978 7702 tablet_service.cc:1511] Processing CreateTablet for tablet 39cf11179ac14488ac603f128af130d6 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=3c06eb374203447799d19d6547b54b94]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260926 13:55:14.981741 7703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d1024c47e14b42beaf8bd7519ad40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.982214 7702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cf11179ac14488ac603f128af130d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:14.993103 7750 tablet_bootstrap.cc:492] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: Bootstrap starting.
I20260926 13:55:14.996829 7750 tablet_bootstrap.cc:654] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:15.000321 7750 tablet_bootstrap.cc:492] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: No bootstrap required, opened a new log
I20260926 13:55:15.000620 7750 ts_tablet_manager.cc:1403] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260926 13:55:15.002375 7750 raft_consensus.cc:359] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.002743 7750 raft_consensus.cc:385] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:15.002918 7750 raft_consensus.cc:740] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74f18fea378438abeab0cca20e90634, State: Initialized, Role: FOLLOWER
I20260926 13:55:15.003350 7750 consensus_queue.cc:260] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.003759 7750 raft_consensus.cc:399] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:15.003942 7750 raft_consensus.cc:493] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:15.004143 7750 raft_consensus.cc:3060] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:15.008455 7750 raft_consensus.cc:515] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.008950 7750 leader_election.cc:304] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b74f18fea378438abeab0cca20e90634; no voters:
I20260926 13:55:15.009961 7750 leader_election.cc:290] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:15.010222 7752 raft_consensus.cc:2804] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:15.011397 7752 raft_consensus.cc:697] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 1 LEADER]: Becoming Leader. State: Replica: b74f18fea378438abeab0cca20e90634, State: Running, Role: LEADER
I20260926 13:55:15.011592 7738 heartbeater.cc:499] Master 127.3.127.190:38471 was elected leader, sending a full tablet report...
I20260926 13:55:15.012122 7750 ts_tablet_manager.cc:1434] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: Time spent starting tablet: real 0.011s user 0.008s sys 0.002s
I20260926 13:55:15.012084 7752 consensus_queue.cc:237] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.012910 7750 tablet_bootstrap.cc:492] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634: Bootstrap starting.
I20260926 13:55:15.018424 7611 catalog_manager.cc:5838] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 reported cstate change: term changed from 0 to 1, leader changed from <none> to b74f18fea378438abeab0cca20e90634 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "b74f18fea378438abeab0cca20e90634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:15.018859 7750 tablet_bootstrap.cc:654] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:15.022557 7750 tablet_bootstrap.cc:492] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634: No bootstrap required, opened a new log
I20260926 13:55:15.022929 7750 ts_tablet_manager.cc:1403] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260926 13:55:15.024885 7750 raft_consensus.cc:359] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.025230 7750 raft_consensus.cc:385] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:15.025436 7750 raft_consensus.cc:740] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b74f18fea378438abeab0cca20e90634, State: Initialized, Role: FOLLOWER
I20260926 13:55:15.026069 7750 consensus_queue.cc:260] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.026482 7750 raft_consensus.cc:399] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:15.026692 7750 raft_consensus.cc:493] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:15.026932 7750 raft_consensus.cc:3060] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:15.031919 7750 raft_consensus.cc:515] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.032366 7750 leader_election.cc:304] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b74f18fea378438abeab0cca20e90634; no voters:
I20260926 13:55:15.032776 7750 leader_election.cc:290] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:15.032919 7752 raft_consensus.cc:2804] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:15.033354 7752 raft_consensus.cc:697] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 1 LEADER]: Becoming Leader. State: Replica: b74f18fea378438abeab0cca20e90634, State: Running, Role: LEADER
I20260926 13:55:15.034000 7752 consensus_queue.cc:237] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } }
I20260926 13:55:15.034324 7750 ts_tablet_manager.cc:1434] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634: Time spent starting tablet: real 0.011s user 0.010s sys 0.002s
I20260926 13:55:15.038964 7611 catalog_manager.cc:5838] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 reported cstate change: term changed from 0 to 1, leader changed from <none> to b74f18fea378438abeab0cca20e90634 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "b74f18fea378438abeab0cca20e90634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b74f18fea378438abeab0cca20e90634" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:15.713385 7611 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57060:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260926 13:55:15.724520 7611 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054: Sending DeleteTablet for 1 replicas of tablet f0d1024c47e14b42beaf8bd7519ad40f
I20260926 13:55:15.726361 7702 tablet_service.cc:1558] Processing DeleteTablet for tablet f0d1024c47e14b42beaf8bd7519ad40f with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-09-26 13:55:15 UTC) from {username='slave'} at 127.0.0.1:37726
I20260926 13:55:15.727795 7764 tablet_replica.cc:333] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: stopping tablet replica
I20260926 13:55:15.728574 7764 raft_consensus.cc:2243] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:15.729108 7764 raft_consensus.cc:2272] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:15.731386 7764 ts_tablet_manager.cc:1916] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260926 13:55:15.742537 7764 ts_tablet_manager.cc:1929] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.51
I20260926 13:55:15.742940 7764 log.cc:1199] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: Deleting WAL directory at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_0.1790430890430161-3582-0/minicluster-data/ts-0-root/wals/f0d1024c47e14b42beaf8bd7519ad40f
I20260926 13:55:15.743697 7764 ts_tablet_manager.cc:1950] T f0d1024c47e14b42beaf8bd7519ad40f P b74f18fea378438abeab0cca20e90634: Deleting consensus metadata
I20260926 13:55:15.746052 7598 catalog_manager.cc:5063] TS b74f18fea378438abeab0cca20e90634 (127.3.127.129:43575): tablet f0d1024c47e14b42beaf8bd7519ad40f (table stale-scan-tokens-dfr [id=3c06eb374203447799d19d6547b54b94]) successfully deleted
I20260926 13:55:15.787060 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:15.802871 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:15.803622 3582 tablet_replica.cc:333] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634: stopping tablet replica
I20260926 13:55:15.804267 3582 raft_consensus.cc:2243] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:15.804812 3582 raft_consensus.cc:2272] T 39cf11179ac14488ac603f128af130d6 P b74f18fea378438abeab0cca20e90634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:15.822511 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:15.831105 3582 master.cc:562] Master@127.3.127.190:38471 shutting down...
I20260926 13:55:15.845993 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:15.846454 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:15.846755 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 07872c07d18c460da20e3e16dc0a1054: stopping tablet replica
I20260926 13:55:15.863296 3582 master.cc:584] Master@127.3.127.190:38471 shutdown complete.
[ OK ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/0 (1218 ms)
[ RUN ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/1
I20260926 13:55:15.881338 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:38167
I20260926 13:55:15.882230 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:15.886360 7773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:15.887403 7774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:15.888207 7776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:15.888356 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:15.889078 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:15.889237 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:15.889345 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430915889335 us; error 0 us; skew 500 ppm
I20260926 13:55:15.889748 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:15.891638 3582 webserver.cc:533] Webserver started at http://127.3.127.190:43977/ using document root <none> and password file <none>
I20260926 13:55:15.892019 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:15.892158 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:15.892344 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:15.893306 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "e55e0fbca0a24134914191e93d83137b"
format_stamp: "Formatted at 2026-09-26 13:55:15 on dist-test-slave-fk7n"
I20260926 13:55:15.897300 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260926 13:55:15.900164 7781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:15.900839 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:15.901077 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "e55e0fbca0a24134914191e93d83137b"
format_stamp: "Formatted at 2026-09-26 13:55:15 on dist-test-slave-fk7n"
I20260926 13:55:15.901300 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:15.913651 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:15.914481 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:15.946038 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:38167
I20260926 13:55:15.946132 7832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:38167 every 8 connection(s)
I20260926 13:55:15.949398 7833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:15.958670 7833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b: Bootstrap starting.
I20260926 13:55:15.962493 7833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:15.965812 7833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b: No bootstrap required, opened a new log
I20260926 13:55:15.967564 7833 raft_consensus.cc:359] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55e0fbca0a24134914191e93d83137b" member_type: VOTER }
I20260926 13:55:15.967901 7833 raft_consensus.cc:385] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:15.968097 7833 raft_consensus.cc:740] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e55e0fbca0a24134914191e93d83137b, State: Initialized, Role: FOLLOWER
I20260926 13:55:15.968624 7833 consensus_queue.cc:260] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55e0fbca0a24134914191e93d83137b" member_type: VOTER }
I20260926 13:55:15.969105 7833 raft_consensus.cc:399] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:15.969308 7833 raft_consensus.cc:493] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:15.969550 7833 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:15.973368 7833 raft_consensus.cc:515] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55e0fbca0a24134914191e93d83137b" member_type: VOTER }
I20260926 13:55:15.973821 7833 leader_election.cc:304] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e55e0fbca0a24134914191e93d83137b; no voters:
I20260926 13:55:15.974817 7833 leader_election.cc:290] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:15.975054 7836 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:15.976222 7836 raft_consensus.cc:697] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 1 LEADER]: Becoming Leader. State: Replica: e55e0fbca0a24134914191e93d83137b, State: Running, Role: LEADER
I20260926 13:55:15.976835 7836 consensus_queue.cc:237] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55e0fbca0a24134914191e93d83137b" member_type: VOTER }
I20260926 13:55:15.977351 7833 sys_catalog.cc:565] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:15.979290 7837 sys_catalog.cc:455] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e55e0fbca0a24134914191e93d83137b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55e0fbca0a24134914191e93d83137b" member_type: VOTER } }
I20260926 13:55:15.979336 7838 sys_catalog.cc:455] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e55e0fbca0a24134914191e93d83137b. Latest consensus state: current_term: 1 leader_uuid: "e55e0fbca0a24134914191e93d83137b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e55e0fbca0a24134914191e93d83137b" member_type: VOTER } }
I20260926 13:55:15.980033 7838 sys_catalog.cc:458] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:15.979967 7837 sys_catalog.cc:458] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:15.986200 7841 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:15.992663 7841 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:15.993561 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:16.000116 7841 catalog_manager.cc:1396] Generated new cluster ID: a82f9652875244db87d0b4c91ea41510
I20260926 13:55:16.000361 7841 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:16.012970 7841 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:16.014110 7841 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:16.028851 7841 catalog_manager.cc:6219] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b: Generated new TSK 0
I20260926 13:55:16.029345 7841 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:16.059301 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:16.064466 7854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:16.065426 7855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:16.066630 7857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:16.066778 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:16.067523 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:16.067699 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:16.067830 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430916067814 us; error 0 us; skew 500 ppm
I20260926 13:55:16.068249 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:16.070263 3582 webserver.cc:533] Webserver started at http://127.3.127.129:34997/ using document root <none> and password file <none>
I20260926 13:55:16.070652 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:16.070809 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:16.071015 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:16.071959 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "225544af8d5d4227a5ffdcaac4ee3059"
format_stamp: "Formatted at 2026-09-26 13:55:16 on dist-test-slave-fk7n"
I20260926 13:55:16.075949 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:55:16.078917 7862 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:16.079586 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:16.079865 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "225544af8d5d4227a5ffdcaac4ee3059"
format_stamp: "Formatted at 2026-09-26 13:55:16 on dist-test-slave-fk7n"
I20260926 13:55:16.080099 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:16.109659 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:16.110574 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:16.111872 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:16.114353 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:16.114584 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:16.114884 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:16.115091 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:16.149920 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:39949
I20260926 13:55:16.150050 7924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:39949 every 8 connection(s)
I20260926 13:55:16.163275 7925 heartbeater.cc:344] Connected to a master server at 127.3.127.190:38167
I20260926 13:55:16.163617 7925 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:16.164235 7925 heartbeater.cc:507] Master 127.3.127.190:38167 requested a full tablet report, sending...
I20260926 13:55:16.166030 7798 ts_manager.cc:194] Registered new tserver with Master: 225544af8d5d4227a5ffdcaac4ee3059 (127.3.127.129:39949)
I20260926 13:55:16.166795 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.013942749s
I20260926 13:55:16.167893 7798 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58968
I20260926 13:55:16.186481 7798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58972:
name: "stale-scan-tokens-dfr"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260926 13:55:16.213402 7890 tablet_service.cc:1511] Processing CreateTablet for tablet 2183714e250e45bf936882c8f8e53ccd (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=e7c6122c3b5f4d40b1d823e8d3757234]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:16.213526 7889 tablet_service.cc:1511] Processing CreateTablet for tablet 84ae992f050542baa337c5bd8619015c (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=e7c6122c3b5f4d40b1d823e8d3757234]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260926 13:55:16.214730 7890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2183714e250e45bf936882c8f8e53ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:16.215323 7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ae992f050542baa337c5bd8619015c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:16.230235 7937 tablet_bootstrap.cc:492] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: Bootstrap starting.
I20260926 13:55:16.234191 7937 tablet_bootstrap.cc:654] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:16.237458 7937 tablet_bootstrap.cc:492] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: No bootstrap required, opened a new log
I20260926 13:55:16.237756 7937 ts_tablet_manager.cc:1403] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260926 13:55:16.239861 7937 raft_consensus.cc:359] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.240231 7937 raft_consensus.cc:385] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:16.240406 7937 raft_consensus.cc:740] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225544af8d5d4227a5ffdcaac4ee3059, State: Initialized, Role: FOLLOWER
I20260926 13:55:16.240893 7937 consensus_queue.cc:260] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.241297 7937 raft_consensus.cc:399] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:16.241482 7937 raft_consensus.cc:493] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:16.241679 7937 raft_consensus.cc:3060] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:16.245962 7937 raft_consensus.cc:515] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.246412 7937 leader_election.cc:304] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 225544af8d5d4227a5ffdcaac4ee3059; no voters:
I20260926 13:55:16.247387 7937 leader_election.cc:290] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:16.247666 7939 raft_consensus.cc:2804] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:16.248934 7939 raft_consensus.cc:697] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 LEADER]: Becoming Leader. State: Replica: 225544af8d5d4227a5ffdcaac4ee3059, State: Running, Role: LEADER
I20260926 13:55:16.249604 7925 heartbeater.cc:499] Master 127.3.127.190:38167 was elected leader, sending a full tablet report...
I20260926 13:55:16.249617 7939 consensus_queue.cc:237] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.251094 7937 ts_tablet_manager.cc:1434] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: Time spent starting tablet: real 0.013s user 0.011s sys 0.002s
I20260926 13:55:16.251963 7937 tablet_bootstrap.cc:492] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059: Bootstrap starting.
I20260926 13:55:16.257133 7937 tablet_bootstrap.cc:654] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:16.256886 7798 catalog_manager.cc:5838] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225544af8d5d4227a5ffdcaac4ee3059 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "225544af8d5d4227a5ffdcaac4ee3059" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:16.261454 7937 tablet_bootstrap.cc:492] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059: No bootstrap required, opened a new log
I20260926 13:55:16.261852 7937 ts_tablet_manager.cc:1403] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:55:16.264099 7937 raft_consensus.cc:359] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.264492 7937 raft_consensus.cc:385] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:16.264694 7937 raft_consensus.cc:740] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225544af8d5d4227a5ffdcaac4ee3059, State: Initialized, Role: FOLLOWER
I20260926 13:55:16.265255 7937 consensus_queue.cc:260] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.265741 7937 raft_consensus.cc:399] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:16.265964 7937 raft_consensus.cc:493] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:16.266201 7937 raft_consensus.cc:3060] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:16.270925 7937 raft_consensus.cc:515] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.271394 7937 leader_election.cc:304] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 225544af8d5d4227a5ffdcaac4ee3059; no voters:
I20260926 13:55:16.271832 7937 leader_election.cc:290] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:16.271951 7939 raft_consensus.cc:2804] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:16.272403 7939 raft_consensus.cc:697] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 LEADER]: Becoming Leader. State: Replica: 225544af8d5d4227a5ffdcaac4ee3059, State: Running, Role: LEADER
I20260926 13:55:16.273135 7937 ts_tablet_manager.cc:1434] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260926 13:55:16.272986 7939 consensus_queue.cc:237] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:16.277931 7798 catalog_manager.cc:5838] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225544af8d5d4227a5ffdcaac4ee3059 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "225544af8d5d4227a5ffdcaac4ee3059" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:16.931551 7798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58972:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260926 13:55:16.941354 7798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b: Sending DeleteTablet for 1 replicas of tablet 2183714e250e45bf936882c8f8e53ccd
I20260926 13:55:16.942955 7889 tablet_service.cc:1558] Processing DeleteTablet for tablet 2183714e250e45bf936882c8f8e53ccd with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-09-26 13:55:16 UTC) from {username='slave'} at 127.0.0.1:54516
I20260926 13:55:16.944252 7951 tablet_replica.cc:333] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: stopping tablet replica
I20260926 13:55:16.944836 7951 raft_consensus.cc:2243] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:16.945340 7951 raft_consensus.cc:2272] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:16.947672 7951 ts_tablet_manager.cc:1916] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260926 13:55:16.959612 7951 ts_tablet_manager.cc:1929] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.51
I20260926 13:55:16.959941 7951 log.cc:1199] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: Deleting WAL directory at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_1.1790430890430161-3582-0/minicluster-data/ts-0-root/wals/2183714e250e45bf936882c8f8e53ccd
I20260926 13:55:16.960800 7951 ts_tablet_manager.cc:1950] T 2183714e250e45bf936882c8f8e53ccd P 225544af8d5d4227a5ffdcaac4ee3059: Deleting consensus metadata
I20260926 13:55:16.963006 7785 catalog_manager.cc:5063] TS 225544af8d5d4227a5ffdcaac4ee3059 (127.3.127.129:39949): tablet 2183714e250e45bf936882c8f8e53ccd (table stale-scan-tokens-dfr [id=e7c6122c3b5f4d40b1d823e8d3757234]) successfully deleted
I20260926 13:55:16.990628 7798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58972:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\0018\377\377\377\377\377\377\377\007\001\234\377\377\377\377\377\377\377""\006\0018\377\377\377\377\377\377\377\007\001\234\377\377\377\377\377\377\377" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:16.999490 7798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9eb5b9d75f4a4b3bb6ad7f037848d3a3 has no consensus state
I20260926 13:55:17.008555 7889 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb5b9d75f4a4b3bb6ad7f037848d3a3 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=e7c6122c3b5f4d40b1d823e8d3757234]), partition=RANGE (key) PARTITION -200 <= VALUES < -100
I20260926 13:55:17.009477 7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb5b9d75f4a4b3bb6ad7f037848d3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:17.020447 7960 tablet_bootstrap.cc:492] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059: Bootstrap starting.
I20260926 13:55:17.025077 7960 tablet_bootstrap.cc:654] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059: Neither blocks nor log segments found. Creating new log.
W20260926 13:55:17.026866 7782 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 9eb5b9d75f4a4b3bb6ad7f037848d3a3 (table stale-scan-tokens-dfr [id=e7c6122c3b5f4d40b1d823e8d3757234], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9eb5b9d75f4a4b3bb6ad7f037848d3a3 consensus state has no leader
I20260926 13:55:17.028661 7960 tablet_bootstrap.cc:492] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059: No bootstrap required, opened a new log
I20260926 13:55:17.029083 7960 ts_tablet_manager.cc:1403] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260926 13:55:17.030989 7960 raft_consensus.cc:359] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:17.031373 7960 raft_consensus.cc:385] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:17.031574 7960 raft_consensus.cc:740] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225544af8d5d4227a5ffdcaac4ee3059, State: Initialized, Role: FOLLOWER
I20260926 13:55:17.032111 7960 consensus_queue.cc:260] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:17.032552 7960 raft_consensus.cc:399] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:17.032780 7960 raft_consensus.cc:493] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:17.033025 7960 raft_consensus.cc:3060] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:17.037684 7960 raft_consensus.cc:515] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:17.038169 7960 leader_election.cc:304] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 225544af8d5d4227a5ffdcaac4ee3059; no voters:
I20260926 13:55:17.038594 7960 leader_election.cc:290] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:17.038738 7939 raft_consensus.cc:2804] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:17.040045 7939 raft_consensus.cc:697] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 LEADER]: Becoming Leader. State: Replica: 225544af8d5d4227a5ffdcaac4ee3059, State: Running, Role: LEADER
I20260926 13:55:17.040966 7960 ts_tablet_manager.cc:1434] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260926 13:55:17.040719 7939 consensus_queue.cc:237] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } }
I20260926 13:55:17.045955 7798 catalog_manager.cc:5838] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225544af8d5d4227a5ffdcaac4ee3059 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "225544af8d5d4227a5ffdcaac4ee3059" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "225544af8d5d4227a5ffdcaac4ee3059" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39949 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:17.056270 7798 catalog_manager.cc:6391] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b: stale-scan-tokens-dfr [id=e7c6122c3b5f4d40b1d823e8d3757234] alter complete (version 0)
I20260926 13:55:17.084368 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:17.099124 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:17.099967 3582 tablet_replica.cc:333] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059: stopping tablet replica
I20260926 13:55:17.100401 3582 raft_consensus.cc:2243] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:17.100777 3582 raft_consensus.cc:2272] T 9eb5b9d75f4a4b3bb6ad7f037848d3a3 P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:17.102880 3582 tablet_replica.cc:333] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059: stopping tablet replica
I20260926 13:55:17.103312 3582 raft_consensus.cc:2243] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:17.103674 3582 raft_consensus.cc:2272] T 84ae992f050542baa337c5bd8619015c P 225544af8d5d4227a5ffdcaac4ee3059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:17.121624 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:17.130841 3582 master.cc:562] Master@127.3.127.190:38167 shutting down...
I20260926 13:55:17.144778 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:17.145213 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:17.145511 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P e55e0fbca0a24134914191e93d83137b: stopping tablet replica
I20260926 13:55:17.162606 3582 master.cc:584] Master@127.3.127.190:38167 shutdown complete.
[ OK ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/1 (1300 ms)
[ RUN ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/2
I20260926 13:55:17.181607 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:33161
I20260926 13:55:17.182523 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:17.186728 7965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:17.187388 7966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:17.187999 7968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:17.190219 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:17.191012 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:17.191185 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:17.191334 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430917191320 us; error 0 us; skew 500 ppm
I20260926 13:55:17.191810 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:17.193884 3582 webserver.cc:533] Webserver started at http://127.3.127.190:43057/ using document root <none> and password file <none>
I20260926 13:55:17.194311 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:17.194458 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:17.194720 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:17.195664 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "239394016c7c4f8e90935ddf00e1d995"
format_stamp: "Formatted at 2026-09-26 13:55:17 on dist-test-slave-fk7n"
I20260926 13:55:17.199705 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:55:17.202689 7973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:17.203341 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260926 13:55:17.203578 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "239394016c7c4f8e90935ddf00e1d995"
format_stamp: "Formatted at 2026-09-26 13:55:17 on dist-test-slave-fk7n"
I20260926 13:55:17.203836 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:17.214727 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:17.215643 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:17.247023 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:33161
I20260926 13:55:17.247105 8024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:33161 every 8 connection(s)
I20260926 13:55:17.250391 8025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:17.259598 8025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995: Bootstrap starting.
I20260926 13:55:17.263423 8025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:17.266745 8025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995: No bootstrap required, opened a new log
I20260926 13:55:17.268484 8025 raft_consensus.cc:359] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239394016c7c4f8e90935ddf00e1d995" member_type: VOTER }
I20260926 13:55:17.268875 8025 raft_consensus.cc:385] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:17.269085 8025 raft_consensus.cc:740] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 239394016c7c4f8e90935ddf00e1d995, State: Initialized, Role: FOLLOWER
I20260926 13:55:17.269615 8025 consensus_queue.cc:260] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239394016c7c4f8e90935ddf00e1d995" member_type: VOTER }
I20260926 13:55:17.270045 8025 raft_consensus.cc:399] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:17.270248 8025 raft_consensus.cc:493] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:17.270476 8025 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:17.274276 8025 raft_consensus.cc:515] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239394016c7c4f8e90935ddf00e1d995" member_type: VOTER }
I20260926 13:55:17.274746 8025 leader_election.cc:304] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 239394016c7c4f8e90935ddf00e1d995; no voters:
I20260926 13:55:17.275687 8025 leader_election.cc:290] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:17.276024 8028 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:17.277235 8028 raft_consensus.cc:697] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 1 LEADER]: Becoming Leader. State: Replica: 239394016c7c4f8e90935ddf00e1d995, State: Running, Role: LEADER
I20260926 13:55:17.277734 8028 consensus_queue.cc:237] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239394016c7c4f8e90935ddf00e1d995" member_type: VOTER }
I20260926 13:55:17.278316 8025 sys_catalog.cc:565] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:17.280270 8029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "239394016c7c4f8e90935ddf00e1d995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239394016c7c4f8e90935ddf00e1d995" member_type: VOTER } }
I20260926 13:55:17.280355 8030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 239394016c7c4f8e90935ddf00e1d995. Latest consensus state: current_term: 1 leader_uuid: "239394016c7c4f8e90935ddf00e1d995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "239394016c7c4f8e90935ddf00e1d995" member_type: VOTER } }
I20260926 13:55:17.280943 8030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:17.280944 8029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:17.283911 8035 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:17.290529 8035 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:17.291414 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:17.297976 8035 catalog_manager.cc:1396] Generated new cluster ID: 1d570fc37d5b45c48899a0dec929029d
I20260926 13:55:17.298233 8035 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:17.321127 8035 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:17.322268 8035 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:17.331995 8035 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995: Generated new TSK 0
I20260926 13:55:17.332495 8035 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:17.357110 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:17.362366 8046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:17.363353 8047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:17.364444 8049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:17.364642 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:17.365374 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:17.365542 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:17.365659 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430917365646 us; error 0 us; skew 500 ppm
I20260926 13:55:17.366144 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:17.368045 3582 webserver.cc:533] Webserver started at http://127.3.127.129:39911/ using document root <none> and password file <none>
I20260926 13:55:17.368438 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:17.368582 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:17.368811 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:17.369742 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "6de6068674b84971b653284ed4a02ff8"
format_stamp: "Formatted at 2026-09-26 13:55:17 on dist-test-slave-fk7n"
I20260926 13:55:17.373659 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260926 13:55:17.376573 8054 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:17.377275 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:17.377501 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "6de6068674b84971b653284ed4a02ff8"
format_stamp: "Formatted at 2026-09-26 13:55:17 on dist-test-slave-fk7n"
I20260926 13:55:17.377720 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:17.392379 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:17.393222 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:17.394448 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:17.396454 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:17.396616 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:17.396798 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:17.396920 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:17.431463 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:39975
I20260926 13:55:17.431550 8116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:39975 every 8 connection(s)
I20260926 13:55:17.443552 8117 heartbeater.cc:344] Connected to a master server at 127.3.127.190:33161
I20260926 13:55:17.443881 8117 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:17.444506 8117 heartbeater.cc:507] Master 127.3.127.190:33161 requested a full tablet report, sending...
I20260926 13:55:17.446308 7990 ts_manager.cc:194] Registered new tserver with Master: 6de6068674b84971b653284ed4a02ff8 (127.3.127.129:39975)
I20260926 13:55:17.447008 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012689041s
I20260926 13:55:17.447934 7990 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45986
I20260926 13:55:17.465706 7990 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45998:
name: "stale-scan-tokens-dfr"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260926 13:55:17.492851 8082 tablet_service.cc:1511] Processing CreateTablet for tablet 0f33ab6396b941ccb6ce9435f81867e1 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=3a962e6c68914aef8ebafa442c000faf]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:17.493180 8081 tablet_service.cc:1511] Processing CreateTablet for tablet 22deb905a1f74e1fa24a03999415210d (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=3a962e6c68914aef8ebafa442c000faf]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260926 13:55:17.494088 8082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f33ab6396b941ccb6ce9435f81867e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:17.494676 8081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22deb905a1f74e1fa24a03999415210d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:17.509505 8129 tablet_bootstrap.cc:492] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: Bootstrap starting.
I20260926 13:55:17.513651 8129 tablet_bootstrap.cc:654] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:17.516924 8129 tablet_bootstrap.cc:492] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: No bootstrap required, opened a new log
I20260926 13:55:17.517225 8129 ts_tablet_manager.cc:1403] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260926 13:55:17.519448 8129 raft_consensus.cc:359] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.519845 8129 raft_consensus.cc:385] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:17.520061 8129 raft_consensus.cc:740] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de6068674b84971b653284ed4a02ff8, State: Initialized, Role: FOLLOWER
I20260926 13:55:17.520609 8129 consensus_queue.cc:260] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.521078 8129 raft_consensus.cc:399] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:17.521298 8129 raft_consensus.cc:493] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:17.521546 8129 raft_consensus.cc:3060] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:17.525533 8129 raft_consensus.cc:515] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.526021 8129 leader_election.cc:304] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6de6068674b84971b653284ed4a02ff8; no voters:
I20260926 13:55:17.527235 8129 leader_election.cc:290] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:17.527555 8131 raft_consensus.cc:2804] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:17.529043 8117 heartbeater.cc:499] Master 127.3.127.190:33161 was elected leader, sending a full tablet report...
I20260926 13:55:17.529461 8131 raft_consensus.cc:697] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 1 LEADER]: Becoming Leader. State: Replica: 6de6068674b84971b653284ed4a02ff8, State: Running, Role: LEADER
I20260926 13:55:17.529547 8129 ts_tablet_manager.cc:1434] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260926 13:55:17.530032 8131 consensus_queue.cc:237] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.530278 8129 tablet_bootstrap.cc:492] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8: Bootstrap starting.
I20260926 13:55:17.535732 8129 tablet_bootstrap.cc:654] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:17.535898 7990 catalog_manager.cc:5838] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6de6068674b84971b653284ed4a02ff8 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6de6068674b84971b653284ed4a02ff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:17.539899 8129 tablet_bootstrap.cc:492] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8: No bootstrap required, opened a new log
I20260926 13:55:17.540300 8129 ts_tablet_manager.cc:1403] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260926 13:55:17.542344 8129 raft_consensus.cc:359] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.542794 8129 raft_consensus.cc:385] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:17.543067 8129 raft_consensus.cc:740] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de6068674b84971b653284ed4a02ff8, State: Initialized, Role: FOLLOWER
I20260926 13:55:17.543677 8129 consensus_queue.cc:260] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.544235 8129 raft_consensus.cc:399] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:17.544461 8129 raft_consensus.cc:493] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:17.544703 8129 raft_consensus.cc:3060] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:17.550203 8129 raft_consensus.cc:515] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.550678 8129 leader_election.cc:304] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6de6068674b84971b653284ed4a02ff8; no voters:
I20260926 13:55:17.551107 8129 leader_election.cc:290] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:17.551234 8131 raft_consensus.cc:2804] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:17.551689 8131 raft_consensus.cc:697] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 1 LEADER]: Becoming Leader. State: Replica: 6de6068674b84971b653284ed4a02ff8, State: Running, Role: LEADER
I20260926 13:55:17.552366 8129 ts_tablet_manager.cc:1434] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260926 13:55:17.552656 8131 consensus_queue.cc:237] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:17.557704 7990 catalog_manager.cc:5838] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6de6068674b84971b653284ed4a02ff8 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6de6068674b84971b653284ed4a02ff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:18.195993 7990 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45998:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260926 13:55:18.206043 7990 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995: Sending DeleteTablet for 1 replicas of tablet 0f33ab6396b941ccb6ce9435f81867e1
I20260926 13:55:18.207533 8081 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f33ab6396b941ccb6ce9435f81867e1 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-09-26 13:55:18 UTC) from {username='slave'} at 127.0.0.1:33152
I20260926 13:55:18.208894 8143 tablet_replica.cc:333] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: stopping tablet replica
I20260926 13:55:18.209514 8143 raft_consensus.cc:2243] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:18.209970 8143 raft_consensus.cc:2272] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:18.212460 8143 ts_tablet_manager.cc:1916] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260926 13:55:18.223577 8143 ts_tablet_manager.cc:1929] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.51
I20260926 13:55:18.223853 8143 log.cc:1199] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: Deleting WAL directory at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_2.1790430890430161-3582-0/minicluster-data/ts-0-root/wals/0f33ab6396b941ccb6ce9435f81867e1
I20260926 13:55:18.224399 8143 ts_tablet_manager.cc:1950] T 0f33ab6396b941ccb6ce9435f81867e1 P 6de6068674b84971b653284ed4a02ff8: Deleting consensus metadata
I20260926 13:55:18.226480 7974 catalog_manager.cc:5063] TS 6de6068674b84971b653284ed4a02ff8 (127.3.127.129:39975): tablet 0f33ab6396b941ccb6ce9435f81867e1 (table stale-scan-tokens-dfr [id=3a962e6c68914aef8ebafa442c000faf]) successfully deleted
I20260926 13:55:18.257880 7990 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45998:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\0018\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\0018\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:18.266340 7990 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a0eb2973e05472aad91c3342c7647e0 has no consensus state
I20260926 13:55:18.276177 8081 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0eb2973e05472aad91c3342c7647e0 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=3a962e6c68914aef8ebafa442c000faf]), partition=RANGE (key) PARTITION -200 <= VALUES < 0
I20260926 13:55:18.277096 8081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0eb2973e05472aad91c3342c7647e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:18.288085 8152 tablet_bootstrap.cc:492] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8: Bootstrap starting.
I20260926 13:55:18.292007 8152 tablet_bootstrap.cc:654] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:18.295317 8152 tablet_bootstrap.cc:492] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8: No bootstrap required, opened a new log
I20260926 13:55:18.295689 8152 ts_tablet_manager.cc:1403] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260926 13:55:18.297456 8152 raft_consensus.cc:359] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:18.297840 8152 raft_consensus.cc:385] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:18.298049 8152 raft_consensus.cc:740] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de6068674b84971b653284ed4a02ff8, State: Initialized, Role: FOLLOWER
I20260926 13:55:18.298578 8152 consensus_queue.cc:260] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:18.299034 8152 raft_consensus.cc:399] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:18.299249 8152 raft_consensus.cc:493] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:18.299482 8152 raft_consensus.cc:3060] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:18.303836 8152 raft_consensus.cc:515] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
I20260926 13:55:18.304301 8152 leader_election.cc:304] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6de6068674b84971b653284ed4a02ff8; no voters:
I20260926 13:55:18.304734 8152 leader_election.cc:290] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:18.304920 8131 raft_consensus.cc:2804] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:18.306136 8131 raft_consensus.cc:697] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 1 LEADER]: Becoming Leader. State: Replica: 6de6068674b84971b653284ed4a02ff8, State: Running, Role: LEADER
I20260926 13:55:18.307044 8152 ts_tablet_manager.cc:1434] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260926 13:55:18.306835 8131 consensus_queue.cc:237] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } }
W20260926 13:55:18.310909 7974 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8a0eb2973e05472aad91c3342c7647e0 (table stale-scan-tokens-dfr [id=3a962e6c68914aef8ebafa442c000faf], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8a0eb2973e05472aad91c3342c7647e0 consensus state has no leader
I20260926 13:55:18.312088 7990 catalog_manager.cc:5838] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6de6068674b84971b653284ed4a02ff8 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6de6068674b84971b653284ed4a02ff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6de6068674b84971b653284ed4a02ff8" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39975 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:18.322229 7990 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995: stale-scan-tokens-dfr [id=3a962e6c68914aef8ebafa442c000faf] alter complete (version 0)
I20260926 13:55:19.266323 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:19.280881 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:19.281401 3582 tablet_replica.cc:333] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8: stopping tablet replica
I20260926 13:55:19.281852 3582 raft_consensus.cc:2243] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:19.282235 3582 raft_consensus.cc:2272] T 8a0eb2973e05472aad91c3342c7647e0 P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:19.284206 3582 tablet_replica.cc:333] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8: stopping tablet replica
I20260926 13:55:19.284610 3582 raft_consensus.cc:2243] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:19.285014 3582 raft_consensus.cc:2272] T 22deb905a1f74e1fa24a03999415210d P 6de6068674b84971b653284ed4a02ff8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:19.303570 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:19.312783 3582 master.cc:562] Master@127.3.127.190:33161 shutting down...
I20260926 13:55:19.328913 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:19.329363 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:19.329644 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 239394016c7c4f8e90935ddf00e1d995: stopping tablet replica
I20260926 13:55:19.345757 3582 master.cc:584] Master@127.3.127.190:33161 shutdown complete.
[ OK ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/2 (2184 ms)
[ RUN ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/3
I20260926 13:55:19.366061 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:35001
I20260926 13:55:19.367019 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:19.371300 8157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:19.372696 8158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:19.372696 8160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:19.373121 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:19.373875 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:19.374043 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:19.374203 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430919374187 us; error 0 us; skew 500 ppm
I20260926 13:55:19.374712 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:19.376665 3582 webserver.cc:533] Webserver started at http://127.3.127.190:46713/ using document root <none> and password file <none>
I20260926 13:55:19.377207 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:19.377382 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:19.377641 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:19.378584 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "547fe97aad9a48febdb178575456228a"
format_stamp: "Formatted at 2026-09-26 13:55:19 on dist-test-slave-fk7n"
I20260926 13:55:19.382790 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260926 13:55:19.385699 8165 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:19.386330 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:19.386610 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "547fe97aad9a48febdb178575456228a"
format_stamp: "Formatted at 2026-09-26 13:55:19 on dist-test-slave-fk7n"
I20260926 13:55:19.386850 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:19.398085 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:19.398932 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:19.430675 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:35001
I20260926 13:55:19.430751 8216 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:35001 every 8 connection(s)
I20260926 13:55:19.434047 8217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:19.443360 8217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a: Bootstrap starting.
I20260926 13:55:19.447372 8217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:19.450714 8217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a: No bootstrap required, opened a new log
I20260926 13:55:19.452473 8217 raft_consensus.cc:359] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547fe97aad9a48febdb178575456228a" member_type: VOTER }
I20260926 13:55:19.452849 8217 raft_consensus.cc:385] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:19.453038 8217 raft_consensus.cc:740] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 547fe97aad9a48febdb178575456228a, State: Initialized, Role: FOLLOWER
I20260926 13:55:19.453486 8217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547fe97aad9a48febdb178575456228a" member_type: VOTER }
I20260926 13:55:19.453866 8217 raft_consensus.cc:399] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:19.454052 8217 raft_consensus.cc:493] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:19.454246 8217 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:19.458104 8217 raft_consensus.cc:515] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547fe97aad9a48febdb178575456228a" member_type: VOTER }
I20260926 13:55:19.458528 8217 leader_election.cc:304] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 547fe97aad9a48febdb178575456228a; no voters:
I20260926 13:55:19.459447 8217 leader_election.cc:290] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:19.459693 8220 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:19.460886 8220 raft_consensus.cc:697] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 1 LEADER]: Becoming Leader. State: Replica: 547fe97aad9a48febdb178575456228a, State: Running, Role: LEADER
I20260926 13:55:19.461462 8220 consensus_queue.cc:237] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547fe97aad9a48febdb178575456228a" member_type: VOTER }
I20260926 13:55:19.461979 8217 sys_catalog.cc:565] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:19.463884 8221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "547fe97aad9a48febdb178575456228a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547fe97aad9a48febdb178575456228a" member_type: VOTER } }
I20260926 13:55:19.463953 8222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 547fe97aad9a48febdb178575456228a. Latest consensus state: current_term: 1 leader_uuid: "547fe97aad9a48febdb178575456228a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547fe97aad9a48febdb178575456228a" member_type: VOTER } }
I20260926 13:55:19.464571 8222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:19.464563 8221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:19.467139 8226 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:19.473795 8226 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:19.475351 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:19.481652 8226 catalog_manager.cc:1396] Generated new cluster ID: 210bf899b2434dc98f7a523bdf79dd60
I20260926 13:55:19.481910 8226 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:19.497221 8226 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:19.498284 8226 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:19.510357 8226 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a: Generated new TSK 0
I20260926 13:55:19.510830 8226 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:19.541035 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:19.546021 8238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:19.546797 8239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:19.548228 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:19.548197 8241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:19.549242 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:19.549419 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:19.549537 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430919549526 us; error 0 us; skew 500 ppm
I20260926 13:55:19.549960 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:19.551864 3582 webserver.cc:533] Webserver started at http://127.3.127.129:42007/ using document root <none> and password file <none>
I20260926 13:55:19.552258 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:19.552402 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:19.552593 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:19.553561 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "315288c74ea9434a9f5ef033005b7ada"
format_stamp: "Formatted at 2026-09-26 13:55:19 on dist-test-slave-fk7n"
I20260926 13:55:19.557497 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260926 13:55:19.560324 8246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:19.561004 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:19.561229 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "315288c74ea9434a9f5ef033005b7ada"
format_stamp: "Formatted at 2026-09-26 13:55:19 on dist-test-slave-fk7n"
I20260926 13:55:19.561444 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:19.574781 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:19.575577 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:19.576828 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:19.578802 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:19.578963 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:19.579180 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:19.579312 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:19.613272 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:39699
I20260926 13:55:19.613354 8308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:39699 every 8 connection(s)
I20260926 13:55:19.625996 8309 heartbeater.cc:344] Connected to a master server at 127.3.127.190:35001
I20260926 13:55:19.626305 8309 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:19.626933 8309 heartbeater.cc:507] Master 127.3.127.190:35001 requested a full tablet report, sending...
I20260926 13:55:19.628611 8182 ts_manager.cc:194] Registered new tserver with Master: 315288c74ea9434a9f5ef033005b7ada (127.3.127.129:39699)
I20260926 13:55:19.628950 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012738968s
I20260926 13:55:19.630179 8182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46150
I20260926 13:55:19.647557 8182 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46154:
name: "stale-scan-tokens-dfr"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260926 13:55:19.674803 8274 tablet_service.cc:1511] Processing CreateTablet for tablet 7abbd70a5c564edc8df026be95d6e7cc (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=5155d9d88417485eb9e21e435fcfc181]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:19.674957 8273 tablet_service.cc:1511] Processing CreateTablet for tablet c1c8dc596b794549a764b4fe8b4f3ad0 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=5155d9d88417485eb9e21e435fcfc181]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260926 13:55:19.676064 8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abbd70a5c564edc8df026be95d6e7cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:19.676643 8273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c8dc596b794549a764b4fe8b4f3ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:19.691547 8321 tablet_bootstrap.cc:492] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada: Bootstrap starting.
I20260926 13:55:19.695361 8321 tablet_bootstrap.cc:654] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:19.698588 8321 tablet_bootstrap.cc:492] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada: No bootstrap required, opened a new log
I20260926 13:55:19.698884 8321 ts_tablet_manager.cc:1403] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260926 13:55:19.700691 8321 raft_consensus.cc:359] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.701110 8321 raft_consensus.cc:385] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:19.701327 8321 raft_consensus.cc:740] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 315288c74ea9434a9f5ef033005b7ada, State: Initialized, Role: FOLLOWER
I20260926 13:55:19.701836 8321 consensus_queue.cc:260] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.702240 8321 raft_consensus.cc:399] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:19.702426 8321 raft_consensus.cc:493] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:19.702642 8321 raft_consensus.cc:3060] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:19.706574 8321 raft_consensus.cc:515] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.707029 8321 leader_election.cc:304] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 315288c74ea9434a9f5ef033005b7ada; no voters:
I20260926 13:55:19.707978 8321 leader_election.cc:290] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:19.708250 8323 raft_consensus.cc:2804] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:19.709803 8309 heartbeater.cc:499] Master 127.3.127.190:35001 was elected leader, sending a full tablet report...
I20260926 13:55:19.710112 8321 ts_tablet_manager.cc:1434] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada: Time spent starting tablet: real 0.011s user 0.005s sys 0.006s
I20260926 13:55:19.710903 8321 tablet_bootstrap.cc:492] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: Bootstrap starting.
I20260926 13:55:19.710891 8323 raft_consensus.cc:697] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 1 LEADER]: Becoming Leader. State: Replica: 315288c74ea9434a9f5ef033005b7ada, State: Running, Role: LEADER
I20260926 13:55:19.711757 8323 consensus_queue.cc:237] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.715986 8321 tablet_bootstrap.cc:654] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:19.717922 8182 catalog_manager.cc:5838] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada reported cstate change: term changed from 0 to 1, leader changed from <none> to 315288c74ea9434a9f5ef033005b7ada (127.3.127.129). New cstate: current_term: 1 leader_uuid: "315288c74ea9434a9f5ef033005b7ada" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:19.719827 8321 tablet_bootstrap.cc:492] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: No bootstrap required, opened a new log
I20260926 13:55:19.720237 8321 ts_tablet_manager.cc:1403] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260926 13:55:19.722445 8321 raft_consensus.cc:359] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.722822 8321 raft_consensus.cc:385] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:19.723085 8321 raft_consensus.cc:740] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 315288c74ea9434a9f5ef033005b7ada, State: Initialized, Role: FOLLOWER
I20260926 13:55:19.723694 8321 consensus_queue.cc:260] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.724301 8321 raft_consensus.cc:399] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:19.724581 8321 raft_consensus.cc:493] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:19.724870 8321 raft_consensus.cc:3060] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:19.729499 8321 raft_consensus.cc:515] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.730082 8321 leader_election.cc:304] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 315288c74ea9434a9f5ef033005b7ada; no voters:
I20260926 13:55:19.730537 8321 leader_election.cc:290] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:19.730670 8323 raft_consensus.cc:2804] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:19.731117 8323 raft_consensus.cc:697] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 1 LEADER]: Becoming Leader. State: Replica: 315288c74ea9434a9f5ef033005b7ada, State: Running, Role: LEADER
I20260926 13:55:19.731819 8321 ts_tablet_manager.cc:1434] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260926 13:55:19.731715 8323 consensus_queue.cc:237] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:19.736287 8182 catalog_manager.cc:5838] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada reported cstate change: term changed from 0 to 1, leader changed from <none> to 315288c74ea9434a9f5ef033005b7ada (127.3.127.129). New cstate: current_term: 1 leader_uuid: "315288c74ea9434a9f5ef033005b7ada" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:20.384002 8182 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46154:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260926 13:55:20.393900 8182 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a: Sending DeleteTablet for 1 replicas of tablet 7abbd70a5c564edc8df026be95d6e7cc
I20260926 13:55:20.395424 8274 tablet_service.cc:1558] Processing DeleteTablet for tablet 7abbd70a5c564edc8df026be95d6e7cc with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-09-26 13:55:20 UTC) from {username='slave'} at 127.0.0.1:49412
I20260926 13:55:20.396849 8335 tablet_replica.cc:333] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: stopping tablet replica
I20260926 13:55:20.397424 8335 raft_consensus.cc:2243] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:20.397886 8335 raft_consensus.cc:2272] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:20.400203 8335 ts_tablet_manager.cc:1916] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260926 13:55:20.413348 8335 ts_tablet_manager.cc:1929] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.51
I20260926 13:55:20.413658 8335 log.cc:1199] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: Deleting WAL directory at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_3.1790430890430161-3582-0/minicluster-data/ts-0-root/wals/7abbd70a5c564edc8df026be95d6e7cc
I20260926 13:55:20.414415 8335 ts_tablet_manager.cc:1950] T 7abbd70a5c564edc8df026be95d6e7cc P 315288c74ea9434a9f5ef033005b7ada: Deleting consensus metadata
I20260926 13:55:20.416510 8169 catalog_manager.cc:5063] TS 315288c74ea9434a9f5ef033005b7ada (127.3.127.129:39699): tablet 7abbd70a5c564edc8df026be95d6e7cc (table stale-scan-tokens-dfr [id=5155d9d88417485eb9e21e435fcfc181]) successfully deleted
I20260926 13:55:20.442647 8182 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46154:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\001\316\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\316\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:20.450858 8182 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7d53ebd14da4bcfa2394503419703dc has no consensus state
I20260926 13:55:20.460031 8274 tablet_service.cc:1511] Processing CreateTablet for tablet f7d53ebd14da4bcfa2394503419703dc (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=5155d9d88417485eb9e21e435fcfc181]), partition=RANGE (key) PARTITION -50 <= VALUES < 0
I20260926 13:55:20.461061 8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d53ebd14da4bcfa2394503419703dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260926 13:55:20.470347 8166 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f7d53ebd14da4bcfa2394503419703dc (table stale-scan-tokens-dfr [id=5155d9d88417485eb9e21e435fcfc181], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet f7d53ebd14da4bcfa2394503419703dc consensus state has no leader
I20260926 13:55:20.472890 8344 tablet_bootstrap.cc:492] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada: Bootstrap starting.
I20260926 13:55:20.477312 8344 tablet_bootstrap.cc:654] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:20.480839 8344 tablet_bootstrap.cc:492] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada: No bootstrap required, opened a new log
I20260926 13:55:20.481145 8344 ts_tablet_manager.cc:1403] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.001s
I20260926 13:55:20.482992 8344 raft_consensus.cc:359] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:20.483367 8344 raft_consensus.cc:385] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:20.483583 8344 raft_consensus.cc:740] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 315288c74ea9434a9f5ef033005b7ada, State: Initialized, Role: FOLLOWER
I20260926 13:55:20.484072 8344 consensus_queue.cc:260] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:20.484510 8344 raft_consensus.cc:399] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:20.484712 8344 raft_consensus.cc:493] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:20.484987 8344 raft_consensus.cc:3060] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:20.489711 8344 raft_consensus.cc:515] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:20.490187 8344 leader_election.cc:304] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 315288c74ea9434a9f5ef033005b7ada; no voters:
I20260926 13:55:20.490623 8344 leader_election.cc:290] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:20.490773 8323 raft_consensus.cc:2804] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:20.491991 8323 raft_consensus.cc:697] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 1 LEADER]: Becoming Leader. State: Replica: 315288c74ea9434a9f5ef033005b7ada, State: Running, Role: LEADER
I20260926 13:55:20.492991 8344 ts_tablet_manager.cc:1434] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260926 13:55:20.492676 8323 consensus_queue.cc:237] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } }
I20260926 13:55:20.497929 8182 catalog_manager.cc:5838] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada reported cstate change: term changed from 0 to 1, leader changed from <none> to 315288c74ea9434a9f5ef033005b7ada (127.3.127.129). New cstate: current_term: 1 leader_uuid: "315288c74ea9434a9f5ef033005b7ada" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "315288c74ea9434a9f5ef033005b7ada" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 39699 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:20.508431 8182 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a: stale-scan-tokens-dfr [id=5155d9d88417485eb9e21e435fcfc181] alter complete (version 0)
I20260926 13:55:20.891937 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:20.913998 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:20.915199 3582 tablet_replica.cc:333] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada: stopping tablet replica
I20260926 13:55:20.915879 3582 raft_consensus.cc:2243] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:20.916613 3582 raft_consensus.cc:2272] T f7d53ebd14da4bcfa2394503419703dc P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:20.919804 3582 tablet_replica.cc:333] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada: stopping tablet replica
I20260926 13:55:20.920267 3582 raft_consensus.cc:2243] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:20.921000 3582 raft_consensus.cc:2272] T c1c8dc596b794549a764b4fe8b4f3ad0 P 315288c74ea9434a9f5ef033005b7ada [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:20.944166 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:20.960247 3582 master.cc:562] Master@127.3.127.190:35001 shutting down...
I20260926 13:55:20.977355 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:20.977998 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:20.978308 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 547fe97aad9a48febdb178575456228a: stopping tablet replica
I20260926 13:55:20.996280 3582 master.cc:584] Master@127.3.127.190:35001 shutdown complete.
[ OK ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/3 (1662 ms)
[ RUN ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/4
I20260926 13:55:21.028255 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:43187
I20260926 13:55:21.029306 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:21.034160 8351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:21.034209 8350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:21.035143 8353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:21.036154 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:21.036927 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:21.037104 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:21.037258 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430921037243 us; error 0 us; skew 500 ppm
I20260926 13:55:21.037727 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:21.039793 3582 webserver.cc:533] Webserver started at http://127.3.127.190:39867/ using document root <none> and password file <none>
I20260926 13:55:21.040227 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:21.040375 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:21.040637 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:21.041728 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "678f05ffc7594006936fa40beb7d1241"
format_stamp: "Formatted at 2026-09-26 13:55:21 on dist-test-slave-fk7n"
I20260926 13:55:21.045921 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:55:21.049185 8358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:21.049865 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:21.050118 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "678f05ffc7594006936fa40beb7d1241"
format_stamp: "Formatted at 2026-09-26 13:55:21 on dist-test-slave-fk7n"
I20260926 13:55:21.050354 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:21.076031 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:21.077608 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:21.113584 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:43187
I20260926 13:55:21.113687 8409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:43187 every 8 connection(s)
I20260926 13:55:21.118021 8410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:21.129014 8410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241: Bootstrap starting.
I20260926 13:55:21.133678 8410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:21.137559 8410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241: No bootstrap required, opened a new log
I20260926 13:55:21.139599 8410 raft_consensus.cc:359] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678f05ffc7594006936fa40beb7d1241" member_type: VOTER }
I20260926 13:55:21.140007 8410 raft_consensus.cc:385] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:21.140228 8410 raft_consensus.cc:740] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 678f05ffc7594006936fa40beb7d1241, State: Initialized, Role: FOLLOWER
I20260926 13:55:21.140739 8410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678f05ffc7594006936fa40beb7d1241" member_type: VOTER }
I20260926 13:55:21.141192 8410 raft_consensus.cc:399] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:21.141390 8410 raft_consensus.cc:493] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:21.141621 8410 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:21.145855 8410 raft_consensus.cc:515] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678f05ffc7594006936fa40beb7d1241" member_type: VOTER }
I20260926 13:55:21.146327 8410 leader_election.cc:304] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 678f05ffc7594006936fa40beb7d1241; no voters:
I20260926 13:55:21.147351 8410 leader_election.cc:290] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:21.147714 8413 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:21.148955 8413 raft_consensus.cc:697] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 1 LEADER]: Becoming Leader. State: Replica: 678f05ffc7594006936fa40beb7d1241, State: Running, Role: LEADER
I20260926 13:55:21.149488 8413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678f05ffc7594006936fa40beb7d1241" member_type: VOTER }
I20260926 13:55:21.150007 8410 sys_catalog.cc:565] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:21.152272 8415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 678f05ffc7594006936fa40beb7d1241. Latest consensus state: current_term: 1 leader_uuid: "678f05ffc7594006936fa40beb7d1241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678f05ffc7594006936fa40beb7d1241" member_type: VOTER } }
I20260926 13:55:21.152311 8414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "678f05ffc7594006936fa40beb7d1241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678f05ffc7594006936fa40beb7d1241" member_type: VOTER } }
I20260926 13:55:21.152866 8415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:21.153028 8414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:21.156253 8418 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:21.160689 8418 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:21.164227 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:21.168434 8418 catalog_manager.cc:1396] Generated new cluster ID: 97d2ce1924a3486385869252fd80d841
I20260926 13:55:21.168666 8418 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:21.189937 8418 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:21.191104 8418 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:21.211755 8418 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241: Generated new TSK 0
I20260926 13:55:21.212271 8418 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:21.229959 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:21.235896 8431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:21.236410 8432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:21.237680 8434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:21.238351 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:21.239017 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:21.239190 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:21.239305 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430921239294 us; error 0 us; skew 500 ppm
I20260926 13:55:21.239720 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:21.241720 3582 webserver.cc:533] Webserver started at http://127.3.127.129:42707/ using document root <none> and password file <none>
I20260926 13:55:21.242107 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:21.242249 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:21.242455 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:21.243469 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "20cfddb7978841a69900561c620d8d2b"
format_stamp: "Formatted at 2026-09-26 13:55:21 on dist-test-slave-fk7n"
I20260926 13:55:21.247750 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260926 13:55:21.250733 8439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:21.251417 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260926 13:55:21.251653 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "20cfddb7978841a69900561c620d8d2b"
format_stamp: "Formatted at 2026-09-26 13:55:21 on dist-test-slave-fk7n"
I20260926 13:55:21.251927 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:21.276340 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:21.277393 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:21.278702 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:21.280781 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:21.280961 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:21.281167 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:21.281306 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:21.317694 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:41965
I20260926 13:55:21.317787 8501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:41965 every 8 connection(s)
I20260926 13:55:21.331713 8502 heartbeater.cc:344] Connected to a master server at 127.3.127.190:43187
I20260926 13:55:21.332036 8502 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:21.332684 8502 heartbeater.cc:507] Master 127.3.127.190:43187 requested a full tablet report, sending...
I20260926 13:55:21.334656 8375 ts_manager.cc:194] Registered new tserver with Master: 20cfddb7978841a69900561c620d8d2b (127.3.127.129:41965)
I20260926 13:55:21.334796 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.014107756s
I20260926 13:55:21.337141 8375 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38226
I20260926 13:55:21.356253 8375 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38240:
name: "stale-scan-tokens-dfr"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260926 13:55:21.384922 8467 tablet_service.cc:1511] Processing CreateTablet for tablet b3766b9bce7b41bea7a27e93091ce05e (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=5c6cee56f127438bb80b6f9e0567f7ac]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:21.385196 8466 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce1949719d344f3a5049b31573dafb4 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=5c6cee56f127438bb80b6f9e0567f7ac]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260926 13:55:21.385954 8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3766b9bce7b41bea7a27e93091ce05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:21.386407 8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce1949719d344f3a5049b31573dafb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:21.398660 8514 tablet_bootstrap.cc:492] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: Bootstrap starting.
I20260926 13:55:21.402868 8514 tablet_bootstrap.cc:654] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:21.406348 8514 tablet_bootstrap.cc:492] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: No bootstrap required, opened a new log
I20260926 13:55:21.406618 8514 ts_tablet_manager.cc:1403] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260926 13:55:21.408402 8514 raft_consensus.cc:359] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.408776 8514 raft_consensus.cc:385] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:21.408978 8514 raft_consensus.cc:740] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20cfddb7978841a69900561c620d8d2b, State: Initialized, Role: FOLLOWER
I20260926 13:55:21.409471 8514 consensus_queue.cc:260] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.409904 8514 raft_consensus.cc:399] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:21.410113 8514 raft_consensus.cc:493] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:21.410348 8514 raft_consensus.cc:3060] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:21.414681 8514 raft_consensus.cc:515] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.415143 8514 leader_election.cc:304] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20cfddb7978841a69900561c620d8d2b; no voters:
I20260926 13:55:21.416188 8514 leader_election.cc:290] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:21.416534 8516 raft_consensus.cc:2804] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:21.417727 8516 raft_consensus.cc:697] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 1 LEADER]: Becoming Leader. State: Replica: 20cfddb7978841a69900561c620d8d2b, State: Running, Role: LEADER
I20260926 13:55:21.417791 8502 heartbeater.cc:499] Master 127.3.127.190:43187 was elected leader, sending a full tablet report...
I20260926 13:55:21.418326 8514 ts_tablet_manager.cc:1434] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260926 13:55:21.418545 8516 consensus_queue.cc:237] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.419118 8514 tablet_bootstrap.cc:492] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b: Bootstrap starting.
I20260926 13:55:21.425169 8514 tablet_bootstrap.cc:654] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:21.425004 8375 catalog_manager.cc:5838] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 20cfddb7978841a69900561c620d8d2b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "20cfddb7978841a69900561c620d8d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:21.429658 8514 tablet_bootstrap.cc:492] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b: No bootstrap required, opened a new log
I20260926 13:55:21.430034 8514 ts_tablet_manager.cc:1403] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260926 13:55:21.432518 8514 raft_consensus.cc:359] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.433037 8514 raft_consensus.cc:385] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:21.433310 8514 raft_consensus.cc:740] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20cfddb7978841a69900561c620d8d2b, State: Initialized, Role: FOLLOWER
I20260926 13:55:21.433882 8514 consensus_queue.cc:260] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.434327 8514 raft_consensus.cc:399] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:21.434533 8514 raft_consensus.cc:493] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:21.434762 8514 raft_consensus.cc:3060] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:21.440698 8514 raft_consensus.cc:515] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.441183 8514 leader_election.cc:304] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20cfddb7978841a69900561c620d8d2b; no voters:
I20260926 13:55:21.441617 8514 leader_election.cc:290] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:21.441749 8516 raft_consensus.cc:2804] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:21.442184 8516 raft_consensus.cc:697] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 1 LEADER]: Becoming Leader. State: Replica: 20cfddb7978841a69900561c620d8d2b, State: Running, Role: LEADER
I20260926 13:55:21.442907 8514 ts_tablet_manager.cc:1434] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260926 13:55:21.442771 8516 consensus_queue.cc:237] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:21.447777 8375 catalog_manager.cc:5838] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 20cfddb7978841a69900561c620d8d2b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "20cfddb7978841a69900561c620d8d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:22.104040 8375 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38240:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260926 13:55:22.114480 8375 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241: Sending DeleteTablet for 1 replicas of tablet b3766b9bce7b41bea7a27e93091ce05e
I20260926 13:55:22.116004 8466 tablet_service.cc:1558] Processing DeleteTablet for tablet b3766b9bce7b41bea7a27e93091ce05e with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-09-26 13:55:22 UTC) from {username='slave'} at 127.0.0.1:53528
I20260926 13:55:22.117486 8528 tablet_replica.cc:333] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: stopping tablet replica
I20260926 13:55:22.118163 8528 raft_consensus.cc:2243] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:22.118731 8528 raft_consensus.cc:2272] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:22.121657 8528 ts_tablet_manager.cc:1916] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260926 13:55:22.135097 8528 ts_tablet_manager.cc:1929] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.51
I20260926 13:55:22.135454 8528 log.cc:1199] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: Deleting WAL directory at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_4.1790430890430161-3582-0/minicluster-data/ts-0-root/wals/b3766b9bce7b41bea7a27e93091ce05e
I20260926 13:55:22.136054 8528 ts_tablet_manager.cc:1950] T b3766b9bce7b41bea7a27e93091ce05e P 20cfddb7978841a69900561c620d8d2b: Deleting consensus metadata
I20260926 13:55:22.138646 8359 catalog_manager.cc:5063] TS 20cfddb7978841a69900561c620d8d2b (127.3.127.129:41965): tablet b3766b9bce7b41bea7a27e93091ce05e (table stale-scan-tokens-dfr [id=5c6cee56f127438bb80b6f9e0567f7ac]) successfully deleted
I20260926 13:55:22.165261 8375 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38240:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:22.173607 8375 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd218753b76e4db78b57412584b55692 has no consensus state
I20260926 13:55:22.182897 8466 tablet_service.cc:1511] Processing CreateTablet for tablet fd218753b76e4db78b57412584b55692 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=5c6cee56f127438bb80b6f9e0567f7ac]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:22.183881 8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd218753b76e4db78b57412584b55692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:22.195156 8537 tablet_bootstrap.cc:492] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b: Bootstrap starting.
I20260926 13:55:22.199491 8537 tablet_bootstrap.cc:654] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:22.203249 8537 tablet_bootstrap.cc:492] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b: No bootstrap required, opened a new log
I20260926 13:55:22.203559 8537 ts_tablet_manager.cc:1403] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260926 13:55:22.205545 8537 raft_consensus.cc:359] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:22.205909 8537 raft_consensus.cc:385] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:22.206113 8537 raft_consensus.cc:740] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20cfddb7978841a69900561c620d8d2b, State: Initialized, Role: FOLLOWER
I20260926 13:55:22.206651 8537 consensus_queue.cc:260] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:22.207098 8537 raft_consensus.cc:399] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:22.207317 8537 raft_consensus.cc:493] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:22.207556 8537 raft_consensus.cc:3060] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:22.212443 8537 raft_consensus.cc:515] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:22.212958 8537 leader_election.cc:304] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20cfddb7978841a69900561c620d8d2b; no voters:
I20260926 13:55:22.213382 8537 leader_election.cc:290] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:22.213512 8516 raft_consensus.cc:2804] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:22.214726 8516 raft_consensus.cc:697] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 1 LEADER]: Becoming Leader. State: Replica: 20cfddb7978841a69900561c620d8d2b, State: Running, Role: LEADER
I20260926 13:55:22.215458 8537 ts_tablet_manager.cc:1434] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260926 13:55:22.215415 8516 consensus_queue.cc:237] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } }
I20260926 13:55:22.220640 8375 catalog_manager.cc:5838] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to 20cfddb7978841a69900561c620d8d2b (127.3.127.129). New cstate: current_term: 1 leader_uuid: "20cfddb7978841a69900561c620d8d2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20cfddb7978841a69900561c620d8d2b" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 41965 } health_report { overall_health: HEALTHY } } }
W20260926 13:55:22.223049 8361 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet fd218753b76e4db78b57412584b55692 (table stale-scan-tokens-dfr [id=5c6cee56f127438bb80b6f9e0567f7ac], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet fd218753b76e4db78b57412584b55692 consensus state has no leader
I20260926 13:55:22.231067 8375 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241: stale-scan-tokens-dfr [id=5c6cee56f127438bb80b6f9e0567f7ac] alter complete (version 0)
I20260926 13:55:22.611860 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:22.626030 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:22.626820 3582 tablet_replica.cc:333] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b: stopping tablet replica
I20260926 13:55:22.627354 3582 raft_consensus.cc:2243] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:22.627784 3582 raft_consensus.cc:2272] T fd218753b76e4db78b57412584b55692 P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:22.629906 3582 tablet_replica.cc:333] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b: stopping tablet replica
I20260926 13:55:22.630336 3582 raft_consensus.cc:2243] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:22.630702 3582 raft_consensus.cc:2272] T 0ce1949719d344f3a5049b31573dafb4 P 20cfddb7978841a69900561c620d8d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:22.650285 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:22.659946 3582 master.cc:562] Master@127.3.127.190:43187 shutting down...
I20260926 13:55:22.674069 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:22.674502 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:22.674773 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 678f05ffc7594006936fa40beb7d1241: stopping tablet replica
I20260926 13:55:22.691008 3582 master.cc:584] Master@127.3.127.190:43187 shutdown complete.
[ OK ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/4 (1681 ms)
[ RUN ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/5
I20260926 13:55:22.710096 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:46189
I20260926 13:55:22.711057 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:22.715265 8542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:22.715838 8543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:22.717036 8545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:22.717790 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:22.718390 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:22.718550 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:22.718658 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430922718648 us; error 0 us; skew 500 ppm
I20260926 13:55:22.719077 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:22.721064 3582 webserver.cc:533] Webserver started at http://127.3.127.190:39499/ using document root <none> and password file <none>
I20260926 13:55:22.721442 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:22.721580 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:22.721776 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:22.722662 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "c56d615e2f25403a9986bb033417cb4d"
format_stamp: "Formatted at 2026-09-26 13:55:22 on dist-test-slave-fk7n"
I20260926 13:55:22.726722 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260926 13:55:22.729558 8550 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:22.730186 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:22.730404 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "c56d615e2f25403a9986bb033417cb4d"
format_stamp: "Formatted at 2026-09-26 13:55:22 on dist-test-slave-fk7n"
I20260926 13:55:22.730618 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:22.743023 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:22.743855 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:22.775358 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:46189
I20260926 13:55:22.775439 8601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:46189 every 8 connection(s)
I20260926 13:55:22.778808 8602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:22.788437 8602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: Bootstrap starting.
I20260926 13:55:22.792313 8602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:22.795676 8602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: No bootstrap required, opened a new log
I20260926 13:55:22.797730 8602 raft_consensus.cc:359] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c56d615e2f25403a9986bb033417cb4d" member_type: VOTER }
I20260926 13:55:22.798069 8602 raft_consensus.cc:385] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:22.798238 8602 raft_consensus.cc:740] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56d615e2f25403a9986bb033417cb4d, State: Initialized, Role: FOLLOWER
I20260926 13:55:22.798689 8602 consensus_queue.cc:260] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c56d615e2f25403a9986bb033417cb4d" member_type: VOTER }
I20260926 13:55:22.799072 8602 raft_consensus.cc:399] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:22.799252 8602 raft_consensus.cc:493] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:22.799456 8602 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:22.803398 8602 raft_consensus.cc:515] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c56d615e2f25403a9986bb033417cb4d" member_type: VOTER }
I20260926 13:55:22.803817 8602 leader_election.cc:304] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c56d615e2f25403a9986bb033417cb4d; no voters:
I20260926 13:55:22.804769 8602 leader_election.cc:290] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:22.805048 8605 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:22.806247 8605 raft_consensus.cc:697] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 1 LEADER]: Becoming Leader. State: Replica: c56d615e2f25403a9986bb033417cb4d, State: Running, Role: LEADER
I20260926 13:55:22.806849 8605 consensus_queue.cc:237] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c56d615e2f25403a9986bb033417cb4d" member_type: VOTER }
I20260926 13:55:22.807305 8602 sys_catalog.cc:565] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:22.809405 8606 sys_catalog.cc:455] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c56d615e2f25403a9986bb033417cb4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c56d615e2f25403a9986bb033417cb4d" member_type: VOTER } }
I20260926 13:55:22.809423 8607 sys_catalog.cc:455] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c56d615e2f25403a9986bb033417cb4d. Latest consensus state: current_term: 1 leader_uuid: "c56d615e2f25403a9986bb033417cb4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c56d615e2f25403a9986bb033417cb4d" member_type: VOTER } }
I20260926 13:55:22.810148 8607 sys_catalog.cc:458] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:22.810443 8606 sys_catalog.cc:458] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:22.820053 8611 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:22.822801 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:22.825093 8611 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:22.832259 8611 catalog_manager.cc:1396] Generated new cluster ID: bc1634cf1cb94b52aa094be260c0ecd3
I20260926 13:55:22.832463 8611 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:22.860080 8611 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:22.861274 8611 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:22.874135 8611 catalog_manager.cc:6219] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: Generated new TSK 0
I20260926 13:55:22.874620 8611 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:22.888638 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:22.893679 8623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:22.894697 8624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:22.896090 8626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:22.896379 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:22.897261 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:22.897445 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:22.897594 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430922897577 us; error 0 us; skew 500 ppm
I20260926 13:55:22.898063 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:22.899983 3582 webserver.cc:533] Webserver started at http://127.3.127.129:42005/ using document root <none> and password file <none>
I20260926 13:55:22.900398 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:22.900558 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:22.900815 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:22.901772 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "6192ed3de4d5452c8a27acfdc26a018a"
format_stamp: "Formatted at 2026-09-26 13:55:22 on dist-test-slave-fk7n"
I20260926 13:55:22.905679 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260926 13:55:22.908509 8631 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:22.909220 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:22.909472 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "6192ed3de4d5452c8a27acfdc26a018a"
format_stamp: "Formatted at 2026-09-26 13:55:22 on dist-test-slave-fk7n"
I20260926 13:55:22.909708 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:22.920969 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:22.921803 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:22.923026 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:22.924990 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:22.925168 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:22.925384 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:22.925526 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:22.960566 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:32859
I20260926 13:55:22.960650 8693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:32859 every 8 connection(s)
I20260926 13:55:22.973109 8694 heartbeater.cc:344] Connected to a master server at 127.3.127.190:46189
I20260926 13:55:22.973405 8694 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:22.974028 8694 heartbeater.cc:507] Master 127.3.127.190:46189 requested a full tablet report, sending...
I20260926 13:55:22.975703 8567 ts_manager.cc:194] Registered new tserver with Master: 6192ed3de4d5452c8a27acfdc26a018a (127.3.127.129:32859)
I20260926 13:55:22.975906 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012449005s
I20260926 13:55:22.977339 8567 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46208
I20260926 13:55:22.994390 8567 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46218:
name: "stale-scan-tokens-dfr"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260926 13:55:23.021227 8659 tablet_service.cc:1511] Processing CreateTablet for tablet aba19a2264114f479eb00600f291cef2 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:23.021642 8658 tablet_service.cc:1511] Processing CreateTablet for tablet 9a00f2d46eeb4af6829c484231c2c29d (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260926 13:55:23.022351 8659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba19a2264114f479eb00600f291cef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:23.022763 8658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a00f2d46eeb4af6829c484231c2c29d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:23.034080 8706 tablet_bootstrap.cc:492] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a: Bootstrap starting.
I20260926 13:55:23.037858 8706 tablet_bootstrap.cc:654] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:23.041438 8706 tablet_bootstrap.cc:492] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a: No bootstrap required, opened a new log
I20260926 13:55:23.041738 8706 ts_tablet_manager.cc:1403] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20260926 13:55:23.043468 8706 raft_consensus.cc:359] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.043838 8706 raft_consensus.cc:385] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:23.044041 8706 raft_consensus.cc:740] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Initialized, Role: FOLLOWER
I20260926 13:55:23.044533 8706 consensus_queue.cc:260] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.045010 8706 raft_consensus.cc:399] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:23.045225 8706 raft_consensus.cc:493] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:23.045462 8706 raft_consensus.cc:3060] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:23.050205 8706 raft_consensus.cc:515] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.050694 8706 leader_election.cc:304] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6192ed3de4d5452c8a27acfdc26a018a; no voters:
I20260926 13:55:23.051700 8706 leader_election.cc:290] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:23.051975 8708 raft_consensus.cc:2804] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:23.053210 8708 raft_consensus.cc:697] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Becoming Leader. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Running, Role: LEADER
I20260926 13:55:23.053340 8694 heartbeater.cc:499] Master 127.3.127.190:46189 was elected leader, sending a full tablet report...
I20260926 13:55:23.053809 8706 ts_tablet_manager.cc:1434] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260926 13:55:23.053921 8708 consensus_queue.cc:237] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.054551 8706 tablet_bootstrap.cc:492] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: Bootstrap starting.
I20260926 13:55:23.060158 8706 tablet_bootstrap.cc:654] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:23.060846 8566 catalog_manager.cc:5838] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6192ed3de4d5452c8a27acfdc26a018a (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6192ed3de4d5452c8a27acfdc26a018a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:23.063999 8706 tablet_bootstrap.cc:492] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: No bootstrap required, opened a new log
I20260926 13:55:23.064335 8706 ts_tablet_manager.cc:1403] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260926 13:55:23.066248 8706 raft_consensus.cc:359] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.066610 8706 raft_consensus.cc:385] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:23.066861 8706 raft_consensus.cc:740] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Initialized, Role: FOLLOWER
I20260926 13:55:23.067476 8706 consensus_queue.cc:260] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.068075 8706 raft_consensus.cc:399] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:23.068353 8706 raft_consensus.cc:493] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:23.068727 8706 raft_consensus.cc:3060] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:23.075026 8706 raft_consensus.cc:515] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.075692 8706 leader_election.cc:304] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6192ed3de4d5452c8a27acfdc26a018a; no voters:
I20260926 13:55:23.076248 8706 leader_election.cc:290] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:23.076386 8708 raft_consensus.cc:2804] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:23.076938 8708 raft_consensus.cc:697] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Becoming Leader. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Running, Role: LEADER
I20260926 13:55:23.077705 8708 consensus_queue.cc:237] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.077940 8706 ts_tablet_manager.cc:1434] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: Time spent starting tablet: real 0.013s user 0.007s sys 0.007s
I20260926 13:55:23.082271 8566 catalog_manager.cc:5838] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6192ed3de4d5452c8a27acfdc26a018a (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6192ed3de4d5452c8a27acfdc26a018a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:23.728173 8566 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46218:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260926 13:55:23.737969 8566 catalog_manager.cc:6133] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: Sending DeleteTablet for 1 replicas of tablet aba19a2264114f479eb00600f291cef2
I20260926 13:55:23.739529 8659 tablet_service.cc:1558] Processing DeleteTablet for tablet aba19a2264114f479eb00600f291cef2 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-09-26 13:55:23 UTC) from {username='slave'} at 127.0.0.1:60386
I20260926 13:55:23.740897 8720 tablet_replica.cc:333] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: stopping tablet replica
I20260926 13:55:23.741489 8720 raft_consensus.cc:2243] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:23.742048 8720 raft_consensus.cc:2272] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:23.744869 8720 ts_tablet_manager.cc:1916] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260926 13:55:23.756304 8720 ts_tablet_manager.cc:1929] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.51
I20260926 13:55:23.756613 8720 log.cc:1199] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: Deleting WAL directory at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_5.1790430890430161-3582-0/minicluster-data/ts-0-root/wals/aba19a2264114f479eb00600f291cef2
I20260926 13:55:23.757347 8720 ts_tablet_manager.cc:1950] T aba19a2264114f479eb00600f291cef2 P 6192ed3de4d5452c8a27acfdc26a018a: Deleting consensus metadata
I20260926 13:55:23.759822 8553 catalog_manager.cc:5063] TS 6192ed3de4d5452c8a27acfdc26a018a (127.3.127.129:32859): tablet aba19a2264114f479eb00600f291cef2 (table stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46]) successfully deleted
I20260926 13:55:23.785508 8566 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46218:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:23.793706 8566 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 888adb8c07af4a7bb0e0fcd49b8a925e has no consensus state
I20260926 13:55:23.802764 8659 tablet_service.cc:1511] Processing CreateTablet for tablet 888adb8c07af4a7bb0e0fcd49b8a925e (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:23.803740 8659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888adb8c07af4a7bb0e0fcd49b8a925e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:23.814039 8729 tablet_bootstrap.cc:492] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a: Bootstrap starting.
I20260926 13:55:23.818440 8729 tablet_bootstrap.cc:654] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:23.821893 8729 tablet_bootstrap.cc:492] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a: No bootstrap required, opened a new log
I20260926 13:55:23.822242 8729 ts_tablet_manager.cc:1403] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260926 13:55:23.824474 8729 raft_consensus.cc:359] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.824883 8729 raft_consensus.cc:385] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:23.825116 8729 raft_consensus.cc:740] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Initialized, Role: FOLLOWER
I20260926 13:55:23.825624 8729 consensus_queue.cc:260] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.826061 8729 raft_consensus.cc:399] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:23.826274 8729 raft_consensus.cc:493] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:23.826515 8729 raft_consensus.cc:3060] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Advancing to term 1
W20260926 13:55:23.829420 8551 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 888adb8c07af4a7bb0e0fcd49b8a925e (table stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 888adb8c07af4a7bb0e0fcd49b8a925e consensus state has no leader
I20260926 13:55:23.831352 8729 raft_consensus.cc:515] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.831857 8729 leader_election.cc:304] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6192ed3de4d5452c8a27acfdc26a018a; no voters:
I20260926 13:55:23.832290 8729 leader_election.cc:290] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:23.832434 8708 raft_consensus.cc:2804] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:23.833680 8708 raft_consensus.cc:697] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Becoming Leader. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Running, Role: LEADER
I20260926 13:55:23.834374 8729 ts_tablet_manager.cc:1434] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20260926 13:55:23.834369 8708 consensus_queue.cc:237] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.839349 8566 catalog_manager.cc:5838] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6192ed3de4d5452c8a27acfdc26a018a (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6192ed3de4d5452c8a27acfdc26a018a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:23.849661 8566 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46] alter complete (version 0)
I20260926 13:55:23.860954 8566 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46218:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\0018\377\377\377\377\377\377\377\007\001\234\377\377\377\377\377\377\377""\006\0018\377\377\377\377\377\377\377\007\001\234\377\377\377\377\377\377\377" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:23.868708 8566 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08cc02a485aa47dbb99dc3ee5412c904 has no consensus state
I20260926 13:55:23.878301 8659 tablet_service.cc:1511] Processing CreateTablet for tablet 08cc02a485aa47dbb99dc3ee5412c904 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46]), partition=RANGE (key) PARTITION -200 <= VALUES < -100
I20260926 13:55:23.879341 8659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08cc02a485aa47dbb99dc3ee5412c904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:23.889499 8729 tablet_bootstrap.cc:492] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a: Bootstrap starting.
I20260926 13:55:23.894042 8729 tablet_bootstrap.cc:654] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:23.897565 8729 tablet_bootstrap.cc:492] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a: No bootstrap required, opened a new log
I20260926 13:55:23.897944 8729 ts_tablet_manager.cc:1403] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260926 13:55:23.900101 8729 raft_consensus.cc:359] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.900456 8729 raft_consensus.cc:385] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:23.900631 8729 raft_consensus.cc:740] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Initialized, Role: FOLLOWER
I20260926 13:55:23.901075 8729 consensus_queue.cc:260] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.901464 8729 raft_consensus.cc:399] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:23.901645 8729 raft_consensus.cc:493] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:23.901849 8729 raft_consensus.cc:3060] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:23.906348 8729 raft_consensus.cc:515] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.906793 8729 leader_election.cc:304] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6192ed3de4d5452c8a27acfdc26a018a; no voters:
I20260926 13:55:23.907196 8729 leader_election.cc:290] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:23.907325 8708 raft_consensus.cc:2804] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:23.907761 8708 raft_consensus.cc:697] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Becoming Leader. State: Replica: 6192ed3de4d5452c8a27acfdc26a018a, State: Running, Role: LEADER
I20260926 13:55:23.908388 8708 consensus_queue.cc:237] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } }
I20260926 13:55:23.909168 8729 ts_tablet_manager.cc:1434] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260926 13:55:23.914175 8566 catalog_manager.cc:5838] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6192ed3de4d5452c8a27acfdc26a018a (127.3.127.129). New cstate: current_term: 1 leader_uuid: "6192ed3de4d5452c8a27acfdc26a018a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6192ed3de4d5452c8a27acfdc26a018a" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 32859 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:23.924432 8566 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: stale-scan-tokens-dfr [id=7e1ad0bb0d104395bb24514ef8f63d46] alter complete (version 0)
I20260926 13:55:24.865012 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:24.879864 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:24.880421 3582 tablet_replica.cc:333] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a: stopping tablet replica
I20260926 13:55:24.881049 3582 raft_consensus.cc:2243] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:24.881476 3582 raft_consensus.cc:2272] T 08cc02a485aa47dbb99dc3ee5412c904 P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:24.885084 3582 tablet_replica.cc:333] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a: stopping tablet replica
I20260926 13:55:24.885526 3582 raft_consensus.cc:2243] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:24.885910 3582 raft_consensus.cc:2272] T 888adb8c07af4a7bb0e0fcd49b8a925e P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:24.887668 3582 tablet_replica.cc:333] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a: stopping tablet replica
I20260926 13:55:24.888077 3582 raft_consensus.cc:2243] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:24.888438 3582 raft_consensus.cc:2272] T 9a00f2d46eeb4af6829c484231c2c29d P 6192ed3de4d5452c8a27acfdc26a018a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:24.907528 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:24.917368 3582 master.cc:562] Master@127.3.127.190:46189 shutting down...
I20260926 13:55:24.932782 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:24.933305 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:24.933643 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P c56d615e2f25403a9986bb033417cb4d: stopping tablet replica
I20260926 13:55:24.949852 3582 master.cc:584] Master@127.3.127.190:46189 shutdown complete.
[ OK ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/5 (2262 ms)
[ RUN ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/6
I20260926 13:55:24.972105 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:43389
I20260926 13:55:24.973055 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:24.977193 8736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:24.978652 8739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:24.978790 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:24.978844 8737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:24.979835 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:24.980010 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:24.980166 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430924980150 us; error 0 us; skew 500 ppm
I20260926 13:55:24.980635 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:24.982581 3582 webserver.cc:533] Webserver started at http://127.3.127.190:42047/ using document root <none> and password file <none>
I20260926 13:55:24.983006 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:24.983227 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:24.983465 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:24.984395 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "c3e87a106ea243dcab233be20d55ea1c"
format_stamp: "Formatted at 2026-09-26 13:55:24 on dist-test-slave-fk7n"
I20260926 13:55:24.988336 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260926 13:55:24.991150 8744 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:24.991829 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:24.992043 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "c3e87a106ea243dcab233be20d55ea1c"
format_stamp: "Formatted at 2026-09-26 13:55:24 on dist-test-slave-fk7n"
I20260926 13:55:24.992278 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:25.001541 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:25.002324 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:25.033720 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:43389
I20260926 13:55:25.033807 8795 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:43389 every 8 connection(s)
I20260926 13:55:25.037130 8796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:25.046492 8796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: Bootstrap starting.
I20260926 13:55:25.050343 8796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:25.053933 8796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: No bootstrap required, opened a new log
I20260926 13:55:25.055740 8796 raft_consensus.cc:359] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e87a106ea243dcab233be20d55ea1c" member_type: VOTER }
I20260926 13:55:25.056120 8796 raft_consensus.cc:385] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:25.056319 8796 raft_consensus.cc:740] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e87a106ea243dcab233be20d55ea1c, State: Initialized, Role: FOLLOWER
I20260926 13:55:25.056844 8796 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e87a106ea243dcab233be20d55ea1c" member_type: VOTER }
I20260926 13:55:25.057255 8796 raft_consensus.cc:399] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:25.057454 8796 raft_consensus.cc:493] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:25.057704 8796 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:25.061713 8796 raft_consensus.cc:515] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e87a106ea243dcab233be20d55ea1c" member_type: VOTER }
I20260926 13:55:25.062163 8796 leader_election.cc:304] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3e87a106ea243dcab233be20d55ea1c; no voters:
I20260926 13:55:25.063104 8796 leader_election.cc:290] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:25.063333 8799 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:25.064504 8799 raft_consensus.cc:697] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 1 LEADER]: Becoming Leader. State: Replica: c3e87a106ea243dcab233be20d55ea1c, State: Running, Role: LEADER
I20260926 13:55:25.065100 8799 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e87a106ea243dcab233be20d55ea1c" member_type: VOTER }
I20260926 13:55:25.065692 8796 sys_catalog.cc:565] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:25.067559 8801 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3e87a106ea243dcab233be20d55ea1c. Latest consensus state: current_term: 1 leader_uuid: "c3e87a106ea243dcab233be20d55ea1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e87a106ea243dcab233be20d55ea1c" member_type: VOTER } }
I20260926 13:55:25.067620 8800 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3e87a106ea243dcab233be20d55ea1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e87a106ea243dcab233be20d55ea1c" member_type: VOTER } }
I20260926 13:55:25.068218 8801 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:25.068259 8800 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:25.076088 8805 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:25.082983 8805 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:25.085129 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:25.091040 8805 catalog_manager.cc:1396] Generated new cluster ID: cb48316ed89f4346a3d2db411e5eecbe
I20260926 13:55:25.091243 8805 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:25.111129 8805 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:25.112179 8805 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:25.123551 8805 catalog_manager.cc:6219] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: Generated new TSK 0
I20260926 13:55:25.123991 8805 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:25.150972 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:25.156184 8817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:25.157128 8818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:25.158569 8820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:25.158803 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:25.159569 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:25.159749 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:25.159898 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430925159881 us; error 0 us; skew 500 ppm
I20260926 13:55:25.160375 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:25.162362 3582 webserver.cc:533] Webserver started at http://127.3.127.129:37055/ using document root <none> and password file <none>
I20260926 13:55:25.162783 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:25.162947 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:25.163192 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:25.164168 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "7c94d9b970354787be98a254f3214d2c"
format_stamp: "Formatted at 2026-09-26 13:55:25 on dist-test-slave-fk7n"
I20260926 13:55:25.168330 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260926 13:55:25.171209 8825 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:25.171855 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:25.172109 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "7c94d9b970354787be98a254f3214d2c"
format_stamp: "Formatted at 2026-09-26 13:55:25 on dist-test-slave-fk7n"
I20260926 13:55:25.172355 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:25.198187 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:25.199056 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:25.200313 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:25.202346 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:25.202533 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:25.202742 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:25.202883 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:25.237771 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:40199
I20260926 13:55:25.237854 8887 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:40199 every 8 connection(s)
I20260926 13:55:25.250938 8888 heartbeater.cc:344] Connected to a master server at 127.3.127.190:43389
I20260926 13:55:25.251248 8888 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:25.251960 8888 heartbeater.cc:507] Master 127.3.127.190:43389 requested a full tablet report, sending...
I20260926 13:55:25.253783 8761 ts_manager.cc:194] Registered new tserver with Master: 7c94d9b970354787be98a254f3214d2c (127.3.127.129:40199)
I20260926 13:55:25.254671 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.014019659s
I20260926 13:55:25.255770 8761 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45792
I20260926 13:55:25.274174 8761 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45796:
name: "stale-scan-tokens-dfr"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000\006\001\000\000\000\000\000\000\000\000\007\001d\000\000\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260926 13:55:25.301759 8853 tablet_service.cc:1511] Processing CreateTablet for tablet 47acbe65366047509cd4a05b809ff02d (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914]), partition=RANGE (key) PARTITION -100 <= VALUES < 0
I20260926 13:55:25.302192 8852 tablet_service.cc:1511] Processing CreateTablet for tablet 52e84b92fbc84f8784ff105bfa252881 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260926 13:55:25.303023 8853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47acbe65366047509cd4a05b809ff02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:25.303545 8852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e84b92fbc84f8784ff105bfa252881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:25.318895 8900 tablet_bootstrap.cc:492] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: Bootstrap starting.
I20260926 13:55:25.322889 8900 tablet_bootstrap.cc:654] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:25.326318 8900 tablet_bootstrap.cc:492] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: No bootstrap required, opened a new log
I20260926 13:55:25.326678 8900 ts_tablet_manager.cc:1403] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260926 13:55:25.328527 8900 raft_consensus.cc:359] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.328941 8900 raft_consensus.cc:385] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:25.329167 8900 raft_consensus.cc:740] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Initialized, Role: FOLLOWER
I20260926 13:55:25.329676 8900 consensus_queue.cc:260] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.330107 8900 raft_consensus.cc:399] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:25.330318 8900 raft_consensus.cc:493] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:25.330549 8900 raft_consensus.cc:3060] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:25.334817 8900 raft_consensus.cc:515] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.335287 8900 leader_election.cc:304] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c94d9b970354787be98a254f3214d2c; no voters:
I20260926 13:55:25.336562 8900 leader_election.cc:290] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:25.336925 8902 raft_consensus.cc:2804] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:25.338251 8888 heartbeater.cc:499] Master 127.3.127.190:43389 was elected leader, sending a full tablet report...
I20260926 13:55:25.338215 8902 raft_consensus.cc:697] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Becoming Leader. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Running, Role: LEADER
I20260926 13:55:25.338842 8900 ts_tablet_manager.cc:1434] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: Time spent starting tablet: real 0.012s user 0.010s sys 0.003s
I20260926 13:55:25.339085 8902 consensus_queue.cc:237] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.339499 8900 tablet_bootstrap.cc:492] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c: Bootstrap starting.
I20260926 13:55:25.344980 8900 tablet_bootstrap.cc:654] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:25.344976 8761 catalog_manager.cc:5838] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c94d9b970354787be98a254f3214d2c (127.3.127.129). New cstate: current_term: 1 leader_uuid: "7c94d9b970354787be98a254f3214d2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:25.349552 8900 tablet_bootstrap.cc:492] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c: No bootstrap required, opened a new log
I20260926 13:55:25.349860 8900 ts_tablet_manager.cc:1403] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260926 13:55:25.351583 8900 raft_consensus.cc:359] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.352080 8900 raft_consensus.cc:385] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:25.352350 8900 raft_consensus.cc:740] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Initialized, Role: FOLLOWER
I20260926 13:55:25.352973 8900 consensus_queue.cc:260] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.353432 8900 raft_consensus.cc:399] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:25.353643 8900 raft_consensus.cc:493] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:25.353868 8900 raft_consensus.cc:3060] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:25.359413 8900 raft_consensus.cc:515] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.359869 8900 leader_election.cc:304] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c94d9b970354787be98a254f3214d2c; no voters:
I20260926 13:55:25.360297 8900 leader_election.cc:290] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:25.360425 8902 raft_consensus.cc:2804] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:25.360916 8902 raft_consensus.cc:697] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Becoming Leader. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Running, Role: LEADER
I20260926 13:55:25.361543 8902 consensus_queue.cc:237] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:25.361697 8900 ts_tablet_manager.cc:1434] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260926 13:55:25.366031 8761 catalog_manager.cc:5838] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c94d9b970354787be98a254f3214d2c (127.3.127.129). New cstate: current_term: 1 leader_uuid: "7c94d9b970354787be98a254f3214d2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:26.006549 8761 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45796:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\234\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260926 13:55:26.016472 8761 catalog_manager.cc:6133] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: Sending DeleteTablet for 1 replicas of tablet 47acbe65366047509cd4a05b809ff02d
I20260926 13:55:26.018077 8852 tablet_service.cc:1558] Processing DeleteTablet for tablet 47acbe65366047509cd4a05b809ff02d with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-09-26 13:55:26 UTC) from {username='slave'} at 127.0.0.1:34416
I20260926 13:55:26.019445 8914 tablet_replica.cc:333] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: stopping tablet replica
I20260926 13:55:26.020010 8914 raft_consensus.cc:2243] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:26.020561 8914 raft_consensus.cc:2272] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:26.023476 8914 ts_tablet_manager.cc:1916] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260926 13:55:26.036638 8914 ts_tablet_manager.cc:1929] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.51
I20260926 13:55:26.036971 8914 log.cc:1199] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: Deleting WAL directory at /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.FirstRangeDropped_StaleScanTokensParamTest.DroppingFirstRange_6.1790430890430161-3582-0/minicluster-data/ts-0-root/wals/47acbe65366047509cd4a05b809ff02d
I20260926 13:55:26.037626 8914 ts_tablet_manager.cc:1950] T 47acbe65366047509cd4a05b809ff02d P 7c94d9b970354787be98a254f3214d2c: Deleting consensus metadata
I20260926 13:55:26.039641 8745 catalog_manager.cc:5063] TS 7c94d9b970354787be98a254f3214d2c (127.3.127.129:40199): tablet 47acbe65366047509cd4a05b809ff02d (table stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914]) successfully deleted
I20260926 13:55:26.065610 8761 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45796:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\001\234\377\377\377\377\377\377\377\007\001\316\377\377\377\377\377\377\377""\006\001\234\377\377\377\377\377\377\377\007\001\316\377\377\377\377\377\377\377" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:26.073902 8761 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c43998ea37a248f1a03cd307611ee225 has no consensus state
I20260926 13:55:26.083289 8852 tablet_service.cc:1511] Processing CreateTablet for tablet c43998ea37a248f1a03cd307611ee225 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914]), partition=RANGE (key) PARTITION -100 <= VALUES < -50
I20260926 13:55:26.084339 8852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43998ea37a248f1a03cd307611ee225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:26.095620 8923 tablet_bootstrap.cc:492] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c: Bootstrap starting.
I20260926 13:55:26.099814 8923 tablet_bootstrap.cc:654] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:26.103221 8923 tablet_bootstrap.cc:492] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c: No bootstrap required, opened a new log
I20260926 13:55:26.103607 8923 ts_tablet_manager.cc:1403] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260926 13:55:26.105458 8923 raft_consensus.cc:359] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.105823 8923 raft_consensus.cc:385] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:26.106027 8923 raft_consensus.cc:740] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Initialized, Role: FOLLOWER
W20260926 13:55:26.106554 8748 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet c43998ea37a248f1a03cd307611ee225 (table stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet c43998ea37a248f1a03cd307611ee225 consensus state has no leader
I20260926 13:55:26.106516 8923 consensus_queue.cc:260] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.107003 8923 raft_consensus.cc:399] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:26.107224 8923 raft_consensus.cc:493] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:26.107472 8923 raft_consensus.cc:3060] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:26.112085 8923 raft_consensus.cc:515] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.112548 8923 leader_election.cc:304] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c94d9b970354787be98a254f3214d2c; no voters:
I20260926 13:55:26.113003 8923 leader_election.cc:290] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:26.113131 8902 raft_consensus.cc:2804] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:26.114372 8902 raft_consensus.cc:697] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Becoming Leader. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Running, Role: LEADER
I20260926 13:55:26.115072 8923 ts_tablet_manager.cc:1434] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c: Time spent starting tablet: real 0.011s user 0.004s sys 0.008s
I20260926 13:55:26.115039 8902 consensus_queue.cc:237] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.119887 8760 catalog_manager.cc:5838] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c94d9b970354787be98a254f3214d2c (127.3.127.129). New cstate: current_term: 1 leader_uuid: "7c94d9b970354787be98a254f3214d2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:26.130228 8760 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914] alter complete (version 0)
I20260926 13:55:26.141616 8760 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45796:
table { table_name: "stale-scan-tokens-dfr" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\001\316\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000""\006\001\316\377\377\377\377\377\377\377\007\001\000\000\000\000\000\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260926 13:55:26.150390 8760 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 214708f8eb4a46689071f498a84ac541 has no consensus state
I20260926 13:55:26.159569 8852 tablet_service.cc:1511] Processing CreateTablet for tablet 214708f8eb4a46689071f498a84ac541 (DEFAULT_TABLE table=stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914]), partition=RANGE (key) PARTITION -50 <= VALUES < 0
I20260926 13:55:26.160569 8852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 214708f8eb4a46689071f498a84ac541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:26.171044 8923 tablet_bootstrap.cc:492] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c: Bootstrap starting.
I20260926 13:55:26.175293 8923 tablet_bootstrap.cc:654] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:26.178591 8923 tablet_bootstrap.cc:492] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c: No bootstrap required, opened a new log
I20260926 13:55:26.178958 8923 ts_tablet_manager.cc:1403] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260926 13:55:26.180832 8923 raft_consensus.cc:359] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.181213 8923 raft_consensus.cc:385] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:26.181428 8923 raft_consensus.cc:740] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Initialized, Role: FOLLOWER
I20260926 13:55:26.181936 8923 consensus_queue.cc:260] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.182372 8923 raft_consensus.cc:399] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:26.182591 8923 raft_consensus.cc:493] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:26.182834 8923 raft_consensus.cc:3060] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:26.186972 8923 raft_consensus.cc:515] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.187467 8923 leader_election.cc:304] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c94d9b970354787be98a254f3214d2c; no voters:
I20260926 13:55:26.187923 8923 leader_election.cc:290] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:26.188095 8902 raft_consensus.cc:2804] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:26.188531 8902 raft_consensus.cc:697] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Becoming Leader. State: Replica: 7c94d9b970354787be98a254f3214d2c, State: Running, Role: LEADER
I20260926 13:55:26.189217 8902 consensus_queue.cc:237] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } }
I20260926 13:55:26.189610 8923 ts_tablet_manager.cc:1434] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260926 13:55:26.194774 8760 catalog_manager.cc:5838] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c94d9b970354787be98a254f3214d2c (127.3.127.129). New cstate: current_term: 1 leader_uuid: "7c94d9b970354787be98a254f3214d2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c94d9b970354787be98a254f3214d2c" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40199 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:26.205521 8760 catalog_manager.cc:6391] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: stale-scan-tokens-dfr [id=674fe6df686e472991adbc9b5aae5914] alter complete (version 0)
I20260926 13:55:26.590409 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:26.605710 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:26.606451 3582 tablet_replica.cc:333] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c: stopping tablet replica
I20260926 13:55:26.606957 3582 raft_consensus.cc:2243] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:26.607378 3582 raft_consensus.cc:2272] T 214708f8eb4a46689071f498a84ac541 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:26.609486 3582 tablet_replica.cc:333] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c: stopping tablet replica
I20260926 13:55:26.609931 3582 raft_consensus.cc:2243] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:26.610276 3582 raft_consensus.cc:2272] T c43998ea37a248f1a03cd307611ee225 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:26.611960 3582 tablet_replica.cc:333] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c: stopping tablet replica
I20260926 13:55:26.612358 3582 raft_consensus.cc:2243] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:26.612725 3582 raft_consensus.cc:2272] T 52e84b92fbc84f8784ff105bfa252881 P 7c94d9b970354787be98a254f3214d2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:26.631237 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:26.641286 3582 master.cc:562] Master@127.3.127.190:43389 shutting down...
I20260926 13:55:26.656633 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:26.657078 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:26.657406 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P c3e87a106ea243dcab233be20d55ea1c: stopping tablet replica
I20260926 13:55:26.665164 3582 master.cc:584] Master@127.3.127.190:43389 shutdown complete.
[ OK ] FirstRangeDropped/StaleScanTokensParamTest.DroppingFirstRange/6 (1717 ms)
[----------] 7 tests from FirstRangeDropped/StaleScanTokensParamTest (12027 ms total)
[----------] 3 tests from PickServer/ReplicaSelectionTest
[ RUN ] PickServer/ReplicaSelectionTest.ReplicaSelection/0
I20260926 13:55:26.690145 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:45823
I20260926 13:55:26.691099 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:26.695374 8930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:26.696549 8933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:26.696784 8931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:26.697111 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:26.697829 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:26.697994 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:26.698136 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430926698121 us; error 0 us; skew 500 ppm
I20260926 13:55:26.698611 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:26.700560 3582 webserver.cc:533] Webserver started at http://127.3.127.190:43795/ using document root <none> and password file <none>
I20260926 13:55:26.700982 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:26.701133 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:26.701376 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:26.702289 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "9714e31f3fdd481d878fde11cc13c8ab"
format_stamp: "Formatted at 2026-09-26 13:55:26 on dist-test-slave-fk7n"
I20260926 13:55:26.706193 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260926 13:55:26.709025 8938 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:26.709626 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:26.709860 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "9714e31f3fdd481d878fde11cc13c8ab"
format_stamp: "Formatted at 2026-09-26 13:55:26 on dist-test-slave-fk7n"
I20260926 13:55:26.710089 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:26.725540 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:26.726347 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:26.757416 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:45823
I20260926 13:55:26.757504 8989 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:45823 every 8 connection(s)
I20260926 13:55:26.760771 8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:26.770349 8990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: Bootstrap starting.
I20260926 13:55:26.774235 8990 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:26.777804 8990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: No bootstrap required, opened a new log
I20260926 13:55:26.779558 8990 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:26.779899 8990 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:26.780117 8990 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e31f3fdd481d878fde11cc13c8ab, State: Initialized, Role: FOLLOWER
I20260926 13:55:26.780625 8990 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:26.781203 8990 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:26.781419 8990 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:26.781667 8990 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:26.785707 8990 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:26.786155 8990 leader_election.cc:304] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9714e31f3fdd481d878fde11cc13c8ab; no voters:
I20260926 13:55:26.787107 8990 leader_election.cc:290] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:26.787372 8993 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:26.788558 8993 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 LEADER]: Becoming Leader. State: Replica: 9714e31f3fdd481d878fde11cc13c8ab, State: Running, Role: LEADER
I20260926 13:55:26.789170 8993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:26.789760 8990 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:26.791528 8994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9714e31f3fdd481d878fde11cc13c8ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER } }
I20260926 13:55:26.791528 8995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9714e31f3fdd481d878fde11cc13c8ab. Latest consensus state: current_term: 1 leader_uuid: "9714e31f3fdd481d878fde11cc13c8ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER } }
I20260926 13:55:26.792145 8994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:26.792279 8995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:26.795112 8998 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:26.800593 8998 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:26.802122 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:26.808314 8998 catalog_manager.cc:1396] Generated new cluster ID: 5473c338d7a84a0b92c626261a8f8705
I20260926 13:55:26.808588 8998 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:26.829030 8998 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:26.830166 8998 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:26.846022 8998 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: Generated new TSK 0
I20260926 13:55:26.846544 8998 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:26.867817 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:26.872915 9011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:26.873652 9012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:26.875144 9014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:26.875469 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:26.876202 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:26.876374 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:26.876534 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430926876517 us; error 0 us; skew 500 ppm
I20260926 13:55:26.877089 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:26.879052 3582 webserver.cc:533] Webserver started at http://127.3.127.129:38219/ using document root <none> and password file <none>
I20260926 13:55:26.879463 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:26.879624 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:26.879854 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:26.880834 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "31100581adf746139e2a9bf8203b65cf"
format_stamp: "Formatted at 2026-09-26 13:55:26 on dist-test-slave-fk7n"
I20260926 13:55:26.884794 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260926 13:55:26.887599 9019 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:26.888275 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:26.888528 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "31100581adf746139e2a9bf8203b65cf"
format_stamp: "Formatted at 2026-09-26 13:55:26 on dist-test-slave-fk7n"
I20260926 13:55:26.888787 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:26.899819 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:26.900692 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:26.901976 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:26.903898 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:26.904085 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:26.904289 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:26.904428 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:26.939167 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:40197
I20260926 13:55:26.939258 9081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:40197 every 8 connection(s)
I20260926 13:55:26.953918 9082 heartbeater.cc:344] Connected to a master server at 127.3.127.190:45823
I20260926 13:55:26.954205 9082 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:26.954808 9082 heartbeater.cc:507] Master 127.3.127.190:45823 requested a full tablet report, sending...
I20260926 13:55:26.956511 8955 ts_manager.cc:194] Registered new tserver with Master: 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40197)
I20260926 13:55:26.957391 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.013717205s
I20260926 13:55:26.958096 8955 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56084
I20260926 13:55:26.974658 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:26.988782 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:27.003804 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:27.010031 3582 master.cc:562] Master@127.3.127.190:45823 shutting down...
I20260926 13:55:27.021516 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:27.021970 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:27.022334 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: stopping tablet replica
I20260926 13:55:27.029994 3582 master.cc:584] Master@127.3.127.190:45823 shutdown complete.
I20260926 13:55:27.038796 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:33623
I20260926 13:55:27.039780 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:27.044101 9092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:27.045394 9095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:27.045473 9093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:27.045928 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:27.046710 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:27.046871 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:27.047021 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430927047007 us; error 0 us; skew 500 ppm
I20260926 13:55:27.047537 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:27.049592 3582 webserver.cc:533] Webserver started at http://127.3.127.190:32865/ using document root <none> and password file <none>
I20260926 13:55:27.050012 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:27.050163 3582 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260926 13:55:27.053378 3582 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:27.055945 9100 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.056588 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:27.056854 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "9714e31f3fdd481d878fde11cc13c8ab"
format_stamp: "Formatted at 2026-09-26 13:55:26 on dist-test-slave-fk7n"
I20260926 13:55:27.057103 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:27.067274 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:27.068193 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:27.103325 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:33623
I20260926 13:55:27.103406 9151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:33623 every 8 connection(s)
I20260926 13:55:27.111642 9152 sys_catalog.cc:263] Verifying existing consensus state
I20260926 13:55:27.115561 9152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: Bootstrap starting.
I20260926 13:55:27.134382 9152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260926 13:55:27.135087 9152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: Bootstrap complete.
I20260926 13:55:27.137055 9152 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:27.137408 9152 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e31f3fdd481d878fde11cc13c8ab, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.137925 9152 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:27.138360 9152 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:27.138556 9152 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:27.138752 9152 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:27.142917 9152 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:27.143344 9152 leader_election.cc:304] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9714e31f3fdd481d878fde11cc13c8ab; no voters:
I20260926 13:55:27.144330 9152 leader_election.cc:290] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [CANDIDATE]: Term 2 election: Requested vote from peers
I20260926 13:55:27.144629 9155 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:27.145903 9155 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 2 LEADER]: Becoming Leader. State: Replica: 9714e31f3fdd481d878fde11cc13c8ab, State: Running, Role: LEADER
I20260926 13:55:27.146432 9155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER }
I20260926 13:55:27.146884 9152 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:27.148949 9157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9714e31f3fdd481d878fde11cc13c8ab. Latest consensus state: current_term: 2 leader_uuid: "9714e31f3fdd481d878fde11cc13c8ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER } }
I20260926 13:55:27.148983 9156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9714e31f3fdd481d878fde11cc13c8ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9714e31f3fdd481d878fde11cc13c8ab" member_type: VOTER } }
I20260926 13:55:27.149691 9156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:27.151582 9157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:27.152669 9161 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:27.157830 9161 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:27.160247 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:27.161126 9161 catalog_manager.cc:1308] Loaded cluster ID: 5473c338d7a84a0b92c626261a8f8705
I20260926 13:55:27.161332 9161 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:27.165627 9161 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:27.168224 9161 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab: Loaded TSK: 0
I20260926 13:55:27.169051 9161 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:27.177634 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:27.183281 9172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:27.183799 9173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:27.185424 9175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:27.185940 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:27.186625 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:27.186810 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:27.186961 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430927186944 us; error 0 us; skew 500 ppm
I20260926 13:55:27.187449 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:27.189544 3582 webserver.cc:533] Webserver started at http://127.3.127.129:36301/ using document root <none> and password file <none>
I20260926 13:55:27.189992 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:27.190160 3582 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260926 13:55:27.193461 3582 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260926 13:55:27.195860 9180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.196484 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:27.196738 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "31100581adf746139e2a9bf8203b65cf"
format_stamp: "Formatted at 2026-09-26 13:55:26 on dist-test-slave-fk7n"
I20260926 13:55:27.197042 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:27.214171 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:27.215131 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:27.216449 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:27.218503 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:27.218691 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.218920 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:27.219064 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.253574 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:40315
I20260926 13:55:27.253669 9242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:40315 every 8 connection(s)
I20260926 13:55:27.257833 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:27.265410 9247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:27.265869 9248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:27.268720 9250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:27.269480 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:27.269557 9243 heartbeater.cc:344] Connected to a master server at 127.3.127.190:33623
I20260926 13:55:27.270028 9243 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:27.270404 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:27.270614 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:27.270702 9243 heartbeater.cc:507] Master 127.3.127.190:33623 requested a full tablet report, sending...
I20260926 13:55:27.270780 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430927270763 us; error 0 us; skew 500 ppm
I20260926 13:55:27.271377 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:27.272715 9117 ts_manager.cc:194] Registered new tserver with Master: 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315)
I20260926 13:55:27.273746 3582 webserver.cc:533] Webserver started at http://127.3.127.130:40215/ using document root <none> and password file <none>
I20260926 13:55:27.274363 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:27.274588 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:27.274991 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:27.275110 9117 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35452
I20260926 13:55:27.276348 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-1-root/instance:
uuid: "963979ac151b4df2afabc1ab6a430b9b"
format_stamp: "Formatted at 2026-09-26 13:55:27 on dist-test-slave-fk7n"
I20260926 13:55:27.280679 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260926 13:55:27.283632 9255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.284281 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:27.284541 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-1-root
uuid: "963979ac151b4df2afabc1ab6a430b9b"
format_stamp: "Formatted at 2026-09-26 13:55:27 on dist-test-slave-fk7n"
I20260926 13:55:27.284803 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:27.307334 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:27.308265 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:27.309547 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:27.311503 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:27.311668 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.311890 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:27.312038 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.347455 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.130:35495
I20260926 13:55:27.347543 9317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.130:35495 every 8 connection(s)
I20260926 13:55:27.351694 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:27.357527 9321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:27.359387 9322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:27.361264 9318 heartbeater.cc:344] Connected to a master server at 127.3.127.190:33623
I20260926 13:55:27.361603 9318 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:27.362092 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:27.362569 9318 heartbeater.cc:507] Master 127.3.127.190:33623 requested a full tablet report, sending...
W20260926 13:55:27.363340 9324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:27.364094 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:27.364289 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:27.364491 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430927364463 us; error 0 us; skew 500 ppm
I20260926 13:55:27.364741 9117 ts_manager.cc:194] Registered new tserver with Master: 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:27.365157 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:27.366392 9117 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35464
I20260926 13:55:27.367601 3582 webserver.cc:533] Webserver started at http://127.3.127.131:41851/ using document root <none> and password file <none>
I20260926 13:55:27.368055 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:27.368234 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:27.368510 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:27.369572 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-2-root/instance:
uuid: "5036bd38367e48199b8de47d7853fc87"
format_stamp: "Formatted at 2026-09-26 13:55:27 on dist-test-slave-fk7n"
I20260926 13:55:27.373627 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260926 13:55:27.376547 9329 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.377286 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:27.377542 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-2-root
uuid: "5036bd38367e48199b8de47d7853fc87"
format_stamp: "Formatted at 2026-09-26 13:55:27 on dist-test-slave-fk7n"
I20260926 13:55:27.377789 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_0.1790430890430161-3582-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:27.401661 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:27.402626 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:27.403889 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:27.405870 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:27.406054 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.406261 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:27.406406 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:27.442332 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.131:39167
I20260926 13:55:27.442425 9391 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.131:39167 every 8 connection(s)
I20260926 13:55:27.454658 9392 heartbeater.cc:344] Connected to a master server at 127.3.127.190:33623
I20260926 13:55:27.455014 9392 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:27.455765 9392 heartbeater.cc:507] Master 127.3.127.190:33623 requested a full tablet report, sending...
I20260926 13:55:27.457466 9117 ts_manager.cc:194] Registered new tserver with Master: 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:27.458328 3582 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013114309s
I20260926 13:55:27.458745 9117 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35478
I20260926 13:55:27.479712 9117 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35482:
name: "replica_selection"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 10
seed: 0
}
}
W20260926 13:55:27.481746 9117 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replica_selection in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260926 13:55:27.548448 9357 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcba31649db42f58ce04c10758ca297 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.549779 9357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcba31649db42f58ce04c10758ca297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.552096 9353 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4eb5b0abcd4df983923718c800b998 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.553319 9353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4eb5b0abcd4df983923718c800b998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.556529 9354 tablet_service.cc:1511] Processing CreateTablet for tablet ab4ec5b0032a4b08911b6e8b1658e45a (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.557703 9354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4ec5b0032a4b08911b6e8b1658e45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.559844 9355 tablet_service.cc:1511] Processing CreateTablet for tablet a6bc150b80ac43d98ea0998dc4e23d6f (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.561050 9355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bc150b80ac43d98ea0998dc4e23d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.563503 9283 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcba31649db42f58ce04c10758ca297 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.564692 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcba31649db42f58ce04c10758ca297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.564740 9352 tablet_service.cc:1511] Processing CreateTablet for tablet f540c52111434b839719f0c1c0113620 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.565708 9277 tablet_service.cc:1511] Processing CreateTablet for tablet 41c702c434fc4bcb828c246a7017a83a (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.566885 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c702c434fc4bcb828c246a7017a83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.568406 9351 tablet_service.cc:1511] Processing CreateTablet for tablet 41c702c434fc4bcb828c246a7017a83a (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.568917 9278 tablet_service.cc:1511] Processing CreateTablet for tablet f540c52111434b839719f0c1c0113620 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.570080 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f540c52111434b839719f0c1c0113620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.570118 9350 tablet_service.cc:1511] Processing CreateTablet for tablet 5140fbbd182b49f993534b84130a185b (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.573469 9349 tablet_service.cc:1511] Processing CreateTablet for tablet 04729c698ede46c78868c2040e9ad38b (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.573967 9279 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4eb5b0abcd4df983923718c800b998 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.574672 9349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04729c698ede46c78868c2040e9ad38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.575134 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4eb5b0abcd4df983923718c800b998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.576534 9350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5140fbbd182b49f993534b84130a185b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.578020 9352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f540c52111434b839719f0c1c0113620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.577937 9280 tablet_service.cc:1511] Processing CreateTablet for tablet ab4ec5b0032a4b08911b6e8b1658e45a (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.579150 9280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4ec5b0032a4b08911b6e8b1658e45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.581604 9282 tablet_service.cc:1511] Processing CreateTablet for tablet 802f137e22714b5ea0ee9530e62d2db1 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.581916 9281 tablet_service.cc:1511] Processing CreateTablet for tablet a6bc150b80ac43d98ea0998dc4e23d6f (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.582789 9282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802f137e22714b5ea0ee9530e62d2db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.584359 9281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bc150b80ac43d98ea0998dc4e23d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.584646 9276 tablet_service.cc:1511] Processing CreateTablet for tablet 5140fbbd182b49f993534b84130a185b (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.563462 9356 tablet_service.cc:1511] Processing CreateTablet for tablet 802f137e22714b5ea0ee9530e62d2db1 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.586449 9356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802f137e22714b5ea0ee9530e62d2db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.586993 9275 tablet_service.cc:1511] Processing CreateTablet for tablet 04729c698ede46c78868c2040e9ad38b (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.589408 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5140fbbd182b49f993534b84130a185b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.589982 9275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04729c698ede46c78868c2040e9ad38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.590098 9274 tablet_service.cc:1511] Processing CreateTablet for tablet 6210fe45bb654298a404f65b1c766d88 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.591280 9274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6210fe45bb654298a404f65b1c766d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.593935 9348 tablet_service.cc:1511] Processing CreateTablet for tablet 6210fe45bb654298a404f65b1c766d88 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.596808 9351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c702c434fc4bcb828c246a7017a83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.597762 9348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6210fe45bb654298a404f65b1c766d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.643033 9208 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcba31649db42f58ce04c10758ca297 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.645126 9207 tablet_service.cc:1511] Processing CreateTablet for tablet 802f137e22714b5ea0ee9530e62d2db1 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.649322 9208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcba31649db42f58ce04c10758ca297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.645701 9206 tablet_service.cc:1511] Processing CreateTablet for tablet a6bc150b80ac43d98ea0998dc4e23d6f (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.650100 9204 tablet_service.cc:1511] Processing CreateTablet for tablet 8c4eb5b0abcd4df983923718c800b998 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.647385 9205 tablet_service.cc:1511] Processing CreateTablet for tablet ab4ec5b0032a4b08911b6e8b1658e45a (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.653795 9204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c4eb5b0abcd4df983923718c800b998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.655443 9205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4ec5b0032a4b08911b6e8b1658e45a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.656399 9207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802f137e22714b5ea0ee9530e62d2db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.657469 9206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6bc150b80ac43d98ea0998dc4e23d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.659746 9203 tablet_service.cc:1511] Processing CreateTablet for tablet f540c52111434b839719f0c1c0113620 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.662158 9203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f540c52111434b839719f0c1c0113620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.663627 9202 tablet_service.cc:1511] Processing CreateTablet for tablet 41c702c434fc4bcb828c246a7017a83a (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.664739 9202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c702c434fc4bcb828c246a7017a83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.656919 9407 tablet_bootstrap.cc:492] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:27.667701 9201 tablet_service.cc:1511] Processing CreateTablet for tablet 5140fbbd182b49f993534b84130a185b (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.669592 9199 tablet_service.cc:1511] Processing CreateTablet for tablet 6210fe45bb654298a404f65b1c766d88 (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.669890 9201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5140fbbd182b49f993534b84130a185b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.674872 9199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6210fe45bb654298a404f65b1c766d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.676321 9408 tablet_bootstrap.cc:492] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.672775 9200 tablet_service.cc:1511] Processing CreateTablet for tablet 04729c698ede46c78868c2040e9ad38b (DEFAULT_TABLE table=replica_selection [id=1fc7b20285664ea4b572c92a8f414418]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:27.680116 9200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04729c698ede46c78868c2040e9ad38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:27.711120 9408 tablet_bootstrap.cc:654] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.713791 9407 tablet_bootstrap.cc:654] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.727116 9409 tablet_bootstrap.cc:492] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:27.732921 9408 tablet_bootstrap.cc:492] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:27.733842 9409 tablet_bootstrap.cc:654] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.734200 9408 ts_tablet_manager.cc:1403] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.086s user 0.012s sys 0.000s
I20260926 13:55:27.737246 9408 raft_consensus.cc:359] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:27.738083 9408 raft_consensus.cc:385] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.738430 9408 raft_consensus.cc:740] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.739188 9408 consensus_queue.cc:260] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:27.741125 9407 tablet_bootstrap.cc:492] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:27.741648 9407 ts_tablet_manager.cc:1403] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.152s user 0.014s sys 0.004s
I20260926 13:55:27.744518 9407 raft_consensus.cc:359] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:27.745330 9407 raft_consensus.cc:385] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.745496 9392 heartbeater.cc:499] Master 127.3.127.190:33623 was elected leader, sending a full tablet report...
I20260926 13:55:27.745692 9407 raft_consensus.cc:740] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.746448 9408 ts_tablet_manager.cc:1434] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260926 13:55:27.746624 9407 consensus_queue.cc:260] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:27.747426 9408 tablet_bootstrap.cc:492] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.753681 9408 tablet_bootstrap.cc:654] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.754933 9318 heartbeater.cc:499] Master 127.3.127.190:33623 was elected leader, sending a full tablet report...
I20260926 13:55:27.756008 9407 ts_tablet_manager.cc:1434] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
I20260926 13:55:27.756970 9407 tablet_bootstrap.cc:492] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:27.763314 9407 tablet_bootstrap.cc:654] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.763016 9409 tablet_bootstrap.cc:492] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:27.764989 9409 ts_tablet_manager.cc:1403] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.008s
I20260926 13:55:27.767810 9409 raft_consensus.cc:359] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.768394 9409 raft_consensus.cc:385] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.768639 9409 raft_consensus.cc:740] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.768898 9408 tablet_bootstrap.cc:492] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:27.769456 9408 ts_tablet_manager.cc:1403] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.007s
I20260926 13:55:27.769512 9409 consensus_queue.cc:260] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.772397 9408 raft_consensus.cc:359] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.773159 9408 raft_consensus.cc:385] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.773485 9408 raft_consensus.cc:740] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.774343 9408 consensus_queue.cc:260] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.775199 9407 tablet_bootstrap.cc:492] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:27.775658 9407 ts_tablet_manager.cc:1403] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20260926 13:55:27.776564 9408 ts_tablet_manager.cc:1434] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260926 13:55:27.777478 9408 tablet_bootstrap.cc:492] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.778339 9407 raft_consensus.cc:359] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.779117 9407 raft_consensus.cc:385] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.779444 9407 raft_consensus.cc:740] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.781865 9243 heartbeater.cc:499] Master 127.3.127.190:33623 was elected leader, sending a full tablet report...
I20260926 13:55:27.782827 9409 ts_tablet_manager.cc:1434] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.017s user 0.008s sys 0.003s
I20260926 13:55:27.783389 9408 tablet_bootstrap.cc:654] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.783720 9409 tablet_bootstrap.cc:492] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:27.780256 9407 consensus_queue.cc:260] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.785604 9407 ts_tablet_manager.cc:1434] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260926 13:55:27.786820 9407 tablet_bootstrap.cc:492] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:27.793309 9409 tablet_bootstrap.cc:654] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.793243 9407 tablet_bootstrap.cc:654] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.795768 9408 tablet_bootstrap.cc:492] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:27.796244 9408 ts_tablet_manager.cc:1403] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.004s
I20260926 13:55:27.799223 9408 raft_consensus.cc:359] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.799993 9408 raft_consensus.cc:385] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.800333 9408 raft_consensus.cc:740] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.801214 9408 consensus_queue.cc:260] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.803584 9408 ts_tablet_manager.cc:1434] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260926 13:55:27.804512 9408 tablet_bootstrap.cc:492] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.805349 9407 tablet_bootstrap.cc:492] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:27.805845 9407 ts_tablet_manager.cc:1403] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.009s
I20260926 13:55:27.809166 9407 raft_consensus.cc:359] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.810534 9408 tablet_bootstrap.cc:654] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.809970 9407 raft_consensus.cc:385] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.813061 9407 raft_consensus.cc:740] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.813800 9407 consensus_queue.cc:260] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.815541 9409 tablet_bootstrap.cc:492] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:27.815852 9407 ts_tablet_manager.cc:1434] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.010s user 0.004s sys 0.002s
I20260926 13:55:27.816025 9409 ts_tablet_manager.cc:1403] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.017s
I20260926 13:55:27.818819 9407 tablet_bootstrap.cc:492] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:27.820937 9409 raft_consensus.cc:359] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.821843 9409 raft_consensus.cc:385] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.822177 9409 raft_consensus.cc:740] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.822914 9409 consensus_queue.cc:260] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.825124 9407 tablet_bootstrap.cc:654] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.828740 9409 ts_tablet_manager.cc:1434] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.010s user 0.000s sys 0.005s
I20260926 13:55:27.829684 9409 tablet_bootstrap.cc:492] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:27.833027 9408 tablet_bootstrap.cc:492] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:27.833506 9408 ts_tablet_manager.cc:1403] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.019s
I20260926 13:55:27.836702 9408 raft_consensus.cc:359] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.837441 9408 raft_consensus.cc:385] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.837750 9408 raft_consensus.cc:740] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.838347 9409 tablet_bootstrap.cc:654] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.838477 9408 consensus_queue.cc:260] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.840862 9408 ts_tablet_manager.cc:1434] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260926 13:55:27.841799 9408 tablet_bootstrap.cc:492] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.844076 9407 tablet_bootstrap.cc:492] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:27.844519 9407 ts_tablet_manager.cc:1403] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.026s user 0.015s sys 0.007s
I20260926 13:55:27.847226 9407 raft_consensus.cc:359] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.847990 9407 raft_consensus.cc:385] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.848059 9408 tablet_bootstrap.cc:654] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.848387 9407 raft_consensus.cc:740] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.849180 9407 consensus_queue.cc:260] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.853681 9407 ts_tablet_manager.cc:1434] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260926 13:55:27.854585 9407 tablet_bootstrap.cc:492] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:27.854782 9408 tablet_bootstrap.cc:492] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:27.855190 9408 ts_tablet_manager.cc:1403] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260926 13:55:27.857127 9408 raft_consensus.cc:359] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.857615 9408 raft_consensus.cc:385] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.857829 9408 raft_consensus.cc:740] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.858397 9408 consensus_queue.cc:260] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.860267 9408 ts_tablet_manager.cc:1434] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260926 13:55:27.861011 9407 tablet_bootstrap.cc:654] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.861244 9408 tablet_bootstrap.cc:492] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.866170 9407 tablet_bootstrap.cc:492] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:27.866568 9409 tablet_bootstrap.cc:492] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:27.866670 9407 ts_tablet_manager.cc:1403] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260926 13:55:27.867029 9409 ts_tablet_manager.cc:1403] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.009s
I20260926 13:55:27.868117 9408 tablet_bootstrap.cc:654] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.869444 9407 raft_consensus.cc:359] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.870110 9407 raft_consensus.cc:385] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.869756 9409 raft_consensus.cc:359] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.870419 9407 raft_consensus.cc:740] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.870594 9409 raft_consensus.cc:385] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.870935 9409 raft_consensus.cc:740] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.871279 9407 consensus_queue.cc:260] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.872148 9409 consensus_queue.cc:260] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.873445 9407 ts_tablet_manager.cc:1434] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260926 13:55:27.874091 9409 ts_tablet_manager.cc:1434] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260926 13:55:27.874311 9407 tablet_bootstrap.cc:492] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:27.875057 9409 tablet_bootstrap.cc:492] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:27.875123 9408 tablet_bootstrap.cc:492] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:27.875650 9408 ts_tablet_manager.cc:1403] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.001s
I20260926 13:55:27.878329 9408 raft_consensus.cc:359] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.879071 9408 raft_consensus.cc:385] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.879402 9408 raft_consensus.cc:740] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.880208 9408 consensus_queue.cc:260] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.881485 9407 tablet_bootstrap.cc:654] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.882591 9408 ts_tablet_manager.cc:1434] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260926 13:55:27.883487 9408 tablet_bootstrap.cc:492] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.889626 9408 tablet_bootstrap.cc:654] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.893594 9407 tablet_bootstrap.cc:492] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:27.893831 9409 tablet_bootstrap.cc:654] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.894073 9407 ts_tablet_manager.cc:1403] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.001s
I20260926 13:55:27.897017 9407 raft_consensus.cc:359] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.897730 9407 raft_consensus.cc:385] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.898151 9407 raft_consensus.cc:740] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.899156 9409 tablet_bootstrap.cc:492] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:27.900068 9417 raft_consensus.cc:493] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:27.900396 9409 ts_tablet_manager.cc:1403] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.006s
I20260926 13:55:27.899076 9407 consensus_queue.cc:260] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.900890 9408 tablet_bootstrap.cc:492] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:27.901391 9408 ts_tablet_manager.cc:1403] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.007s
I20260926 13:55:27.902496 9407 ts_tablet_manager.cc:1434] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20260926 13:55:27.903430 9407 tablet_bootstrap.cc:492] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:27.903092 9409 raft_consensus.cc:359] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.903880 9409 raft_consensus.cc:385] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.904212 9409 raft_consensus.cc:740] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.904155 9408 raft_consensus.cc:359] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.905001 9408 raft_consensus.cc:385] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:27.905347 9408 raft_consensus.cc:740] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:27.905174 9409 consensus_queue.cc:260] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.900542 9417 raft_consensus.cc:515] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.906188 9408 consensus_queue.cc:260] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.908366 9408 ts_tablet_manager.cc:1434] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260926 13:55:27.909201 9408 tablet_bootstrap.cc:492] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:27.909931 9407 tablet_bootstrap.cc:654] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.908631 9417 leader_election.cc:290] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:27.918084 9408 tablet_bootstrap.cc:654] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.921854 9409 ts_tablet_manager.cc:1434] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.021s user 0.008s sys 0.007s
I20260926 13:55:27.922324 9414 raft_consensus.cc:493] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:27.922892 9409 tablet_bootstrap.cc:492] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:27.922830 9414 raft_consensus.cc:515] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.928032 9414 leader_election.cc:290] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:27.930918 9409 tablet_bootstrap.cc:654] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:27.934479 9413 raft_consensus.cc:493] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:27.934917 9413 raft_consensus.cc:515] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:27.937399 9413 leader_election.cc:290] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.005724 9413 raft_consensus.cc:493] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.006202 9413 raft_consensus.cc:515] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.008144 9413 leader_election.cc:290] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.008605 9413 raft_consensus.cc:493] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.010797 9413 raft_consensus.cc:515] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.012634 9413 leader_election.cc:290] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.021061 9414 raft_consensus.cc:493] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.021543 9414 raft_consensus.cc:515] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:28.023387 9414 leader_election.cc:290] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167), 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315)
I20260926 13:55:28.032286 9414 raft_consensus.cc:493] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.032819 9414 raft_consensus.cc:515] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.034783 9414 leader_election.cc:290] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.045670 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.054675 9414 raft_consensus.cc:493] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.055377 9414 raft_consensus.cc:515] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.057404 9414 leader_election.cc:290] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.058104 9440 raft_consensus.cc:493] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.058733 9440 raft_consensus.cc:515] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.071564 9413 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.080982 9440 leader_election.cc:290] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.080793 9413 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.081482 9414 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.081936 9414 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.082590 9413 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.072901 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.083751 9414 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
W20260926 13:55:28.073953 9331 leader_election.cc:343] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.074334 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.085862 9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.086581 9293 raft_consensus.cc:2468] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 0.
I20260926 13:55:28.087224 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.087823 9217 raft_consensus.cc:2468] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 0.
I20260926 13:55:28.088418 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
W20260926 13:55:28.090227 9257 leader_election.cc:343] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.091238 9216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5140fbbd182b49f993534b84130a185b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.092830 9215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.093541 9215 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 0.
I20260926 13:55:28.094555 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.095677 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.096232 9217 raft_consensus.cc:2468] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 0.
I20260926 13:55:28.098201 9182 leader_election.cc:304] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:28.099414 9430 raft_consensus.cc:2804] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.099617 9407 tablet_bootstrap.cc:492] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:28.099821 9430 raft_consensus.cc:493] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.100171 9430 raft_consensus.cc:3060] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.105786 9408 tablet_bootstrap.cc:492] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:28.106223 9408 ts_tablet_manager.cc:1403] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.197s user 0.058s sys 0.113s
I20260926 13:55:28.106691 9409 tablet_bootstrap.cc:492] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:28.107126 9409 ts_tablet_manager.cc:1403] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.184s user 0.065s sys 0.097s
I20260926 13:55:28.108489 9430 raft_consensus.cc:515] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:28.109512 9257 leader_election.cc:343] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.108961 9407 ts_tablet_manager.cc:1403] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.206s user 0.047s sys 0.133s
I20260926 13:55:28.108673 9408 raft_consensus.cc:359] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.109815 9409 raft_consensus.cc:359] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.110744 9408 raft_consensus.cc:385] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.111092 9408 raft_consensus.cc:740] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.110975 9409 raft_consensus.cc:385] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.111896 9408 consensus_queue.cc:260] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.111805 9409 raft_consensus.cc:740] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.113060 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.113642 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
W20260926 13:55:28.113948 9331 leader_election.cc:343] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.113889 9367 raft_consensus.cc:2468] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 0.
I20260926 13:55:28.114250 9217 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 0.
W20260926 13:55:28.115013 9331 leader_election.cc:343] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.115644 9331 leader_election.cc:304] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87; no voters:
I20260926 13:55:28.118907 9408 ts_tablet_manager.cc:1434] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260926 13:55:28.118837 9407 raft_consensus.cc:359] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.119565 9407 raft_consensus.cc:385] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.119812 9408 tablet_bootstrap.cc:492] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:28.119851 9407 raft_consensus.cc:740] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.120548 9407 consensus_queue.cc:260] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.123099 9413 raft_consensus.cc:2804] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.123539 9413 raft_consensus.cc:493] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.123165 9409 consensus_queue.cc:260] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.123870 9413 raft_consensus.cc:3060] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.125483 9409 ts_tablet_manager.cc:1434] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260926 13:55:28.126399 9409 tablet_bootstrap.cc:492] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:28.122640 9407 ts_tablet_manager.cc:1434] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20260926 13:55:28.126461 9408 tablet_bootstrap.cc:654] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.123561 9430 leader_election.cc:290] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 election: Requested vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.127589 9331 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87; no voters:
I20260926 13:55:28.127941 9407 tablet_bootstrap.cc:492] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:28.128361 9440 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.128741 9440 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.129151 9440 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.111552 9257 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:28.132177 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.133323 9367 raft_consensus.cc:3060] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.137452 9413 raft_consensus.cc:515] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.139410 9413 leader_election.cc:290] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.140125 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.140316 9367 raft_consensus.cc:2468] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 1.
I20260926 13:55:28.140654 9217 raft_consensus.cc:3060] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.141495 9414 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.140597 9440 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.142395 9414 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260926 13:55:28.143522 9257 leader_election.cc:343] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.144606 9413 raft_consensus.cc:493] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.145148 9413 raft_consensus.cc:515] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:28.146903 9182 leader_election.cc:304] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87; no voters:
I20260926 13:55:28.145777 9257 leader_election.cc:304] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:28.148216 9414 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.148151 9430 raft_consensus.cc:2804] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:28.150542 9440 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.151861 9413 leader_election.cc:290] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315)
I20260926 13:55:28.151621 9430 raft_consensus.cc:697] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 1 LEADER]: Becoming Leader. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Running, Role: LEADER
I20260926 13:55:28.153018 9430 consensus_queue.cc:237] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.154832 9217 raft_consensus.cc:2468] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 1.
I20260926 13:55:28.154227 9407 tablet_bootstrap.cc:654] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.161479 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.161815 9444 raft_consensus.cc:2804] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.162030 9218 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.162276 9444 raft_consensus.cc:493] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.163697 9331 leader_election.cc:304] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87; no voters:
I20260926 13:55:28.165607 9413 raft_consensus.cc:2804] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:28.166090 9413 raft_consensus.cc:697] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Becoming Leader. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Running, Role: LEADER
I20260926 13:55:28.170596 9218 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 1.
I20260926 13:55:28.168817 9413 consensus_queue.cc:237] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.164378 9444 raft_consensus.cc:3060] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.171380 9409 tablet_bootstrap.cc:654] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.171327 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.175307 9414 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.175772 9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.176894 9331 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87; no voters:
I20260926 13:55:28.179342 9440 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election won for term 1
W20260926 13:55:28.179508 9331 leader_election.cc:343] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.178939 9115 catalog_manager.cc:5838] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 31100581adf746139e2a9bf8203b65cf (127.3.127.129). New cstate: current_term: 1 leader_uuid: "31100581adf746139e2a9bf8203b65cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:28.182237 9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.183851 9292 raft_consensus.cc:2468] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 0.
I20260926 13:55:28.189433 9408 tablet_bootstrap.cc:492] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:28.189889 9408 ts_tablet_manager.cc:1403] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.070s user 0.024s sys 0.012s
I20260926 13:55:28.191332 9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.191491 9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.193944 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.194077 9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.195380 9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.193430 9291 raft_consensus.cc:2468] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 0.
I20260926 13:55:28.192826 9292 raft_consensus.cc:2468] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 0.
I20260926 13:55:28.198832 9289 raft_consensus.cc:2393] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5036bd38367e48199b8de47d7853fc87 in current term 1: Already voted for candidate 963979ac151b4df2afabc1ab6a430b9b in this term.
I20260926 13:55:28.198580 9408 raft_consensus.cc:359] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.199473 9408 raft_consensus.cc:385] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.199797 9408 raft_consensus.cc:740] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.193675 9414 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.199777 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.205329 9408 consensus_queue.cc:260] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.205049 9440 raft_consensus.cc:697] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Becoming Leader. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Running, Role: LEADER
I20260926 13:55:28.208423 9290 raft_consensus.cc:2468] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 0.
I20260926 13:55:28.210917 9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.210768 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.212473 9366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.214020 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.213967 9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.214154 9331 leader_election.cc:304] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.211453 9364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5140fbbd182b49f993534b84130a185b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.214104 9440 consensus_queue.cc:237] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.218240 9364 raft_consensus.cc:2468] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 0.
I20260926 13:55:28.216182 9367 raft_consensus.cc:2468] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 0.
I20260926 13:55:28.213897 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.220639 9217 raft_consensus.cc:2393] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.221180 9365 raft_consensus.cc:2393] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 1: Already voted for candidate 31100581adf746139e2a9bf8203b65cf in this term.
I20260926 13:55:28.220700 9444 raft_consensus.cc:515] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:28.221628 9331 leader_election.cc:343] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.222452 9293 raft_consensus.cc:2393] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf in current term 1: Already voted for candidate 963979ac151b4df2afabc1ab6a430b9b in this term.
I20260926 13:55:28.216668 9366 raft_consensus.cc:2468] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 0.
I20260926 13:55:28.220731 9292 raft_consensus.cc:2393] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5036bd38367e48199b8de47d7853fc87 in current term 1: Already voted for candidate 963979ac151b4df2afabc1ab6a430b9b in this term.
I20260926 13:55:28.225993 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.226964 9407 tablet_bootstrap.cc:492] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:28.227399 9407 ts_tablet_manager.cc:1403] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.100s user 0.011s sys 0.016s
I20260926 13:55:28.222745 9413 raft_consensus.cc:2804] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260926 13:55:28.224942 9331 leader_election.cc:343] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.229894 9413 raft_consensus.cc:493] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.230685 9407 raft_consensus.cc:359] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.230934 9331 leader_election.cc:304] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.231446 9407 raft_consensus.cc:385] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.231706 9407 raft_consensus.cc:740] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.230494 9116 catalog_manager.cc:5838] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5036bd38367e48199b8de47d7853fc87 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "5036bd38367e48199b8de47d7853fc87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:28.233240 9407 consensus_queue.cc:260] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.232669 9444 leader_election.cc:290] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.236053 9447 raft_consensus.cc:2804] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.236091 9331 leader_election.cc:304] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.236614 9447 raft_consensus.cc:493] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.237020 9447 raft_consensus.cc:3060] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.231328 9413 raft_consensus.cc:3060] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.240352 9331 leader_election.cc:304] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.246219 9407 ts_tablet_manager.cc:1434] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.019s user 0.001s sys 0.005s
I20260926 13:55:28.247143 9407 tablet_bootstrap.cc:492] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:28.256554 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.264485 9407 tablet_bootstrap.cc:654] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.259099 9447 raft_consensus.cc:515] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.266486 9408 ts_tablet_manager.cc:1434] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.076s user 0.012s sys 0.000s
I20260926 13:55:28.267347 9408 tablet_bootstrap.cc:492] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87: Bootstrap starting.
I20260926 13:55:28.267521 9409 tablet_bootstrap.cc:492] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:28.267956 9409 ts_tablet_manager.cc:1403] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.142s user 0.013s sys 0.015s
I20260926 13:55:28.268325 9413 raft_consensus.cc:515] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.271323 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c702c434fc4bcb828c246a7017a83a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.273327 9365 raft_consensus.cc:2393] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 1: Already voted for candidate 31100581adf746139e2a9bf8203b65cf in this term.
I20260926 13:55:28.275944 9451 raft_consensus.cc:2804] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.275843 9409 raft_consensus.cc:359] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.276412 9451 raft_consensus.cc:493] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.276640 9409 raft_consensus.cc:385] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.276785 9451 raft_consensus.cc:3060] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.277098 9409 raft_consensus.cc:740] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.277588 9452 raft_consensus.cc:2804] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.282320 9452 raft_consensus.cc:493] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.282680 9413 leader_election.cc:290] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.284061 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.284277 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.285777 9409 consensus_queue.cc:260] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:28.286366 9331 leader_election.cc:343] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
W20260926 13:55:28.287081 9331 leader_election.cc:343] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.287532 9409 ts_tablet_manager.cc:1434] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.019s user 0.006s sys 0.002s
I20260926 13:55:28.282737 9452 raft_consensus.cc:3060] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.289927 9409 tablet_bootstrap.cc:492] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:28.289047 9257 leader_election.cc:304] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.290735 9447 leader_election.cc:290] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.291117 9408 tablet_bootstrap.cc:654] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.291915 9414 raft_consensus.cc:2804] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.292254 9414 raft_consensus.cc:493] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.292559 9414 raft_consensus.cc:3060] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.294230 9257 leader_election.cc:304] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.297189 9257 leader_election.cc:304] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.298424 9444 raft_consensus.cc:2804] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.300279 9444 raft_consensus.cc:493] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.300601 9444 raft_consensus.cc:3060] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.301469 9451 raft_consensus.cc:515] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.318150 9430 raft_consensus.cc:493] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.318684 9430 raft_consensus.cc:515] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.322441 9452 raft_consensus.cc:515] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:28.324419 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802f137e22714b5ea0ee9530e62d2db1" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.320701 9430 leader_election.cc:290] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
W20260926 13:55:28.326675 9182 leader_election.cc:343] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.318178 9414 raft_consensus.cc:515] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.327975 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.328814 9414 leader_election.cc:290] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.329315 9414 raft_consensus.cc:2804] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.329630 9414 raft_consensus.cc:493] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.329890 9414 raft_consensus.cc:3060] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
W20260926 13:55:28.333104 9331 leader_election.cc:343] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.333725 9451 leader_election.cc:290] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.334718 9452 leader_election.cc:290] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Requested vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315)
I20260926 13:55:28.337453 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.337363 9414 raft_consensus.cc:515] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
W20260926 13:55:28.338909 9331 leader_election.cc:343] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.339116 9414 leader_election.cc:290] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Requested vote from peers 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167), 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315)
I20260926 13:55:28.323026 9444 raft_consensus.cc:515] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:28.345336 9257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.127.131:39167, user_credentials={real_user=slave}} blocked reactor thread for 48210.1us
I20260926 13:55:28.346642 9459 raft_consensus.cc:493] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.346886 9257 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:28.348918 9409 tablet_bootstrap.cc:654] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.348232 9407 tablet_bootstrap.cc:492] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:28.355154 9407 ts_tablet_manager.cc:1403] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.108s user 0.005s sys 0.014s
I20260926 13:55:28.346385 9444 leader_election.cc:290] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.349444 9257 leader_election.cc:304] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:28.356294 9408 tablet_bootstrap.cc:492] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87: No bootstrap required, opened a new log
I20260926 13:55:28.347191 9459 raft_consensus.cc:515] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.356950 9408 ts_tablet_manager.cc:1403] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87: Time spent bootstrapping tablet: real 0.090s user 0.031s sys 0.022s
I20260926 13:55:28.360239 9407 raft_consensus.cc:359] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.360939 9407 raft_consensus.cc:385] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.361120 9407 raft_consensus.cc:740] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.361505 9407 consensus_queue.cc:260] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.362782 9407 ts_tablet_manager.cc:1434] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260926 13:55:28.361980 9115 catalog_manager.cc:5838] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5036bd38367e48199b8de47d7853fc87 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "5036bd38367e48199b8de47d7853fc87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:28.358866 9444 raft_consensus.cc:2749] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.363338 9407 tablet_bootstrap.cc:492] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b: Bootstrap starting.
I20260926 13:55:28.366050 9459 leader_election.cc:290] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.347836 9414 raft_consensus.cc:2749] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.367789 9408 raft_consensus.cc:359] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.368413 9408 raft_consensus.cc:385] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.368664 9408 raft_consensus.cc:740] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.369496 9408 consensus_queue.cc:260] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.374637 9408 ts_tablet_manager.cc:1434] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260926 13:55:28.375743 9407 tablet_bootstrap.cc:654] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.379453 9218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5140fbbd182b49f993534b84130a185b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.379832 9407 tablet_bootstrap.cc:492] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b: No bootstrap required, opened a new log
I20260926 13:55:28.379987 9218 raft_consensus.cc:3060] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.380215 9407 ts_tablet_manager.cc:1403] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.002s
I20260926 13:55:28.380776 9409 tablet_bootstrap.cc:492] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:28.381258 9409 ts_tablet_manager.cc:1403] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.092s user 0.010s sys 0.008s
I20260926 13:55:28.382809 9407 raft_consensus.cc:359] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.383474 9407 raft_consensus.cc:385] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.383773 9407 raft_consensus.cc:740] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.383915 9409 raft_consensus.cc:359] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.384572 9409 raft_consensus.cc:385] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.384526 9407 consensus_queue.cc:260] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.385000 9409 raft_consensus.cc:740] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.385900 9409 consensus_queue.cc:260] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.386786 9407 ts_tablet_manager.cc:1434] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260926 13:55:28.387607 9366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.388281 9366 raft_consensus.cc:2393] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.388830 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.388924 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.386670 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5140fbbd182b49f993534b84130a185b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.389652 9367 raft_consensus.cc:2393] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.389741 9365 raft_consensus.cc:3060] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.389901 9409 ts_tablet_manager.cc:1434] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260926 13:55:28.389927 9215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.391479 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6210fe45bb654298a404f65b1c766d88" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.391700 9409 tablet_bootstrap.cc:492] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:28.391549 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6210fe45bb654298a404f65b1c766d88" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.392108 9367 raft_consensus.cc:2468] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 0.
I20260926 13:55:28.392266 9217 raft_consensus.cc:2468] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 0.
I20260926 13:55:28.393805 9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802f137e22714b5ea0ee9530e62d2db1" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.394106 9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.394377 9293 raft_consensus.cc:2468] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 0.
I20260926 13:55:28.394639 9292 raft_consensus.cc:3060] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.394716 9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.395226 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.395540 9289 raft_consensus.cc:2393] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5036bd38367e48199b8de47d7853fc87 in current term 1: Already voted for candidate 963979ac151b4df2afabc1ab6a430b9b in this term.
I20260926 13:55:28.395757 9290 raft_consensus.cc:3060] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.396788 9289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.397475 9289 raft_consensus.cc:2393] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5036bd38367e48199b8de47d7853fc87 in current term 1: Already voted for candidate 963979ac151b4df2afabc1ab6a430b9b in this term.
I20260926 13:55:28.397286 9331 leader_election.cc:304] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87; no voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b
W20260926 13:55:28.398731 9257 leader_election.cc:343] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
W20260926 13:55:28.399382 9257 leader_election.cc:343] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:28.399951 9452 raft_consensus.cc:2749] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.399991 9257 leader_election.cc:304] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:28.401021 9460 raft_consensus.cc:2804] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.401077 9257 leader_election.cc:304] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:28.401436 9460 raft_consensus.cc:493] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.401401 9182 leader_election.cc:304] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters: 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:28.401852 9414 raft_consensus.cc:2749] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.401935 9460 raft_consensus.cc:3060] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.402510 9430 raft_consensus.cc:2804] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:28.402861 9430 raft_consensus.cc:493] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:28.402947 9257 leader_election.cc:304] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:28.403234 9430 raft_consensus.cc:3060] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.403661 9414 raft_consensus.cc:2749] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.404150 9292 raft_consensus.cc:2468] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 1.
I20260926 13:55:28.405588 9331 leader_election.cc:304] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87; no voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:28.406301 9452 raft_consensus.cc:2749] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.408485 9460 raft_consensus.cc:515] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.409981 9409 tablet_bootstrap.cc:654] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.410415 9460 leader_election.cc:290] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.413017 9331 leader_election.cc:304] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.413985 9452 raft_consensus.cc:2804] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:28.413939 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6210fe45bb654298a404f65b1c766d88" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:28.414163 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6210fe45bb654298a404f65b1c766d88" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.414549 9452 raft_consensus.cc:697] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Becoming Leader. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Running, Role: LEADER
I20260926 13:55:28.414623 9217 raft_consensus.cc:3060] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.415400 9452 consensus_queue.cc:237] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.418576 9365 raft_consensus.cc:2468] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 1.
I20260926 13:55:28.419138 9430 raft_consensus.cc:515] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.418576 9290 raft_consensus.cc:2468] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 1.
I20260926 13:55:28.414728 9367 raft_consensus.cc:3060] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.420982 9430 leader_election.cc:290] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 election: Requested vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.421268 9409 tablet_bootstrap.cc:492] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:28.386639 9218 raft_consensus.cc:2468] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 1.
I20260926 13:55:28.421892 9331 leader_election.cc:304] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:28.422582 9451 raft_consensus.cc:2804] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:28.422796 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802f137e22714b5ea0ee9530e62d2db1" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:28.423034 9451 raft_consensus.cc:697] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Becoming Leader. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Running, Role: LEADER
I20260926 13:55:28.423305 9365 raft_consensus.cc:3060] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.421669 9409 ts_tablet_manager.cc:1403] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.001s
I20260926 13:55:28.424206 9451 consensus_queue.cc:237] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.425168 9257 leader_election.cc:304] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:28.426397 9460 raft_consensus.cc:2804] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:28.426815 9460 raft_consensus.cc:697] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 1 LEADER]: Becoming Leader. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Running, Role: LEADER
I20260926 13:55:28.427541 9460 consensus_queue.cc:237] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.428887 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802f137e22714b5ea0ee9530e62d2db1" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:28.429397 9290 raft_consensus.cc:3060] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.430416 9409 raft_consensus.cc:359] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.431396 9367 raft_consensus.cc:2468] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 1.
I20260926 13:55:28.432035 9217 raft_consensus.cc:2468] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 1.
I20260926 13:55:28.432253 9365 raft_consensus.cc:2468] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 1.
I20260926 13:55:28.432468 9409 raft_consensus.cc:385] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.433555 9409 raft_consensus.cc:740] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.433569 9182 leader_election.cc:304] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87; no voters:
I20260926 13:55:28.433945 9257 leader_election.cc:304] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:28.434414 9430 raft_consensus.cc:2804] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:28.435011 9430 raft_consensus.cc:697] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 1 LEADER]: Becoming Leader. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Running, Role: LEADER
I20260926 13:55:28.434475 9409 consensus_queue.cc:260] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.435670 9414 raft_consensus.cc:2804] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:28.435737 9430 consensus_queue.cc:237] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.436196 9414 raft_consensus.cc:697] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 1 LEADER]: Becoming Leader. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Running, Role: LEADER
I20260926 13:55:28.437093 9414 consensus_queue.cc:237] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.443850 9409 ts_tablet_manager.cc:1434] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.020s user 0.007s sys 0.005s
I20260926 13:55:28.444811 9409 tablet_bootstrap.cc:492] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:28.444859 9115 catalog_manager.cc:5838] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5036bd38367e48199b8de47d7853fc87 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "5036bd38367e48199b8de47d7853fc87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:28.451144 9409 tablet_bootstrap.cc:654] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.463306 9117 catalog_manager.cc:5838] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130). New cstate: current_term: 1 leader_uuid: "963979ac151b4df2afabc1ab6a430b9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:28.468382 9409 tablet_bootstrap.cc:492] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:28.468735 9409 ts_tablet_manager.cc:1403] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.002s
I20260926 13:55:28.470072 9116 catalog_manager.cc:5838] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 31100581adf746139e2a9bf8203b65cf (127.3.127.129). New cstate: current_term: 1 leader_uuid: "31100581adf746139e2a9bf8203b65cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:28.471357 9409 raft_consensus.cc:359] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:28.472007 9409 raft_consensus.cc:385] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.472293 9409 raft_consensus.cc:740] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.473464 9290 raft_consensus.cc:2468] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 1.
I20260926 13:55:28.475808 9409 consensus_queue.cc:260] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:28.479157 9409 ts_tablet_manager.cc:1434] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.010s user 0.002s sys 0.004s
I20260926 13:55:28.480124 9409 tablet_bootstrap.cc:492] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: Bootstrap starting.
I20260926 13:55:28.479517 9115 catalog_manager.cc:5838] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5036bd38367e48199b8de47d7853fc87 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "5036bd38367e48199b8de47d7853fc87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:28.481743 9116 catalog_manager.cc:5838] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130). New cstate: current_term: 1 leader_uuid: "963979ac151b4df2afabc1ab6a430b9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:28.484251 9409 tablet_bootstrap.cc:654] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:28.484228 9430 raft_consensus.cc:493] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.484771 9430 raft_consensus.cc:515] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.487627 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.487136 9430 leader_election.cc:290] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.493661 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.494370 9290 raft_consensus.cc:2393] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.495503 9182 leader_election.cc:304] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:28.496083 9430 raft_consensus.cc:3060] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.497092 9409 tablet_bootstrap.cc:492] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: No bootstrap required, opened a new log
I20260926 13:55:28.497574 9409 ts_tablet_manager.cc:1403] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.004s
I20260926 13:55:28.500288 9409 raft_consensus.cc:359] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.500680 9409 raft_consensus.cc:385] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:28.500916 9409 raft_consensus.cc:740] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31100581adf746139e2a9bf8203b65cf, State: Initialized, Role: FOLLOWER
I20260926 13:55:28.501049 9430 raft_consensus.cc:2749] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.501417 9409 consensus_queue.cc:260] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.503059 9409 ts_tablet_manager.cc:1434] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260926 13:55:28.531518 9414 raft_consensus.cc:493] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.531869 9414 raft_consensus.cc:515] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.533313 9414 leader_election.cc:290] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.533960 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:28.534276 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.534502 9217 raft_consensus.cc:2393] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.535584 9257 leader_election.cc:304] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:28.536150 9414 raft_consensus.cc:3060] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.540066 9414 raft_consensus.cc:2749] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.607923 9430 consensus_queue.cc:1048] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.618304 9467 raft_consensus.cc:493] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.620325 9430 consensus_queue.cc:1048] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.618749 9467 raft_consensus.cc:515] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.623939 9467 leader_election.cc:290] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.626186 9292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.626905 9292 raft_consensus.cc:2393] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf in current term 1: Already voted for candidate 963979ac151b4df2afabc1ab6a430b9b in this term.
I20260926 13:55:28.629658 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.630365 9367 raft_consensus.cc:2393] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.633049 9430 raft_consensus.cc:493] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.633508 9430 raft_consensus.cc:515] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:28.634035 9182 leader_election.cc:304] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:28.635399 9430 leader_election.cc:290] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:28.635593 9467 raft_consensus.cc:3060] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.636060 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.636817 9365 raft_consensus.cc:2393] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.637193 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.637880 9290 raft_consensus.cc:2393] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf in current term 1: Already voted for candidate 963979ac151b4df2afabc1ab6a430b9b in this term.
I20260926 13:55:28.638936 9182 leader_election.cc:304] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:28.639523 9430 raft_consensus.cc:3060] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.642177 9467 raft_consensus.cc:2749] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.644660 9430 raft_consensus.cc:2749] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.644932 9467 raft_consensus.cc:493] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:28.645331 9467 raft_consensus.cc:515] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:28.646737 9467 leader_election.cc:290] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:28.647276 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:28.647578 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:28.647805 9290 raft_consensus.cc:2393] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf in current term 1: Already voted for candidate 5036bd38367e48199b8de47d7853fc87 in this term.
I20260926 13:55:28.648859 9182 leader_election.cc:304] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:28.649381 9467 raft_consensus.cc:3060] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:28.653101 9467 raft_consensus.cc:2749] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:28.660195 9451 consensus_queue.cc:1048] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.669431 9440 consensus_queue.cc:1048] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.719693 9440 consensus_queue.cc:1048] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.729851 9440 consensus_queue.cc:1048] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.812047 9440 consensus_queue.cc:1048] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.821794 9452 consensus_queue.cc:1048] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.834959 9467 consensus_queue.cc:1048] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.844682 9414 consensus_queue.cc:1048] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.846592 9474 consensus_queue.cc:1048] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260926 13:55:28.854058 9414 consensus_queue.cc:1048] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.908138 9414 consensus_queue.cc:1048] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.917747 9444 consensus_queue.cc:1048] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.951545 9452 consensus_queue.cc:1048] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:28.960184 9440 consensus_queue.cc:1048] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:30.077247 9440 raft_consensus.cc:493] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:30.077665 9440 raft_consensus.cc:515] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:30.079187 9440 leader_election.cc:290] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315)
I20260926 13:55:30.079800 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:30.080158 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:30.080411 9290 raft_consensus.cc:2468] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 1.
I20260926 13:55:30.080776 9217 raft_consensus.cc:2468] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 1.
I20260926 13:55:30.081507 9331 leader_election.cc:304] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:30.082098 9440 raft_consensus.cc:2804] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:30.082358 9440 raft_consensus.cc:493] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:30.082643 9440 raft_consensus.cc:3060] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:30.087159 9440 raft_consensus.cc:515] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:30.088521 9440 leader_election.cc:290] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 2 election: Requested vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315)
I20260926 13:55:30.089229 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:30.089674 9290 raft_consensus.cc:3060] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:30.089541 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcba31649db42f58ce04c10758ca297" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:30.090113 9217 raft_consensus.cc:3060] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:30.094358 9290 raft_consensus.cc:2468] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 2.
I20260926 13:55:30.094625 9217 raft_consensus.cc:2468] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 2.
I20260926 13:55:30.095187 9331 leader_election.cc:304] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:30.095757 9440 raft_consensus.cc:2804] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:30.096443 9440 raft_consensus.cc:697] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 2 LEADER]: Becoming Leader. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Running, Role: LEADER
I20260926 13:55:30.097057 9440 consensus_queue.cc:237] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } }
I20260926 13:55:30.103523 9115 catalog_manager.cc:5838] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5036bd38367e48199b8de47d7853fc87 (127.3.127.131). New cstate: current_term: 2 leader_uuid: "5036bd38367e48199b8de47d7853fc87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:30.128476 9444 raft_consensus.cc:493] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:30.128939 9444 raft_consensus.cc:515] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:30.130586 9444 leader_election.cc:290] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:30.131238 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:30.131588 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:30.131749 9217 raft_consensus.cc:2468] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 1.
I20260926 13:55:30.132206 9365 raft_consensus.cc:2468] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 1.
I20260926 13:55:30.132928 9257 leader_election.cc:304] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:30.133550 9444 raft_consensus.cc:2804] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:30.133876 9444 raft_consensus.cc:493] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:30.134140 9444 raft_consensus.cc:3060] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:30.138325 9444 raft_consensus.cc:515] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:30.139856 9444 leader_election.cc:290] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:30.140532 9217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:30.141073 9217 raft_consensus.cc:3060] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:30.141116 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6bc150b80ac43d98ea0998dc4e23d6f" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:30.141661 9367 raft_consensus.cc:3060] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:30.145510 9217 raft_consensus.cc:2468] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 2.
I20260926 13:55:30.145848 9367 raft_consensus.cc:2468] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 2.
I20260926 13:55:30.146371 9257 leader_election.cc:304] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:30.146935 9444 raft_consensus.cc:2804] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:30.147852 9444 raft_consensus.cc:697] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 2 LEADER]: Becoming Leader. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Running, Role: LEADER
I20260926 13:55:30.148496 9444 consensus_queue.cc:237] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:30.154924 9115 catalog_manager.cc:5838] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b reported cstate change: term changed from 0 to 2, leader changed from <none> to 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130). New cstate: current_term: 2 leader_uuid: "963979ac151b4df2afabc1ab6a430b9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: UNKNOWN } } }
W20260926 13:55:30.362512 9502 meta_cache.cc:1261] Time spent looking up entry by key: real 0.057s user 0.003s sys 0.005s
W20260926 13:55:30.362877 9399 meta_cache.cc:1261] Time spent looking up entry by key: real 0.056s user 0.008s sys 0.001s
W20260926 13:55:30.363165 9396 meta_cache.cc:1261] Time spent looking up entry by key: real 0.064s user 0.000s sys 0.008s
W20260926 13:55:30.370635 9500 meta_cache.cc:1261] Time spent looking up entry by key: real 0.061s user 0.004s sys 0.004s
W20260926 13:55:30.371383 9506 meta_cache.cc:1261] Time spent looking up entry by key: real 0.060s user 0.003s sys 0.004s
W20260926 13:55:30.371553 9501 meta_cache.cc:1261] Time spent looking up entry by key: real 0.062s user 0.008s sys 0.003s
W20260926 13:55:30.371245 9398 meta_cache.cc:1261] Time spent looking up entry by key: real 0.062s user 0.004s sys 0.004s
W20260926 13:55:30.371033 9504 meta_cache.cc:1261] Time spent looking up entry by key: real 0.064s user 0.010s sys 0.005s
W20260926 13:55:30.381346 9508 meta_cache.cc:1261] Time spent looking up entry by key: real 0.057s user 0.004s sys 0.000s
I20260926 13:55:30.582438 9217 raft_consensus.cc:1275] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Refusing update from remote peer 5036bd38367e48199b8de47d7853fc87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:30.585479 9367 raft_consensus.cc:1275] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Refusing update from remote peer 963979ac151b4df2afabc1ab6a430b9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:30.596577 9498 consensus_queue.cc:1048] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:30.598198 9440 consensus_queue.cc:1048] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:30.615183 9290 raft_consensus.cc:1275] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Refusing update from remote peer 5036bd38367e48199b8de47d7853fc87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:30.618383 9440 consensus_queue.cc:1048] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:30.646278 9218 raft_consensus.cc:1275] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Refusing update from remote peer 963979ac151b4df2afabc1ab6a430b9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:30.648886 9444 consensus_queue.cc:1048] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260926 13:55:30.710194 9331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:40315, user_credentials={real_user=slave}} blocked reactor thread for 59133us
W20260926 13:55:31.023875 9536 log.cc:927] Time spent T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.050s user 0.000s sys 0.001s
W20260926 13:55:31.039942 9534 log.cc:927] Time spent T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.073s user 0.003s sys 0.000s
W20260926 13:55:31.088081 9535 log.cc:927] Time spent T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.075s user 0.002s sys 0.000s
W20260926 13:55:31.105154 9515 log.cc:927] Time spent T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.103s user 0.012s sys 0.007s
W20260926 13:55:31.184824 9541 log.cc:927] Time spent T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.070s user 0.000s sys 0.001s
W20260926 13:55:31.244951 9540 log.cc:927] Time spent T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.137s user 0.000s sys 0.002s
W20260926 13:55:31.297401 9544 log.cc:927] Time spent T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.167s user 0.002s sys 0.000s
W20260926 13:55:31.324690 9546 log.cc:927] Time spent T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.089s user 0.000s sys 0.001s
W20260926 13:55:31.428602 9331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.130:35495, user_credentials={real_user=slave}} blocked reactor thread for 315443us
W20260926 13:55:31.530177 9493 log.cc:927] Time spent T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.259s user 0.003s sys 0.000s
W20260926 13:55:31.540509 9551 log.cc:927] Time spent T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.155s user 0.001s sys 0.000s
W20260926 13:55:31.619367 9257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.131:39167, user_credentials={real_user=slave}} blocked reactor thread for 170580us
W20260926 13:55:31.652830 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.131:39167, user_credentials={real_user=slave}} blocked reactor thread for 44171.7us
W20260926 13:55:31.665374 9556 log.cc:927] Time spent T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.162s user 0.001s sys 0.001s
W20260926 13:55:31.735611 9562 log.cc:927] Time spent T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260926 13:55:31.760895 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=4, attempt_no=0}) took 1082 ms. Trace:
I20260926 13:55:31.809381 9566 rpcz_store.cc:276] 0926 13:55:30.675993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.676144 (+ 151us) service_pool.cc:224] Handling call
0926 13:55:31.758159 (+1082015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.732435 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:30.746445 (+ 14010us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:30.746478 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:30.746491 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:30.765255 (+ 18764us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:30.765298 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:30.765328 (+ 30us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:30.816378 (+ 51050us) tablet.cc:701] Row locks acquired
0926 13:55:30.816436 (+ 58us) write_op.cc:260] PREPARE: finished
0926 13:55:30.819252 (+ 2816us) write_op.cc:270] Start()
0926 13:55:30.827710 (+ 8458us) write_op.cc:276] Timestamp: P: 1790430930816730 usec, L: 0
0926 13:55:30.829476 (+ 1766us) op_driver.cc:348] REPLICATION: starting
0926 13:55:30.899207 (+ 69731us) log.cc:844] Serialized 821 byte log entry
0926 13:55:31.473783 (+574576us) op_driver.cc:464] REPLICATION: finished
0926 13:55:31.646782 (+172999us) write_op.cc:301] APPLY: starting
0926 13:55:31.649801 (+ 3019us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:31.686684 (+ 36883us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:31.692830 (+ 6146us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:31.729251 (+ 36421us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:31.729512 (+ 261us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:31.729553 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:31.729822 (+ 269us) log.cc:844] Serialized 88 byte log entry
0926 13:55:31.757688 (+ 27866us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:31.757798 (+ 110us) write_op.cc:454] Released schema lock
0926 13:55:31.757842 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":164581,"mutex_wait_us":5247,"num_ops":12,"prepare.queue_time_us":54524,"prepare.run_cpu_time_us":18510,"prepare.run_wall_time_us":209314,"raft.queue_time_us":2756,"raft.run_cpu_time_us":2721,"raft.run_wall_time_us":7109,"replication_time_us":644187,"spinlock_wait_cycles":129816960,"thread_start_us":63878,"threads_started":2,"wal-append.queue_time_us":46328}]]}
W20260926 13:55:32.128033 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.130:35495, user_credentials={real_user=slave}} blocked reactor thread for 76749.7us
W20260926 13:55:32.130292 9515 log.cc:927] Time spent T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
W20260926 13:55:32.136988 9546 log.cc:927] Time spent T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.070s user 0.000s sys 0.001s
W20260926 13:55:32.165369 9573 log.cc:927] Time spent T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.222s user 0.001s sys 0.001s
I20260926 13:55:32.269737 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=1, attempt_no=0}) took 1531 ms. Trace:
I20260926 13:55:32.270332 9554 rpcz_store.cc:276] 0926 13:55:30.747541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.750210 (+ 2669us) service_pool.cc:224] Handling call
0926 13:55:30.805138 (+ 54928us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:32.269532 (+1464394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.918097 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:30.938297 (+ 20200us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:30.939513 (+ 1216us) write_op.cc:435] Acquired schema lock
0926 13:55:30.940262 (+ 749us) tablet.cc:662] Decoding operations
0926 13:55:30.951279 (+ 11017us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:30.952559 (+ 1280us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:30.955973 (+ 3414us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:31.015669 (+ 59696us) tablet.cc:701] Row locks acquired
0926 13:55:31.015689 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:31.019813 (+ 4124us) write_op.cc:270] Start()
0926 13:55:31.025992 (+ 6179us) write_op.cc:276] Timestamp: P: 1790430931019135 usec, L: 0
0926 13:55:31.027066 (+ 1074us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.082520 (+ 55454us) log.cc:844] Serialized 864 byte log entry
0926 13:55:31.787560 (+705040us) op_driver.cc:464] REPLICATION: finished
0926 13:55:31.838281 (+ 50721us) write_op.cc:301] APPLY: starting
0926 13:55:31.840199 (+ 1918us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:31.860395 (+ 20196us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:31.863186 (+ 2791us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.152182 (+288996us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.181853 (+ 29671us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.193011 (+ 11158us) write_op.cc:312] APPLY: finished
0926 13:55:32.226367 (+ 33356us) log.cc:844] Serialized 94 byte log entry
0926 13:55:32.226619 (+ 252us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.269122 (+ 42503us) write_op.cc:454] Released schema lock
0926 13:55:32.269178 (+ 56us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":4719488,"child_traces":[["op",{"apply.queue_time_us":38465,"mutex_wait_us":3757,"num_ops":13,"prepare.queue_time_us":85169,"prepare.run_cpu_time_us":15927,"prepare.run_wall_time_us":200754,"raft.queue_time_us":23702,"raft.run_cpu_time_us":14,"raft.run_wall_time_us":14,"replication_time_us":760335,"thread_start_us":299235,"threads_started":2}]]}
W20260926 13:55:32.402442 9534 log.cc:927] Time spent T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.072s user 0.001s sys 0.000s
I20260926 13:55:32.439358 9571 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=7, attempt_no=0}) took 1512 ms. Trace:
I20260926 13:55:32.439810 9571 rpcz_store.cc:276] 0926 13:55:30.927424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.929086 (+ 1662us) service_pool.cc:224] Handling call
0926 13:55:32.439161 (+1510075us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.079804 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:31.109877 (+ 30073us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.110695 (+ 818us) write_op.cc:435] Acquired schema lock
0926 13:55:31.111551 (+ 856us) tablet.cc:662] Decoding operations
0926 13:55:31.150088 (+ 38537us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.150155 (+ 67us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.150185 (+ 30us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.152023 (+ 1838us) tablet.cc:701] Row locks acquired
0926 13:55:31.152044 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:31.152211 (+ 167us) write_op.cc:270] Start()
0926 13:55:31.152323 (+ 112us) write_op.cc:276] Timestamp: P: 1790430931152173 usec, L: 0
0926 13:55:31.152344 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.153119 (+ 775us) log.cc:844] Serialized 907 byte log entry
0926 13:55:32.319482 (+1166363us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.327337 (+ 7855us) write_op.cc:301] APPLY: starting
0926 13:55:32.327406 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.435650 (+108244us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.435747 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.437723 (+ 1976us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.438085 (+ 362us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.438131 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:32.438429 (+ 298us) log.cc:844] Serialized 100 byte log entry
0926 13:55:32.438629 (+ 200us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.438751 (+ 122us) write_op.cc:454] Released schema lock
0926 13:55:32.438795 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":7670,"mutex_wait_us":17411,"num_ops":14,"prepare.queue_time_us":82794,"prepare.run_cpu_time_us":36305,"prepare.run_wall_time_us":511585,"raft.queue_time_us":165821,"raft.run_cpu_time_us":1235,"raft.run_wall_time_us":51204,"replication_time_us":1166988,"spinlock_wait_cycles":1455872,"thread_start_us":482925,"threads_started":3,"wal-append.queue_time_us":295963}]]}
W20260926 13:55:32.476063 9562 log.cc:927] Time spent T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.063s user 0.000s sys 0.001s
W20260926 13:55:32.475106 9331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:40315, user_credentials={real_user=slave}} blocked reactor thread for 167687us
I20260926 13:55:32.513553 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=19, attempt_no=0}) took 1836 ms. Trace:
I20260926 13:55:32.507781 9578 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=9, attempt_no=0}) took 1576 ms. Trace:
I20260926 13:55:32.540512 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=11, attempt_no=0}) took 1863 ms. Trace:
I20260926 13:55:32.513971 9566 rpcz_store.cc:276] 0926 13:55:30.677502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.678836 (+ 1334us) service_pool.cc:224] Handling call
0926 13:55:32.513475 (+1834639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.039486 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:31.040052 (+ 566us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.040080 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:31.040096 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:31.056599 (+ 16503us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.056648 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.056682 (+ 34us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.122222 (+ 65540us) tablet.cc:701] Row locks acquired
0926 13:55:31.122836 (+ 614us) write_op.cc:260] PREPARE: finished
0926 13:55:31.398497 (+275661us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:31.398656 (+ 159us) write_op.cc:270] Start()
0926 13:55:31.398866 (+ 210us) write_op.cc:276] Timestamp: P: 1790430931398608 usec, L: 0
0926 13:55:31.398891 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.665618 (+266727us) log.cc:844] Serialized 907 byte log entry
0926 13:55:31.752853 (+ 87235us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54002364d4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:32.464670 (+711817us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.475524 (+ 10854us) write_op.cc:301] APPLY: starting
0926 13:55:32.475602 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.478804 (+ 3202us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.478829 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.480740 (+ 1911us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.499199 (+ 18459us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.501042 (+ 1843us) write_op.cc:312] APPLY: finished
0926 13:55:32.512220 (+ 11178us) log.cc:844] Serialized 100 byte log entry
0926 13:55:32.512968 (+ 748us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.513076 (+ 108us) write_op.cc:454] Released schema lock
0926 13:55:32.513125 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5531,"num_ops":14,"prepare.queue_time_us":354657,"prepare.run_cpu_time_us":11133,"prepare.run_wall_time_us":714802,"replication_time_us":1065659,"spinlock_wait_cycles":588329728}]]}
W20260926 13:55:32.580883 9257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.131:39167, user_credentials={real_user=slave}} blocked reactor thread for 59019.4us
I20260926 13:55:32.562386 9557 rpcz_store.cc:276] 0926 13:55:30.676726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.683595 (+ 6869us) service_pool.cc:224] Handling call
0926 13:55:32.540307 (+1856712us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.099770 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:31.101577 (+ 1807us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.101624 (+ 47us) write_op.cc:435] Acquired schema lock
0926 13:55:31.101637 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:31.102314 (+ 677us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.102359 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.102388 (+ 29us) tablet.cc:685] Acquiring locks for 7 operations
0926 13:55:31.122810 (+ 20422us) tablet.cc:701] Row locks acquired
0926 13:55:31.123066 (+ 256us) write_op.cc:260] PREPARE: finished
0926 13:55:31.131860 (+ 8794us) write_op.cc:270] Start()
0926 13:55:31.137261 (+ 5401us) write_op.cc:276] Timestamp: P: 1790430931130775 usec, L: 0
0926 13:55:31.137278 (+ 17us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.412479 (+275201us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54003aa5a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:31.413116 (+ 637us) log.cc:844] Serialized 605 byte log entry
0926 13:55:32.136621 (+723505us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.296622 (+160001us) write_op.cc:301] APPLY: starting
0926 13:55:32.296693 (+ 71us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.296913 (+ 220us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.296944 (+ 31us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.297899 (+ 955us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.298070 (+ 171us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.298115 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:32.298386 (+ 271us) log.cc:844] Serialized 58 byte log entry
0926 13:55:32.298595 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.406660 (+108065us) write_op.cc:454] Released schema lock
0926 13:55:32.410566 (+ 3906us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:32.540169 (+129603us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":158890,"num_ops":7,"prepare.queue_time_us":412777,"prepare.run_cpu_time_us":5733,"prepare.run_wall_time_us":313612,"replication_time_us":991556,"spinlock_wait_cycles":175905792,"thread_start_us":226993,"threads_started":1}]]}
W20260926 13:55:32.721194 9592 log.cc:927] Time spent T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.220s user 0.001s sys 0.000s
I20260926 13:55:32.741252 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=27, attempt_no=0}) took 1843 ms. Trace:
I20260926 13:55:32.754997 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=21, attempt_no=0}) took 1912 ms. Trace:
I20260926 13:55:32.758534 9579 rpcz_store.cc:276] 0926 13:55:30.837625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.837809 (+ 184us) service_pool.cc:224] Handling call
0926 13:55:32.749977 (+1912168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.127416 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:31.181445 (+ 54029us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.181479 (+ 34us) write_op.cc:435] Acquired schema lock
0926 13:55:31.181497 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:31.182360 (+ 863us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.182407 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.182433 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.183226 (+ 793us) tablet.cc:701] Row locks acquired
0926 13:55:31.183246 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:31.183390 (+ 144us) write_op.cc:270] Start()
0926 13:55:31.183502 (+ 112us) write_op.cc:276] Timestamp: P: 1790430931183352 usec, L: 0
0926 13:55:31.183524 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.184087 (+ 563us) log.cc:844] Serialized 821 byte log entry
0926 13:55:32.422587 (+1238500us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.712965 (+290378us) write_op.cc:301] APPLY: starting
0926 13:55:32.713039 (+ 74us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.713270 (+ 231us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.713367 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.715096 (+ 1729us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.715300 (+ 204us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.715342 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:32.715611 (+ 269us) log.cc:844] Serialized 88 byte log entry
0926 13:55:32.724645 (+ 9034us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.724783 (+ 138us) write_op.cc:454] Released schema lock
0926 13:55:32.727568 (+ 2785us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":290199,"num_ops":12,"prepare.queue_time_us":266656,"prepare.run_cpu_time_us":3661,"prepare.run_wall_time_us":67891,"replication_time_us":1228000}]]}
I20260926 13:55:32.773936 9586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=35, attempt_no=0}) took 1963 ms. Trace:
I20260926 13:55:32.755319 9554 rpcz_store.cc:276] 0926 13:55:30.899219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.901115 (+ 1896us) service_pool.cc:224] Handling call
0926 13:55:32.741184 (+1840069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.213310 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:31.235093 (+ 21783us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.235125 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:31.235139 (+ 14us) tablet.cc:662] Decoding operations
0926 13:55:31.242166 (+ 7027us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.242703 (+ 537us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.242731 (+ 28us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:31.243382 (+ 651us) tablet.cc:701] Row locks acquired
0926 13:55:31.243397 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:31.244871 (+ 1474us) write_op.cc:270] Start()
0926 13:55:31.244985 (+ 114us) write_op.cc:276] Timestamp: P: 1790430931244826 usec, L: 0
0926 13:55:31.245006 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.261405 (+ 16399us) log.cc:844] Serialized 778 byte log entry
0926 13:55:31.404322 (+142917us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54001eb254. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:32.422879 (+1018557us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.716315 (+293436us) write_op.cc:301] APPLY: starting
0926 13:55:32.716392 (+ 77us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.716603 (+ 211us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.716625 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.718093 (+ 1468us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.718353 (+ 260us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.718410 (+ 57us) write_op.cc:312] APPLY: finished
0926 13:55:32.718661 (+ 251us) log.cc:844] Serialized 82 byte log entry
0926 13:55:32.733729 (+ 15068us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.740828 (+ 7099us) write_op.cc:454] Released schema lock
0926 13:55:32.740876 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":293293,"num_ops":11,"prepare.queue_time_us":244416,"prepare.run_cpu_time_us":5448,"prepare.run_wall_time_us":202193,"replication_time_us":1177779,"spinlock_wait_cycles":36219648}]]}
I20260926 13:55:32.821471 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=20, attempt_no=0}) took 2103 ms. Trace:
I20260926 13:55:32.514617 9578 rpcz_store.cc:276] 0926 13:55:30.933849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.939905 (+ 6056us) service_pool.cc:224] Handling call
0926 13:55:32.506108 (+1566203us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.982432 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:31.010678 (+ 28246us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.011365 (+ 687us) write_op.cc:435] Acquired schema lock
0926 13:55:31.012153 (+ 788us) tablet.cc:662] Decoding operations
0926 13:55:31.055182 (+ 43029us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.058363 (+ 3181us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.060165 (+ 1802us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.137278 (+ 77113us) tablet.cc:701] Row locks acquired
0926 13:55:31.138316 (+ 1038us) write_op.cc:260] PREPARE: finished
0926 13:55:31.149341 (+ 11025us) write_op.cc:270] Start()
0926 13:55:31.164866 (+ 15525us) write_op.cc:276] Timestamp: P: 1790430931149295 usec, L: 0
0926 13:55:31.167620 (+ 2754us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.219653 (+ 52033us) log.cc:844] Serialized 821 byte log entry
0926 13:55:31.533105 (+313452us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b18002a9040. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb02db6492 00007fdb02db8751 00007fdb02db8709 00007fdb02db8699 00007fdb02db8661 00007fdb02db795d 000000000041fb94 000000000041f9d9 00007fdb02d9981a
0926 13:55:31.990950 (+457845us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.321862 (+330912us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b54000b2628. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0c2c1c21 00007fdb0c2c088c 00007fdb09caa038 00007fdb09caa699 00007fdb09cac92a 00007fdb09cac8b8 00007fdb09cac838 00007fdb09cac7f3 00007fdb09caba0c 00007fdb0bd6fdb6 00007fdb0bd6a568
0926 13:55:32.336960 (+ 15098us) write_op.cc:301] APPLY: starting
0926 13:55:32.337033 (+ 73us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.337296 (+ 263us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.337319 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.339068 (+ 1749us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.339343 (+ 275us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.339394 (+ 51us) write_op.cc:312] APPLY: finished
0926 13:55:32.339692 (+ 298us) log.cc:844] Serialized 88 byte log entry
0926 13:55:32.458737 (+119045us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.471070 (+ 12333us) write_op.cc:454] Released schema lock
0926 13:55:32.475153 (+ 4083us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":14876,"num_ops":12,"prepare.queue_time_us":25956,"prepare.run_cpu_time_us":30426,"prepare.run_wall_time_us":392084,"raft.queue_time_us":1590,"raft.run_cpu_time_us":1196,"raft.run_wall_time_us":8901,"replication_time_us":800614,"spinlock_wait_cycles":26412160,"thread_start_us":127545,"threads_started":2,"wal-append.queue_time_us":131781}]]}
I20260926 13:55:32.775486 9586 rpcz_store.cc:276] 0926 13:55:30.808316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.808609 (+ 293us) service_pool.cc:224] Handling call
0926 13:55:32.771551 (+1962942us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.413534 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:31.413970 (+ 436us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.413994 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:31.414009 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:31.414847 (+ 838us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.414887 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.414913 (+ 26us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.472598 (+ 57685us) tablet.cc:701] Row locks acquired
0926 13:55:31.479644 (+ 7046us) write_op.cc:260] PREPARE: finished
0926 13:55:31.519257 (+ 39613us) write_op.cc:270] Start()
0926 13:55:31.534015 (+ 14758us) write_op.cc:276] Timestamp: P: 1790430931518545 usec, L: 0
0926 13:55:31.535043 (+ 1028us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.633885 (+ 98842us) log.cc:844] Serialized 907 byte log entry
0926 13:55:31.852900 (+219015us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54000a73d4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:32.721762 (+868862us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.754036 (+ 32274us) write_op.cc:301] APPLY: starting
0926 13:55:32.756772 (+ 2736us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.760988 (+ 4216us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.761010 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.764816 (+ 3806us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.765029 (+ 213us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.765070 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:32.765335 (+ 265us) log.cc:844] Serialized 100 byte log entry
0926 13:55:32.771102 (+ 5767us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.771213 (+ 111us) write_op.cc:454] Released schema lock
0926 13:55:32.771273 (+ 60us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2171,"num_ops":14,"prepare.queue_time_us":602355,"prepare.run_cpu_time_us":6436,"prepare.run_wall_time_us":439524,"replication_time_us":1128593,"spinlock_wait_cycles":144468224}]]}
I20260926 13:55:32.917356 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=46, attempt_no=0}) took 1805 ms. Trace:
I20260926 13:55:32.994989 9364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59752 (request call id 31) took 1355 ms. Trace:
W20260926 13:55:32.992756 9331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:40315, user_credentials={real_user=slave}} blocked reactor thread for 214335us
I20260926 13:55:33.008947 9591 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=23, attempt_no=0}) took 1921 ms. Trace:
I20260926 13:55:33.020531 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=13, attempt_no=0}) took 2223 ms. Trace:
I20260926 13:55:32.851529 9557 rpcz_store.cc:276] 0926 13:55:30.696867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.702091 (+ 5224us) service_pool.cc:224] Handling call
0926 13:55:32.778039 (+2075948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.795737 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:31.803261 (+ 7524us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.806478 (+ 3217us) write_op.cc:435] Acquired schema lock
0926 13:55:31.806499 (+ 21us) tablet.cc:662] Decoding operations
0926 13:55:31.899952 (+ 93453us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.903450 (+ 3498us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.931694 (+ 28244us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:31.987620 (+ 55926us) tablet.cc:701] Row locks acquired
0926 13:55:31.990907 (+ 3287us) write_op.cc:260] PREPARE: finished
0926 13:55:32.234071 (+243164us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b2c0004bfa8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:32.234125 (+ 54us) write_op.cc:270] Start()
0926 13:55:32.234330 (+ 205us) write_op.cc:276] Timestamp: P: 1790430932038250 usec, L: 0
0926 13:55:32.234353 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.235015 (+ 662us) log.cc:844] Serialized 692 byte log entry
0926 13:55:32.663312 (+428297us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.719483 (+ 56171us) write_op.cc:301] APPLY: starting
0926 13:55:32.721571 (+ 2088us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.757204 (+ 35633us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.759821 (+ 2617us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.764056 (+ 4235us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.764263 (+ 207us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.764309 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:32.764570 (+ 261us) log.cc:844] Serialized 70 byte log entry
0926 13:55:32.771324 (+ 6754us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.771436 (+ 112us) write_op.cc:454] Released schema lock
0926 13:55:32.771487 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":32255,"mutex_wait_us":218661,"num_ops":9,"prepare.queue_time_us":1070139,"prepare.run_cpu_time_us":5558,"prepare.run_wall_time_us":447207,"replication_time_us":428843,"spinlock_wait_cycles":19183488}]]}
I20260926 13:55:33.050733 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=33, attempt_no=0}) took 2068 ms. Trace:
I20260926 13:55:33.054478 9579 rpcz_store.cc:276] 0926 13:55:30.797114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.797636 (+ 522us) service_pool.cc:224] Handling call
0926 13:55:33.020448 (+2222812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.902159 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:30.934820 (+ 32661us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:30.935429 (+ 609us) write_op.cc:435] Acquired schema lock
0926 13:55:30.936229 (+ 800us) tablet.cc:662] Decoding operations
0926 13:55:30.998169 (+ 61940us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.008398 (+ 10229us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.009129 (+ 731us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.082384 (+ 73255us) tablet.cc:701] Row locks acquired
0926 13:55:31.083174 (+ 790us) write_op.cc:260] PREPARE: finished
0926 13:55:31.093254 (+ 10080us) write_op.cc:270] Start()
0926 13:55:31.095969 (+ 2715us) write_op.cc:276] Timestamp: P: 1790430931089141 usec, L: 0
0926 13:55:31.096742 (+ 773us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.101786 (+ 5044us) log.cc:844] Serialized 821 byte log entry
0926 13:55:31.331559 (+229773us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b540016a1a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:32.714888 (+1383329us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.012381 (+297493us) write_op.cc:301] APPLY: starting
0926 13:55:33.012460 (+ 79us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.012688 (+ 228us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.012710 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.014385 (+ 1675us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.014698 (+ 313us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.014757 (+ 59us) write_op.cc:312] APPLY: finished
0926 13:55:33.015035 (+ 278us) log.cc:844] Serialized 88 byte log entry
0926 13:55:33.019916 (+ 4881us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.020033 (+ 117us) write_op.cc:454] Released schema lock
0926 13:55:33.020078 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":297333,"num_ops":12,"prepare.queue_time_us":74445,"prepare.run_cpu_time_us":20779,"prepare.run_wall_time_us":432098,"replication_time_us":1617097,"spinlock_wait_cycles":11225728,"thread_start_us":81563,"threads_started":2,"wal-append.queue_time_us":78172}]]}
I20260926 13:55:32.946206 9554 rpcz_store.cc:276] 0926 13:55:31.108519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.111994 (+ 3475us) service_pool.cc:224] Handling call
0926 13:55:32.914000 (+1802006us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.408534 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:31.408981 (+ 447us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.409014 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:31.409030 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:31.409850 (+ 820us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.409887 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.409914 (+ 27us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.432090 (+ 22176us) tablet.cc:701] Row locks acquired
0926 13:55:31.432108 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:31.449065 (+ 16957us) write_op.cc:270] Start()
0926 13:55:31.467409 (+ 18344us) write_op.cc:276] Timestamp: P: 1790430931442138 usec, L: 0
0926 13:55:31.467438 (+ 29us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.539280 (+ 71842us) log.cc:844] Serialized 907 byte log entry
0926 13:55:31.655658 (+116378us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b1800170c20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb02db6363 00007fdb02db8751 00007fdb02db8709 00007fdb02db8699 00007fdb02db8661 00007fdb02db795d 000000000041fb94 000000000041f9d9 00007fdb02d9981a
0926 13:55:32.423299 (+767641us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.819473 (+396174us) write_op.cc:301] APPLY: starting
0926 13:55:32.819548 (+ 75us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.819820 (+ 272us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.819841 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.835059 (+ 15218us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.845808 (+ 10749us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.850287 (+ 4479us) write_op.cc:312] APPLY: finished
0926 13:55:32.852004 (+ 1717us) log.cc:844] Serialized 100 byte log entry
0926 13:55:32.858332 (+ 6328us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.888543 (+ 30211us) write_op.cc:454] Released schema lock
0926 13:55:32.892536 (+ 3993us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":396019,"mutex_wait_us":2549,"num_ops":14,"prepare.queue_time_us":176597,"prepare.run_cpu_time_us":4108,"prepare.run_wall_time_us":153999,"raft.queue_time_us":7177,"raft.run_cpu_time_us":35,"raft.run_wall_time_us":36,"replication_time_us":954330,"spinlock_wait_cycles":11025408}]]}
I20260926 13:55:33.068902 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=3, attempt_no=0}) took 2320 ms. Trace:
I20260926 13:55:33.070148 9293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60064 (request call id 44) took 1392 ms. Trace:
I20260926 13:55:33.069381 9579 rpcz_store.cc:276] 0926 13:55:30.748992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.751554 (+ 2562us) service_pool.cc:224] Handling call
0926 13:55:33.068842 (+2317288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.893762 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:30.904605 (+ 10843us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:30.904640 (+ 35us) write_op.cc:435] Acquired schema lock
0926 13:55:30.904658 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:30.934845 (+ 30187us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:30.936273 (+ 1428us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:30.936470 (+ 197us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:30.965254 (+ 28784us) tablet.cc:701] Row locks acquired
0926 13:55:30.965949 (+ 695us) write_op.cc:260] PREPARE: finished
0926 13:55:31.126987 (+161038us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:31.127093 (+ 106us) write_op.cc:270] Start()
0926 13:55:31.127308 (+ 215us) write_op.cc:276] Timestamp: P: 1790430931127051 usec, L: 0
0926 13:55:31.127326 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.179917 (+ 52591us) log.cc:844] Serialized 649 byte log entry
0926 13:55:32.564599 (+1384682us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b5400169a20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb097932ee 00007fdb0979de60 00007fdb0979de08 00007fdb0979dd88 00007fdb0979dd43 00007fdb0979cfcc 00007fdb0bd6fdb6 00007fdb0bd6a568 00007fdb097d9cfb 00007fdb097dc7f0
0926 13:55:32.765028 (+200429us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.063231 (+298203us) write_op.cc:301] APPLY: starting
0926 13:55:33.063299 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.063520 (+ 221us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.063552 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.065086 (+ 1534us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.067348 (+ 2262us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.067403 (+ 55us) write_op.cc:312] APPLY: finished
0926 13:55:33.067635 (+ 232us) log.cc:844] Serialized 64 byte log entry
0926 13:55:33.068384 (+ 749us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.068483 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:33.068522 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":298047,"num_ops":8,"prepare.queue_time_us":69806,"prepare.run_cpu_time_us":53863,"prepare.run_wall_time_us":543238,"raft.queue_time_us":4321,"raft.run_cpu_time_us":1274,"raft.run_wall_time_us":68400,"replication_time_us":1634467,"spinlock_wait_cycles":11684480,"thread_start_us":226889,"threads_started":2,"wal-append.queue_time_us":386705}]]}
I20260926 13:55:33.097074 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=8, attempt_no=0}) took 2347 ms. Trace:
I20260926 13:55:33.097445 9579 rpcz_store.cc:276] 0926 13:55:30.749652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.751495 (+ 1843us) service_pool.cc:224] Handling call
0926 13:55:33.097014 (+2345519us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.918799 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:30.945716 (+ 26917us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:30.945749 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:30.945766 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.011187 (+ 65421us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.012668 (+ 1481us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.014112 (+ 1444us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.029510 (+ 15398us) tablet.cc:701] Row locks acquired
0926 13:55:31.029531 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:31.306197 (+276666us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:31.306314 (+ 117us) write_op.cc:270] Start()
0926 13:55:31.306542 (+ 228us) write_op.cc:276] Timestamp: P: 1790430931306271 usec, L: 0
0926 13:55:31.306567 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.330809 (+ 24242us) log.cc:844] Serialized 907 byte log entry
0926 13:55:32.834762 (+1503953us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.081432 (+246670us) write_op.cc:301] APPLY: starting
0926 13:55:33.081498 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.082929 (+ 1431us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.082956 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.095699 (+ 12743us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.095974 (+ 275us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.096019 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:33.096291 (+ 272us) log.cc:844] Serialized 100 byte log entry
0926 13:55:33.096517 (+ 226us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.096627 (+ 110us) write_op.cc:454] Released schema lock
0926 13:55:33.096674 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":198912,"child_traces":[["op",{"apply.queue_time_us":246498,"mutex_wait_us":15777,"num_ops":14,"prepare.queue_time_us":74826,"prepare.run_cpu_time_us":43084,"prepare.run_wall_time_us":550571,"replication_time_us":1528061,"spinlock_wait_cycles":10039680,"thread_start_us":143167,"threads_started":2,"wal-append.queue_time_us":303826}]]}
I20260926 13:55:33.109742 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=2, attempt_no=0}) took 2361 ms. Trace:
I20260926 13:55:33.110141 9579 rpcz_store.cc:276] 0926 13:55:30.747947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.750185 (+ 2238us) service_pool.cc:224] Handling call
0926 13:55:33.109677 (+2359492us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.838862 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:30.860162 (+ 21300us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:30.860194 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:30.860212 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:30.939401 (+ 79189us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:30.940659 (+ 1258us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:30.941226 (+ 567us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:30.976428 (+ 35202us) tablet.cc:701] Row locks acquired
0926 13:55:30.976447 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:30.976601 (+ 154us) write_op.cc:270] Start()
0926 13:55:30.976695 (+ 94us) write_op.cc:276] Timestamp: P: 1790430930976564 usec, L: 0
0926 13:55:30.976712 (+ 17us) op_driver.cc:348] REPLICATION: starting
0926 13:55:30.990972 (+ 14260us) log.cc:844] Serialized 864 byte log entry
0926 13:55:31.590242 (+599270us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b58002339d0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb0977796c 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5 00007fdb02db8751
0926 13:55:32.936687 (+1346445us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.106313 (+169626us) write_op.cc:301] APPLY: starting
0926 13:55:33.106379 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.106638 (+ 259us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.106658 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.108407 (+ 1749us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.108674 (+ 267us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.108722 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:33.109028 (+ 306us) log.cc:844] Serialized 94 byte log entry
0926 13:55:33.109225 (+ 197us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.109338 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:33.109379 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":11520,"child_traces":[["op",{"apply.queue_time_us":168596,"mutex_wait_us":5170,"num_ops":13,"prepare.queue_time_us":4450,"prepare.run_cpu_time_us":40978,"prepare.run_wall_time_us":542442,"raft.queue_time_us":30935,"raft.run_cpu_time_us":6388,"raft.run_wall_time_us":241221,"replication_time_us":1936600,"spinlock_wait_cycles":47264128,"thread_start_us":276472,"threads_started":2,"wal-append.queue_time_us":50670}]]}
I20260926 13:55:32.995378 9364 rpcz_store.cc:276] 0926 13:55:31.639510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.639743 (+ 233us) service_pool.cc:224] Handling call
0926 13:55:31.787597 (+147854us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b580004d198. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7ea02 00007fdb0bcf9119 00007fdb0b812a70 00007fdb0b8db6db 00007fdb0b8db761 00007fdb0b89d570 00007fdb0b887b69 00007fdb0b887612 00007fdb092c5d34
0926 13:55:31.789192 (+ 1595us) raft_consensus.cc:1471] Updating replica for 3 ops
0926 13:55:31.809416 (+ 20224us) raft_consensus.cc:1534] Early marking committed up to index 2
0926 13:55:31.837233 (+ 27817us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0926 13:55:31.858797 (+ 21564us) write_op.cc:270] Start()
0926 13:55:31.863736 (+ 4939us) write_op.cc:276] Timestamp: P: 1790430931065575 usec, L: 0
0926 13:55:32.307645 (+443909us) write_op.cc:270] Start()
0926 13:55:32.320138 (+ 12493us) write_op.cc:276] Timestamp: P: 1790430931302289 usec, L: 0
0926 13:55:32.320892 (+ 754us) write_op.cc:270] Start()
0926 13:55:32.320989 (+ 97us) write_op.cc:276] Timestamp: P: 1790430931382212 usec, L: 0
0926 13:55:32.383543 (+ 62554us) log.cc:844] Serialized 2592 byte log entry
0926 13:55:32.383701 (+ 158us) raft_consensus.cc:1645] Marking committed up to 2
0926 13:55:32.383738 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0926 13:55:32.383813 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0926 13:55:32.992528 (+608715us) raft_consensus.cc:1685] finished
0926 13:55:32.994621 (+ 2093us) raft_consensus.cc:1691] UpdateReplicas() finished
0926 13:55:32.994814 (+ 193us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.296293 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:32.296769 (+ 476us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.296798 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:32.296815 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:32.297564 (+ 749us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.297623 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.297653 (+ 30us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:32.298378 (+ 725us) tablet.cc:701] Row locks acquired
0926 13:55:32.298395 (+ 17us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:32.320660 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:32.321187 (+ 527us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.321215 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:32.321227 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:32.322035 (+ 808us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.322094 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.322122 (+ 28us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:32.322884 (+ 762us) tablet.cc:701] Row locks acquired
0926 13:55:32.322911 (+ 27us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:32.325274 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:32.326074 (+ 800us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.326098 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:32.326110 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:32.326881 (+ 771us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.326937 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.326968 (+ 31us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:32.445366 (+118398us) tablet.cc:701] Row locks acquired
0926 13:55:32.453919 (+ 8553us) write_op.cc:260] PREPARE: finished
Metrics: {"spinlock_wait_cycles":2916224,"child_traces":[["op",{"num_ops":12,"partition_lock_wait_us":11,"prepare.queue_time_us":6387,"prepare.run_cpu_time_us":2361,"prepare.run_wall_time_us":2360}],["op",{"num_ops":12,"partition_lock_wait_us":14,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2524,"prepare.run_wall_time_us":2526,"spinlock_wait_cycles":1792}],["op",{"mutex_wait_us":1532,"num_ops":15,"partition_lock_wait_us":14,"prepare.queue_time_us":1990,"prepare.run_cpu_time_us":4124,"prepare.run_wall_time_us":147366}]]}
I20260926 13:55:33.162792 9571 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=37, attempt_no=0}) took 2173 ms. Trace:
I20260926 13:55:33.163674 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=53, attempt_no=0}) took 2043 ms. Trace:
I20260926 13:55:33.174165 9563 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:33.174913 9563 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:33.184027 9600 log.cc:927] Time spent T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260926 13:55:33.195662 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=49, attempt_no=0}) took 1674 ms. Trace:
I20260926 13:55:33.166208 9571 rpcz_store.cc:276] 0926 13:55:30.989234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.989901 (+ 667us) service_pool.cc:224] Handling call
0926 13:55:33.162699 (+2172798us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.587414 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:31.637683 (+ 50269us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.638484 (+ 801us) write_op.cc:435] Acquired schema lock
0926 13:55:31.640062 (+ 1578us) tablet.cc:662] Decoding operations
0926 13:55:31.662003 (+ 21941us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.662046 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.662073 (+ 27us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.662764 (+ 691us) tablet.cc:701] Row locks acquired
0926 13:55:31.662782 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:31.662917 (+ 135us) write_op.cc:270] Start()
0926 13:55:31.663007 (+ 90us) write_op.cc:276] Timestamp: P: 1790430931662886 usec, L: 0
0926 13:55:31.663028 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.667752 (+ 4724us) log.cc:844] Serialized 907 byte log entry
0926 13:55:32.939644 (+1271892us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.158299 (+218655us) write_op.cc:301] APPLY: starting
0926 13:55:33.158367 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.158609 (+ 242us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.158703 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.161549 (+ 2846us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.161760 (+ 211us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.161801 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:33.162082 (+ 281us) log.cc:844] Serialized 100 byte log entry
0926 13:55:33.162259 (+ 177us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.162372 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:33.162420 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":218496,"mutex_wait_us":100859,"num_ops":14,"prepare.queue_time_us":558226,"prepare.run_cpu_time_us":3937,"prepare.run_wall_time_us":89216,"replication_time_us":1276511}]]}
I20260926 13:55:33.061646 9584 rpcz_store.cc:276] 0926 13:55:30.948427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.951149 (+ 2722us) service_pool.cc:224] Handling call
0926 13:55:33.009267 (+2058118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.404597 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:31.405687 (+ 1090us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.405713 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:31.405730 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.406386 (+ 656us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.406432 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.406459 (+ 27us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:31.407366 (+ 907us) tablet.cc:701] Row locks acquired
0926 13:55:31.407387 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:31.407537 (+ 150us) write_op.cc:270] Start()
0926 13:55:31.407627 (+ 90us) write_op.cc:276] Timestamp: P: 1790430931407498 usec, L: 0
0926 13:55:31.407647 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.408185 (+ 538us) log.cc:844] Serialized 649 byte log entry
0926 13:55:32.423100 (+1014915us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.725546 (+302446us) write_op.cc:301] APPLY: starting
0926 13:55:32.918891 (+193345us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b60000c25c8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09bdd1a1 00007fdb09d4d8eb 00007fdb09d4ff14 00007fdb09cc08eb 00007fdb09bbda93 00007fdb09bbfdc8 00007fdb09cbf044 00007fdb09caab8c 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9
0926 13:55:32.918969 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.919207 (+ 238us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.919229 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.920314 (+ 1085us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.920503 (+ 189us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.920546 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:32.937114 (+ 16568us) log.cc:844] Serialized 64 byte log entry
0926 13:55:32.988989 (+ 51875us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.991554 (+ 2565us) write_op.cc:454] Released schema lock
0926 13:55:32.992696 (+ 1142us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":298823,"num_ops":8,"prepare.queue_time_us":385137,"prepare.run_cpu_time_us":2804,"prepare.run_wall_time_us":3788,"replication_time_us":1015365,"spinlock_wait_cycles":3058560}]]}
I20260926 13:55:33.055162 9591 rpcz_store.cc:276] 0926 13:55:30.976656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.982669 (+ 6013us) service_pool.cc:224] Handling call
0926 13:55:32.895379 (+1912710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.387077 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:31.409459 (+ 22382us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.409485 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:31.409502 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.410254 (+ 752us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.410298 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.410323 (+ 25us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.419127 (+ 8804us) tablet.cc:701] Row locks acquired
0926 13:55:31.419145 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:31.433077 (+ 13932us) write_op.cc:270] Start()
0926 13:55:31.442328 (+ 9251us) write_op.cc:276] Timestamp: P: 1790430931432558 usec, L: 0
0926 13:55:31.448849 (+ 6521us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.520735 (+ 71886us) log.cc:844] Serialized 821 byte log entry
0926 13:55:32.355658 (+834923us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.465245 (+109587us) write_op.cc:301] APPLY: starting
0926 13:55:32.473823 (+ 8578us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.501950 (+ 28127us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.520792 (+ 18842us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:32.582473 (+ 61681us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:32.582701 (+ 228us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:32.582747 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:32.583072 (+ 325us) log.cc:844] Serialized 88 byte log entry
0926 13:55:32.885867 (+302795us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:32.889955 (+ 4088us) write_op.cc:454] Released schema lock
0926 13:55:32.890002 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64892,"num_ops":12,"prepare.queue_time_us":393083,"prepare.run_cpu_time_us":3975,"prepare.run_wall_time_us":149987,"replication_time_us":906691,"thread_start_us":5045,"threads_started":1}]]}
W20260926 13:55:33.231107 9606 log.cc:927] Time spent T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.051s user 0.000s sys 0.001s
I20260926 13:55:33.225219 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=26, attempt_no=0}) took 2484 ms. Trace:
I20260926 13:55:33.074978 9293 rpcz_store.cc:276] 0926 13:55:31.674221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.722371 (+ 48150us) service_pool.cc:224] Handling call
0926 13:55:31.809361 (+ 86990us) raft_consensus.cc:1471] Updating replica for 1 ops
0926 13:55:31.845773 (+ 36412us) raft_consensus.cc:1534] Early marking committed up to index 0
0926 13:55:31.849575 (+ 3802us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0926 13:55:31.852937 (+ 3362us) write_op.cc:270] Start()
0926 13:55:31.853061 (+ 124us) write_op.cc:276] Timestamp: P: 1790430931089141 usec, L: 0
0926 13:55:32.520182 (+667121us) log.cc:844] Serialized 821 byte log entry
0926 13:55:32.712596 (+192414us) raft_consensus.cc:1645] Marking committed up to 1
0926 13:55:32.712633 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0926 13:55:32.712707 (+ 74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0926 13:55:33.059389 (+346682us) raft_consensus.cc:1685] finished
0926 13:55:33.061182 (+ 1793us) raft_consensus.cc:1691] UpdateReplicas() finished
0926 13:55:33.066330 (+ 5148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.940938 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:31.941433 (+ 495us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.941458 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:31.941474 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:31.942243 (+ 769us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.942307 (+ 64us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.942336 (+ 29us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.944078 (+ 1742us) tablet.cc:701] Row locks acquired
0926 13:55:31.944098 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:32.518553 (+574455us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b1800226240. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb093c46ac 00007fdb02d9946b 00007fdb0bc4d0f9 00007fdb02db560b 00007fdb02db390b 00007fdb02db3435 00007fdb09ca837c 00007fdb09c6af6e 00007fdb09814440
Metrics: {"thread_start_us":190302,"threads_started":1,"wal-append.queue_time_us":518808,"child_traces":[["op",{"mutex_wait_us":175398,"num_ops":12,"partition_lock_wait_us":12,"prepare.queue_time_us":83227,"prepare.run_cpu_time_us":2496,"prepare.run_wall_time_us":3401,"spinlock_wait_cycles":19645824,"thread_start_us":364193,"threads_started":1}]]}
I20260926 13:55:33.259815 9578 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=36, attempt_no=0}) took 2271 ms. Trace:
I20260926 13:55:33.204160 9583 rpcz_store.cc:276] 0926 13:55:31.472055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.472163 (+ 108us) service_pool.cc:224] Handling call
0926 13:55:33.146074 (+1673911us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.575733 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:31.621914 (+ 46181us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.629625 (+ 7711us) write_op.cc:435] Acquired schema lock
0926 13:55:31.629924 (+ 299us) tablet.cc:662] Decoding operations
0926 13:55:31.639918 (+ 9994us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.641285 (+ 1367us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.641332 (+ 47us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.645189 (+ 3857us) tablet.cc:701] Row locks acquired
0926 13:55:31.645208 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:31.650418 (+ 5210us) write_op.cc:270] Start()
0926 13:55:31.652199 (+ 1781us) write_op.cc:276] Timestamp: P: 1790430931650064 usec, L: 0
0926 13:55:31.652224 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.693580 (+ 41356us) log.cc:844] Serialized 907 byte log entry
0926 13:55:32.423492 (+729912us) op_driver.cc:464] REPLICATION: finished
0926 13:55:32.895684 (+472192us) write_op.cc:301] APPLY: starting
0926 13:55:32.896383 (+ 699us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:32.981091 (+ 84708us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:32.984893 (+ 3802us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.082272 (+ 97379us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.138608 (+ 56336us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.145162 (+ 6554us) write_op.cc:312] APPLY: finished
0926 13:55:33.145449 (+ 287us) log.cc:844] Serialized 100 byte log entry
0926 13:55:33.145618 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.145733 (+ 115us) write_op.cc:454] Released schema lock
0926 13:55:33.145786 (+ 53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":470584,"mutex_wait_us":8335,"num_ops":14,"prepare.queue_time_us":96033,"prepare.run_cpu_time_us":4523,"prepare.run_wall_time_us":150084,"replication_time_us":768176,"spinlock_wait_cycles":566528}]]}
I20260926 13:55:33.263738 9599 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:33.242053 9603 raft_consensus.cc:493] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:33.264163 9599 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:33.285542 9563 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:33.324595 9599 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:33.173547 9566 rpcz_store.cc:276] 0926 13:55:31.125108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.128207 (+ 3099us) service_pool.cc:224] Handling call
0926 13:55:31.248864 (+120657us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:33.163615 (+1914751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.901489 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:32.901959 (+ 470us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.901986 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:32.902001 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:32.902713 (+ 712us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.908108 (+ 5395us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.908915 (+ 807us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:32.909481 (+ 566us) tablet.cc:701] Row locks acquired
0926 13:55:32.909500 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:32.909643 (+ 143us) write_op.cc:270] Start()
0926 13:55:32.909740 (+ 97us) write_op.cc:276] Timestamp: P: 1790430932909604 usec, L: 0
0926 13:55:32.909756 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.911045 (+ 1289us) log.cc:844] Serialized 735 byte log entry
0926 13:55:33.154271 (+243226us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.160867 (+ 6596us) write_op.cc:301] APPLY: starting
0926 13:55:33.160944 (+ 77us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.161146 (+ 202us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.161242 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.162582 (+ 1340us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.162777 (+ 195us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.162820 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:33.163043 (+ 223us) log.cc:844] Serialized 76 byte log entry
0926 13:55:33.163184 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.163273 (+ 89us) write_op.cc:454] Released schema lock
0926 13:55:33.163313 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":7656832,"child_traces":[["op",{"apply.queue_time_us":4102,"num_ops":10,"prepare.queue_time_us":1651435,"prepare.run_cpu_time_us":2915,"prepare.run_wall_time_us":10830,"replication_time_us":244422}]]}
I20260926 13:55:33.327723 9599 raft_consensus.cc:493] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:33.275059 9603 raft_consensus.cc:515] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:33.279191 9291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
W20260926 13:55:33.387009 9600 log.cc:927] Time spent T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: Append to log took a long time: real 0.059s user 0.000s sys 0.001s
I20260926 13:55:33.385495 9291 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 1.
I20260926 13:55:33.417220 9607 raft_consensus.cc:493] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:33.263237 9578 rpcz_store.cc:276] 0926 13:55:30.988801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.988977 (+ 176us) service_pool.cc:224] Handling call
0926 13:55:33.259723 (+2270746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.789645 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:31.826300 (+ 36655us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.828559 (+ 2259us) write_op.cc:435] Acquired schema lock
0926 13:55:31.828576 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.829331 (+ 755us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.829375 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.829401 (+ 26us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:31.830031 (+ 630us) tablet.cc:701] Row locks acquired
0926 13:55:31.830047 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:31.830209 (+ 162us) write_op.cc:270] Start()
0926 13:55:31.830324 (+ 115us) write_op.cc:276] Timestamp: P: 1790430931830168 usec, L: 0
0926 13:55:31.830340 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.868064 (+ 37724us) log.cc:844] Serialized 778 byte log entry
0926 13:55:33.008120 (+1140056us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.162335 (+154215us) write_op.cc:301] APPLY: starting
0926 13:55:33.162402 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.162622 (+ 220us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.162705 (+ 83us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.184832 (+ 22127us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.230434 (+ 45602us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.237454 (+ 7020us) write_op.cc:312] APPLY: finished
0926 13:55:33.250806 (+ 13352us) log.cc:844] Serialized 82 byte log entry
0926 13:55:33.258325 (+ 7519us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.258425 (+ 100us) write_op.cc:454] Released schema lock
0926 13:55:33.259145 (+ 720us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":153239,"mutex_wait_us":10557,"num_ops":11,"prepare.queue_time_us":715984,"prepare.run_cpu_time_us":9361,"prepare.run_wall_time_us":131439,"replication_time_us":1175585,"spinlock_wait_cycles":605056}]]}
I20260926 13:55:33.386838 9599 raft_consensus.cc:515] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:33.436072 9574 log.cc:927] Time spent T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.081s user 0.001s sys 0.001s
I20260926 13:55:33.417747 9607 raft_consensus.cc:515] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:33.433039 9213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:33.447983 9608 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=14, attempt_no=0}) took 2766 ms. Trace:
I20260926 13:55:33.460602 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:33.471349 9603 leader_election.cc:290] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:33.243486 9557 rpcz_store.cc:276] 0926 13:55:30.740894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.741340 (+ 446us) service_pool.cc:224] Handling call
0926 13:55:33.221608 (+2480268us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.476251 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:32.509958 (+ 33707us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.510963 (+ 1005us) write_op.cc:435] Acquired schema lock
0926 13:55:32.510978 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:32.756104 (+245126us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.757544 (+ 1440us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.760130 (+ 2586us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:32.891143 (+131013us) tablet.cc:701] Row locks acquired
0926 13:55:32.891161 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:32.891315 (+ 154us) write_op.cc:270] Start()
0926 13:55:32.891418 (+ 103us) write_op.cc:276] Timestamp: P: 1790430932891277 usec, L: 0
0926 13:55:32.891438 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.893802 (+ 2364us) log.cc:844] Serialized 907 byte log entry
0926 13:55:32.909037 (+ 15235us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b58001c67d0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb0977796c 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5 00007fdb02db8751
0926 13:55:33.153984 (+244947us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.156332 (+ 2348us) write_op.cc:301] APPLY: starting
0926 13:55:33.156404 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.156645 (+ 241us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.156665 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.158469 (+ 1804us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.158666 (+ 197us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.158710 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:33.158999 (+ 289us) log.cc:844] Serialized 100 byte log entry
0926 13:55:33.180074 (+ 21075us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.186447 (+ 6373us) write_op.cc:454] Released schema lock
0926 13:55:33.188616 (+ 2169us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":290,"mutex_wait_us":46498,"num_ops":14,"prepare.queue_time_us":1714875,"prepare.run_cpu_time_us":13979,"prepare.run_wall_time_us":432487,"raft.queue_time_us":1651,"raft.run_cpu_time_us":2567,"raft.run_wall_time_us":15042,"replication_time_us":259070,"spinlock_wait_cycles":16990720}]]}
I20260926 13:55:33.486491 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:33.487340 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:33.480798 9591 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=50, attempt_no=0}) took 2244 ms. Trace:
I20260926 13:55:33.509593 9607 leader_election.cc:290] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:33.502496 9182 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 963979ac151b4df2afabc1ab6a430b9b; no voters:
I20260926 13:55:33.502615 9215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59484 (request call id 36) took 1512 ms. Trace:
I20260926 13:55:33.519111 9599 leader_election.cc:290] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:33.528654 9570 raft_consensus.cc:493] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:33.541146 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c4eb5b0abcd4df983923718c800b998" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:33.543663 9570 raft_consensus.cc:515] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:33.551841 9586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=31, attempt_no=0}) took 2744 ms. Trace:
I20260926 13:55:33.552271 9586 rpcz_store.cc:276] 0926 13:55:30.807710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.819822 (+ 12112us) service_pool.cc:224] Handling call
0926 13:55:33.551783 (+2731961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.928511 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:31.944715 (+ 16204us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.944762 (+ 47us) write_op.cc:435] Acquired schema lock
0926 13:55:31.944779 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.945513 (+ 734us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.945554 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.945580 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.970529 (+ 24949us) tablet.cc:701] Row locks acquired
0926 13:55:31.970550 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:31.971772 (+ 1222us) write_op.cc:270] Start()
0926 13:55:32.289802 (+318030us) write_op.cc:276] Timestamp: P: 1790430931971731 usec, L: 0
0926 13:55:32.295354 (+ 5552us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.389029 (+ 93675us) log.cc:844] Serialized 821 byte log entry
0926 13:55:32.423834 (+ 34805us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b54000a73d4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:33.207087 (+783253us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.542097 (+335010us) write_op.cc:301] APPLY: starting
0926 13:55:33.542163 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.542401 (+ 238us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.542422 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.550719 (+ 8297us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.550915 (+ 196us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.550958 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:33.551205 (+ 247us) log.cc:844] Serialized 88 byte log entry
0926 13:55:33.551375 (+ 170us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.551489 (+ 114us) write_op.cc:454] Released schema lock
0926 13:55:33.551535 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":334841,"mutex_wait_us":40901,"num_ops":12,"prepare.queue_time_us":980575,"prepare.run_cpu_time_us":57498,"prepare.run_wall_time_us":543966,"replication_time_us":908218,"spinlock_wait_cycles":185385856}]]}
I20260926 13:55:33.533890 9578 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=12, attempt_no=0}) took 2588 ms. Trace:
W20260926 13:55:33.555410 9182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.127.130:35495, user_credentials={real_user=slave}} blocked reactor thread for 53907.4us
I20260926 13:55:33.563993 9367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:33.513324 9215 rpcz_store.cc:276] 0926 13:55:31.989823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.989986 (+ 163us) service_pool.cc:224] Handling call
0926 13:55:32.007848 (+ 17862us) raft_consensus.cc:1471] Updating replica for 7 ops
0926 13:55:32.008609 (+ 761us) raft_consensus.cc:1534] Early marking committed up to index 2
0926 13:55:32.009010 (+ 401us) raft_consensus.cc:1539] Triggering prepare for 7 ops
0926 13:55:32.474177 (+465167us) write_op.cc:270] Start()
0926 13:55:32.477407 (+ 3230us) write_op.cc:276] Timestamp: P: 1790430931065575 usec, L: 0
0926 13:55:32.507795 (+ 30388us) write_op.cc:270] Start()
0926 13:55:32.515736 (+ 7941us) write_op.cc:276] Timestamp: P: 1790430931302289 usec, L: 0
0926 13:55:32.587779 (+ 72043us) write_op.cc:270] Start()
0926 13:55:32.720241 (+132462us) write_op.cc:276] Timestamp: P: 1790430931382212 usec, L: 0
0926 13:55:32.776384 (+ 56143us) write_op.cc:270] Start()
0926 13:55:32.790036 (+ 13652us) write_op.cc:276] Timestamp: P: 1790430931475550 usec, L: 0
0926 13:55:33.017630 (+227594us) write_op.cc:270] Start()
0926 13:55:33.017752 (+ 122us) write_op.cc:276] Timestamp: P: 1790430931626514 usec, L: 0
0926 13:55:33.164923 (+147171us) write_op.cc:270] Start()
0926 13:55:33.165034 (+ 111us) write_op.cc:276] Timestamp: P: 1790430931652721 usec, L: 0
0926 13:55:33.209437 (+ 44403us) write_op.cc:270] Start()
0926 13:55:33.224464 (+ 15027us) write_op.cc:276] Timestamp: P: 1790430931720820 usec, L: 0
0926 13:55:33.325009 (+100545us) log.cc:844] Serialized 5402 byte log entry
0926 13:55:33.325191 (+ 182us) raft_consensus.cc:1645] Marking committed up to 2
0926 13:55:33.325228 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0926 13:55:33.328121 (+ 2893us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0926 13:55:33.488983 (+160862us) raft_consensus.cc:1685] finished
0926 13:55:33.489575 (+ 592us) raft_consensus.cc:1691] UpdateReplicas() finished
0926 13:55:33.499492 (+ 9917us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.495336 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:32.504726 (+ 9390us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.504794 (+ 68us) write_op.cc:435] Acquired schema lock
0926 13:55:32.504811 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:32.505338 (+ 527us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.505387 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.505404 (+ 17us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:32.509115 (+ 3711us) tablet.cc:701] Row locks acquired
0926 13:55:32.509134 (+ 19us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:32.565471 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:32.591716 (+ 26245us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.591745 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:32.594418 (+ 2673us) tablet.cc:662] Decoding operations
0926 13:55:32.595620 (+ 1202us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.595687 (+ 67us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.595716 (+ 29us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:32.670364 (+ 74648us) tablet.cc:701] Row locks acquired
0926 13:55:32.670381 (+ 17us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:33.006654 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:33.066331 (+ 59677us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.079363 (+ 13032us) write_op.cc:435] Acquired schema lock
0926 13:55:33.082384 (+ 3021us) tablet.cc:662] Decoding operations
0926 13:55:33.194621 (+112237us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.197748 (+ 3127us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.197782 (+ 34us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:33.198690 (+ 908us) tablet.cc:701] Row locks acquired
0926 13:55:33.198706 (+ 16us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:33.199130 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:33.199605 (+ 475us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.199632 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:33.199653 (+ 21us) tablet.cc:662] Decoding operations
0926 13:55:33.200354 (+ 701us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.200410 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.200450 (+ 40us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:33.240312 (+ 39862us) tablet.cc:701] Row locks acquired
0926 13:55:33.240324 (+ 12us) write_op.cc:260] PREPARE: finished
0926 13:55:33.417783 (+177459us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6a72 00007fdb09ca9bc5 00007fdb09ca9381 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94
Related trace 'op':
0926 13:55:33.418044 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:33.451588 (+ 33544us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.454085 (+ 2497us) write_op.cc:435] Acquired schema lock
0926 13:55:33.454104 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:33.540083 (+ 85979us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.543555 (+ 3472us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.545208 (+ 1653us) tablet.cc:685] Acquiring locks for 11 operations
Related trace 'op':
Related trace 'op':
Metrics: {"child_traces":[["op",{"num_ops":12,"partition_lock_wait_us":11,"prepare.queue_time_us":2707,"prepare.run_cpu_time_us":2323,"prepare.run_wall_time_us":14878}],["op",{"num_ops":12,"partition_lock_wait_us":13,"prepare.queue_time_us":15752,"prepare.run_cpu_time_us":2989,"prepare.run_wall_time_us":109546}],["op",{"num_ops":15,"partition_lock_wait_us":1308,"prepare.queue_time_us":13073,"prepare.run_cpu_time_us":3457,"prepare.run_wall_time_us":194295}],["op",{"mutex_wait_us":179973,"num_ops":11,"partition_lock_wait_us":10,"prepare.queue_time_us":368286,"prepare.run_cpu_time_us":17682,"prepare.run_wall_time_us":218772,"spinlock_wait_cycles":5639040}],["op",{"num_ops":11,"partition_lock_wait_us":3024,"prepare.queue_time_us":399970}],["op",{"mutex_wait_us":7099}],["op",{}]]}
I20260926 13:55:33.684439 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=22, attempt_no=0}) took 2845 ms. Trace:
I20260926 13:55:33.692375 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=16, attempt_no=0}) took 2856 ms. Trace:
I20260926 13:55:33.692830 9584 rpcz_store.cc:276] 0926 13:55:30.835959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.836100 (+ 141us) service_pool.cc:224] Handling call
0926 13:55:33.692315 (+2856215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.534732 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:31.543087 (+ 8355us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.543120 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:31.543140 (+ 20us) tablet.cc:662] Decoding operations
0926 13:55:31.544023 (+ 883us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.544069 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.544100 (+ 31us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.546036 (+ 1936us) tablet.cc:701] Row locks acquired
0926 13:55:31.546055 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:31.546196 (+ 141us) write_op.cc:270] Start()
0926 13:55:31.546293 (+ 97us) write_op.cc:276] Timestamp: P: 1790430931546164 usec, L: 0
0926 13:55:31.546312 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.546849 (+ 537us) log.cc:844] Serialized 907 byte log entry
0926 13:55:33.280105 (+1733256us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.555527 (+275422us) write_op.cc:301] APPLY: starting
0926 13:55:33.557539 (+ 2012us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.675790 (+118251us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.689313 (+ 13523us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.691134 (+ 1821us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.691352 (+ 218us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.691406 (+ 54us) write_op.cc:312] APPLY: finished
0926 13:55:33.691668 (+ 262us) log.cc:844] Serialized 100 byte log entry
0926 13:55:33.691855 (+ 187us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.691976 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:33.692022 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":268515,"num_ops":14,"prepare.queue_time_us":659928,"prepare.run_cpu_time_us":8060,"prepare.run_wall_time_us":22448,"replication_time_us":1732954}]]}
I20260926 13:55:33.691931 9554 rpcz_store.cc:276] 0926 13:55:30.841062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.841254 (+ 192us) service_pool.cc:224] Handling call
0926 13:55:33.684362 (+2843108us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.573685 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:31.618782 (+ 45097us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.621266 (+ 2484us) write_op.cc:435] Acquired schema lock
0926 13:55:31.621949 (+ 683us) tablet.cc:662] Decoding operations
0926 13:55:31.668310 (+ 46361us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.671198 (+ 2888us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.674885 (+ 3687us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:31.761628 (+ 86743us) tablet.cc:701] Row locks acquired
0926 13:55:31.761649 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:31.761812 (+ 163us) write_op.cc:270] Start()
0926 13:55:31.761924 (+ 112us) write_op.cc:276] Timestamp: P: 1790430931761767 usec, L: 0
0926 13:55:31.761945 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.767143 (+ 5198us) log.cc:844] Serialized 735 byte log entry
0926 13:55:33.280367 (+1513224us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.681477 (+401110us) write_op.cc:301] APPLY: starting
0926 13:55:33.681541 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.681763 (+ 222us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.681857 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.683272 (+ 1415us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.683486 (+ 214us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.683530 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:33.683783 (+ 253us) log.cc:844] Serialized 76 byte log entry
0926 13:55:33.683939 (+ 156us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.684035 (+ 96us) write_op.cc:454] Released schema lock
0926 13:55:33.684079 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":1002752,"child_traces":[["op",{"apply.queue_time_us":393514,"num_ops":10,"prepare.queue_time_us":697145,"prepare.run_cpu_time_us":4216,"prepare.run_wall_time_us":198009,"replication_time_us":1518335}]]}
I20260926 13:55:33.702801 9615 raft_consensus.cc:493] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963979ac151b4df2afabc1ab6a430b9b)
I20260926 13:55:33.457538 9608 rpcz_store.cc:276] 0926 13:55:30.677097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.677201 (+ 104us) service_pool.cc:224] Handling call
0926 13:55:33.438490 (+2761289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:30.951253 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:30.983951 (+ 32698us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:30.984852 (+ 901us) write_op.cc:435] Acquired schema lock
0926 13:55:30.984869 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.058826 (+ 73957us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.058881 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.058913 (+ 32us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.065399 (+ 6486us) tablet.cc:701] Row locks acquired
0926 13:55:31.065425 (+ 26us) write_op.cc:260] PREPARE: finished
0926 13:55:31.065629 (+ 204us) write_op.cc:270] Start()
0926 13:55:31.065736 (+ 107us) write_op.cc:276] Timestamp: P: 1790430931065575 usec, L: 0
0926 13:55:31.065755 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.095424 (+ 29669us) log.cc:844] Serialized 821 byte log entry
0926 13:55:33.181118 (+2085694us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.278201 (+ 97083us) write_op.cc:301] APPLY: starting
0926 13:55:33.279983 (+ 1782us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.355655 (+ 75672us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.357618 (+ 1963us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.371416 (+ 13798us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.371620 (+ 204us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.371805 (+ 185us) write_op.cc:312] APPLY: finished
0926 13:55:33.372109 (+ 304us) log.cc:844] Serialized 88 byte log entry
0926 13:55:33.402887 (+ 30778us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.407480 (+ 4593us) write_op.cc:454] Released schema lock
0926 13:55:33.411323 (+ 3843us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":83953,"mutex_wait_us":531,"num_ops":12,"prepare.queue_time_us":267856,"prepare.run_cpu_time_us":5034,"prepare.run_wall_time_us":150620,"replication_time_us":2111709,"thread_start_us":33830,"threads_started":1}]]}
I20260926 13:55:33.707471 9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:33.555781 9578 rpcz_store.cc:276] 0926 13:55:30.951441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.955262 (+ 3821us) service_pool.cc:224] Handling call
0926 13:55:33.533814 (+2578552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.935711 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:31.944387 (+ 8676us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.944417 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:31.944434 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.945308 (+ 874us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.945353 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.945379 (+ 26us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.952140 (+ 6761us) tablet.cc:701] Row locks acquired
0926 13:55:31.952175 (+ 35us) write_op.cc:260] PREPARE: finished
0926 13:55:31.952331 (+ 156us) write_op.cc:270] Start()
0926 13:55:31.952436 (+ 105us) write_op.cc:276] Timestamp: P: 1790430931952290 usec, L: 0
0926 13:55:31.952454 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.967960 (+ 15506us) log.cc:844] Serialized 907 byte log entry
0926 13:55:32.319100 (+351140us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b540035bc20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:33.086429 (+767329us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.431095 (+344666us) write_op.cc:301] APPLY: starting
0926 13:55:33.431158 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.431398 (+ 240us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.431421 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.433262 (+ 1841us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.447522 (+ 14260us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.451789 (+ 4267us) write_op.cc:312] APPLY: finished
0926 13:55:33.479232 (+ 27443us) log.cc:844] Serialized 100 byte log entry
0926 13:55:33.494224 (+ 14992us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.502037 (+ 7813us) write_op.cc:454] Released schema lock
0926 13:55:33.506607 (+ 4570us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":342308,"mutex_wait_us":8029,"num_ops":14,"prepare.queue_time_us":851710,"prepare.run_cpu_time_us":5969,"prepare.run_wall_time_us":386919,"replication_time_us":1130878,"spinlock_wait_cycles":3492480}]]}
I20260926 13:55:33.703433 9615 raft_consensus.cc:515] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:33.722438 9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:33.724903 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=29, attempt_no=0}) took 2825 ms. Trace:
I20260926 13:55:33.769243 9257 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:33.769627 9182 leader_election.cc:304] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:33.772202 9366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04729c698ede46c78868c2040e9ad38b" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:33.503446 9591 rpcz_store.cc:276] 0926 13:55:31.235167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.246812 (+ 11645us) service_pool.cc:224] Handling call
0926 13:55:33.479082 (+2232270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.834026 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:31.834479 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.834504 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:31.834516 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:31.835372 (+ 856us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.835413 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.835443 (+ 30us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:31.836386 (+ 943us) tablet.cc:701] Row locks acquired
0926 13:55:31.836405 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:31.836548 (+ 143us) write_op.cc:270] Start()
0926 13:55:31.836643 (+ 95us) write_op.cc:276] Timestamp: P: 1790430931836513 usec, L: 0
0926 13:55:31.836658 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.843966 (+ 7308us) log.cc:844] Serialized 993 byte log entry
0926 13:55:33.012631 (+1168665us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.228335 (+215704us) write_op.cc:301] APPLY: starting
0926 13:55:33.228413 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.233633 (+ 5220us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.238086 (+ 4453us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.465138 (+227052us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.471720 (+ 6582us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.471769 (+ 49us) write_op.cc:312] APPLY: finished
0926 13:55:33.472071 (+ 302us) log.cc:844] Serialized 112 byte log entry
0926 13:55:33.472247 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.472368 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:33.472425 (+ 57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":215545,"num_ops":16,"prepare.queue_time_us":584009,"prepare.run_cpu_time_us":3552,"prepare.run_wall_time_us":10158,"replication_time_us":1175888}]]}
I20260926 13:55:33.772439 9570 leader_election.cc:290] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:33.785717 9564 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=39, attempt_no=0}) took 2696 ms. Trace:
I20260926 13:55:33.726714 9579 rpcz_store.cc:276] 0926 13:55:30.900339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.903545 (+ 3206us) service_pool.cc:224] Handling call
0926 13:55:33.724834 (+2821289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.767543 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:31.768000 (+ 457us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.768024 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:31.768036 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:31.796874 (+ 28838us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.799360 (+ 2486us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.800580 (+ 1220us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.869840 (+ 69260us) tablet.cc:701] Row locks acquired
0926 13:55:31.869857 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:31.870014 (+ 157us) write_op.cc:270] Start()
0926 13:55:31.870109 (+ 95us) write_op.cc:276] Timestamp: P: 1790430931869976 usec, L: 0
0926 13:55:31.870132 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.278819 (+408687us) log.cc:844] Serialized 907 byte log entry
0926 13:55:33.283134 (+1004315us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.685057 (+401923us) write_op.cc:301] APPLY: starting
0926 13:55:33.685126 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.685366 (+ 240us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.685458 (+ 92us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.688390 (+ 2932us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.688625 (+ 235us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.688672 (+ 47us) write_op.cc:312] APPLY: finished
0926 13:55:33.688989 (+ 317us) log.cc:844] Serialized 100 byte log entry
0926 13:55:33.689173 (+ 184us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.702115 (+ 12942us) write_op.cc:454] Released schema lock
0926 13:55:33.706166 (+ 4051us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":401763,"num_ops":14,"prepare.queue_time_us":856579,"prepare.run_cpu_time_us":72804,"prepare.run_wall_time_us":512712,"replication_time_us":1412048}]]}
I20260926 13:55:33.846293 9608 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=40, attempt_no=0}) took 2954 ms. Trace:
I20260926 13:55:33.846701 9571 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=28, attempt_no=0}) took 2858 ms. Trace:
I20260926 13:55:33.846321 9547 raft_consensus.cc:2749] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260926 13:55:33.851521 9586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=32, attempt_no=0}) took 3048 ms. Trace:
I20260926 13:55:33.851941 9586 rpcz_store.cc:276] 0926 13:55:30.803096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.803286 (+ 190us) service_pool.cc:224] Handling call
0926 13:55:33.851455 (+3048169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.102820 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:31.128654 (+ 25834us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.129415 (+ 761us) write_op.cc:435] Acquired schema lock
0926 13:55:31.130068 (+ 653us) tablet.cc:662] Decoding operations
0926 13:55:31.151992 (+ 21924us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.152044 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.152075 (+ 31us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.152881 (+ 806us) tablet.cc:701] Row locks acquired
0926 13:55:31.152899 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:31.302217 (+149318us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:31.302327 (+ 110us) write_op.cc:270] Start()
0926 13:55:31.302528 (+ 201us) write_op.cc:276] Timestamp: P: 1790430931302289 usec, L: 0
0926 13:55:31.302553 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.303096 (+ 543us) log.cc:844] Serialized 821 byte log entry
0926 13:55:33.235871 (+1932775us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.703052 (+467181us) write_op.cc:301] APPLY: starting
0926 13:55:33.703130 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.703348 (+ 218us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.703365 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.705854 (+ 2489us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.713880 (+ 8026us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.713925 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:33.714178 (+ 253us) log.cc:844] Serialized 88 byte log entry
0926 13:55:33.714371 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.728286 (+ 13915us) write_op.cc:454] Released schema lock
0926 13:55:33.728338 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:33.851335 (+122997us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":466021,"num_ops":12,"prepare.queue_time_us":291876,"prepare.run_cpu_time_us":17682,"prepare.run_wall_time_us":202946,"replication_time_us":1923091,"spinlock_wait_cycles":49736448}]]}
I20260926 13:55:33.861680 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:33.846725 9608 rpcz_store.cc:276] 0926 13:55:30.893002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.893161 (+ 159us) service_pool.cc:224] Handling call
0926 13:55:33.846222 (+2953061us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.303457 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:31.330850 (+ 27393us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.331404 (+ 554us) write_op.cc:435] Acquired schema lock
0926 13:55:31.331861 (+ 457us) tablet.cc:662] Decoding operations
0926 13:55:31.380526 (+ 48665us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.380569 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.380604 (+ 35us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:31.382072 (+ 1468us) tablet.cc:701] Row locks acquired
0926 13:55:31.382092 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:31.382250 (+ 158us) write_op.cc:270] Start()
0926 13:55:31.385754 (+ 3504us) write_op.cc:276] Timestamp: P: 1790430931382212 usec, L: 0
0926 13:55:31.386242 (+ 488us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.403136 (+ 16894us) log.cc:844] Serialized 950 byte log entry
0926 13:55:33.243541 (+1840405us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.705718 (+462177us) write_op.cc:301] APPLY: starting
0926 13:55:33.705787 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.707574 (+ 1787us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.714521 (+ 6947us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.735691 (+ 21170us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.735931 (+ 240us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.735978 (+ 47us) write_op.cc:312] APPLY: finished
0926 13:55:33.736270 (+ 292us) log.cc:844] Serialized 106 byte log entry
0926 13:55:33.736440 (+ 170us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.736552 (+ 112us) write_op.cc:454] Released schema lock
0926 13:55:33.736601 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:33.846109 (+109508us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":457808,"num_ops":15,"prepare.queue_time_us":407649,"prepare.run_cpu_time_us":4739,"prepare.run_wall_time_us":99917,"replication_time_us":1853994,"spinlock_wait_cycles":23221632}]]}
I20260926 13:55:33.884065 9257 leader_election.cc:304] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:33.887022 9366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6210fe45bb654298a404f65b1c766d88" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:33.888609 9257 leader_election.cc:304] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87
I20260926 13:55:33.882489 9615 leader_election.cc:290] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:33.885337 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=15, attempt_no=0}) took 3064 ms. Trace:
I20260926 13:55:33.897109 9563 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:33.907102 9611 raft_consensus.cc:2749] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260926 13:55:33.909662 9286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f540c52111434b839719f0c1c0113620" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:33.847085 9571 rpcz_store.cc:276] 0926 13:55:30.988341 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.988544 (+ 203us) service_pool.cc:224] Handling call
0926 13:55:33.846644 (+2858100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.825143 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:31.826779 (+ 1636us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.826811 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:31.826823 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:31.831837 (+ 5014us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.831878 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.831902 (+ 24us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:31.832814 (+ 912us) tablet.cc:701] Row locks acquired
0926 13:55:31.832832 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:31.832985 (+ 153us) write_op.cc:270] Start()
0926 13:55:31.833076 (+ 91us) write_op.cc:276] Timestamp: P: 1790430931832935 usec, L: 0
0926 13:55:31.833095 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.833650 (+ 555us) log.cc:844] Serialized 950 byte log entry
0926 13:55:33.012426 (+1178776us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.208477 (+196051us) write_op.cc:301] APPLY: starting
0926 13:55:33.208542 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.237683 (+ 29141us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.241828 (+ 4145us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.437320 (+195492us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.437567 (+ 247us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.437613 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:33.437924 (+ 311us) log.cc:844] Serialized 106 byte log entry
0926 13:55:33.442974 (+ 5050us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.449844 (+ 6870us) write_op.cc:454] Released schema lock
0926 13:55:33.453602 (+ 3758us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:33.846545 (+392943us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":195905,"num_ops":15,"prepare.queue_time_us":768818,"prepare.run_cpu_time_us":3424,"prepare.run_wall_time_us":8723,"replication_time_us":1179243,"spinlock_wait_cycles":6941952}]]}
I20260926 13:55:33.920367 9293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6210fe45bb654298a404f65b1c766d88" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 9 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:33.898993 9554 rpcz_store.cc:276] 0926 13:55:30.821932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.826051 (+ 4119us) service_pool.cc:224] Handling call
0926 13:55:33.884790 (+3058739us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.469649 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:31.551206 (+ 81557us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.556453 (+ 5247us) write_op.cc:435] Acquired schema lock
0926 13:55:31.556472 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:31.622469 (+ 65997us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.622519 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.622547 (+ 28us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:31.623458 (+ 911us) tablet.cc:701] Row locks acquired
0926 13:55:31.623477 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:31.747617 (+124140us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b2c000aea28. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:31.752717 (+ 5100us) write_op.cc:270] Start()
0926 13:55:31.785489 (+ 32772us) write_op.cc:276] Timestamp: P: 1790430931629472 usec, L: 0
0926 13:55:31.785518 (+ 29us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.822878 (+ 37360us) log.cc:844] Serialized 950 byte log entry
0926 13:55:33.431322 (+1608444us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.765496 (+334174us) write_op.cc:301] APPLY: starting
0926 13:55:33.767183 (+ 1687us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.795105 (+ 27922us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.795128 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.806531 (+ 11403us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.806742 (+ 211us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.806785 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:33.807067 (+ 282us) log.cc:844] Serialized 106 byte log entry
0926 13:55:33.820315 (+ 13248us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.841520 (+ 21205us) write_op.cc:454] Released schema lock
0926 13:55:33.845470 (+ 3950us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":281236,"mutex_wait_us":1307,"num_ops":15,"prepare.queue_time_us":582481,"prepare.run_cpu_time_us":7809,"prepare.run_wall_time_us":363329,"replication_time_us":1643360,"spinlock_wait_cycles":13487488}]]}
I20260926 13:55:33.938931 9182 leader_election.cc:304] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:33.945784 9563 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:33.940009 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=30, attempt_no=0}) took 3020 ms. Trace:
I20260926 13:55:33.946218 9563 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:33.979307 9182 leader_election.cc:304] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:33.979804 9570 raft_consensus.cc:2749] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260926 13:55:33.818881 9564 rpcz_store.cc:276] 0926 13:55:30.989674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.989819 (+ 145us) service_pool.cc:224] Handling call
0926 13:55:33.685716 (+2695897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.563768 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:31.602147 (+ 38379us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.605181 (+ 3034us) write_op.cc:435] Acquired schema lock
0926 13:55:31.614709 (+ 9528us) tablet.cc:662] Decoding operations
0926 13:55:31.659960 (+ 45251us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.660912 (+ 952us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.660945 (+ 33us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:31.793636 (+132691us) tablet.cc:701] Row locks acquired
0926 13:55:31.793656 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:31.794963 (+ 1307us) write_op.cc:270] Start()
0926 13:55:31.799672 (+ 4709us) write_op.cc:276] Timestamp: P: 1790430931794917 usec, L: 0
0926 13:55:31.801242 (+ 1570us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.824781 (+ 23539us) log.cc:844] Serialized 993 byte log entry
0926 13:55:33.012180 (+1187399us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.198628 (+186448us) write_op.cc:301] APPLY: starting
0926 13:55:33.198694 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.198982 (+ 288us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.199076 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.231335 (+ 32259us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.236443 (+ 5108us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.238236 (+ 1793us) write_op.cc:312] APPLY: finished
0926 13:55:33.239189 (+ 953us) log.cc:844] Serialized 112 byte log entry
0926 13:55:33.239919 (+ 730us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.241655 (+ 1736us) write_op.cc:454] Released schema lock
0926 13:55:33.243413 (+ 1758us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:33.685609 (+442196us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":186288,"num_ops":16,"prepare.queue_time_us":536892,"prepare.run_cpu_time_us":19170,"prepare.run_wall_time_us":267712,"replication_time_us":1210808,"spinlock_wait_cycles":16825216}]]}
I20260926 13:55:34.026633 9615 raft_consensus.cc:2749] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260926 13:55:34.038775 9619 log.cc:927] Time spent T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.125s user 0.000s sys 0.001s
I20260926 13:55:34.036437 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=52, attempt_no=0}) took 2706 ms. Trace:
I20260926 13:55:34.056100 9564 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=55, attempt_no=0}) took 2875 ms. Trace:
I20260926 13:55:33.956915 9579 rpcz_store.cc:276] 0926 13:55:30.931967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.934395 (+ 2428us) service_pool.cc:224] Handling call
0926 13:55:33.939945 (+3005550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.849832 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:31.935549 (+ 85717us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.942980 (+ 7431us) write_op.cc:435] Acquired schema lock
0926 13:55:31.943006 (+ 26us) tablet.cc:662] Decoding operations
0926 13:55:32.047010 (+104004us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.048225 (+ 1215us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.049168 (+ 943us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:32.146668 (+ 97500us) tablet.cc:701] Row locks acquired
0926 13:55:32.147432 (+ 764us) write_op.cc:260] PREPARE: finished
0926 13:55:32.162185 (+ 14753us) write_op.cc:270] Start()
0926 13:55:32.167775 (+ 5590us) write_op.cc:276] Timestamp: P: 1790430932157589 usec, L: 0
0926 13:55:32.174851 (+ 7076us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.227907 (+ 53056us) log.cc:844] Serialized 649 byte log entry
0926 13:55:33.431585 (+1203678us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.806641 (+375056us) write_op.cc:301] APPLY: starting
0926 13:55:33.806707 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.806892 (+ 185us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.806982 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:33.895944 (+ 88962us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:33.896127 (+ 183us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:33.896170 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:33.896389 (+ 219us) log.cc:844] Serialized 64 byte log entry
0926 13:55:33.899380 (+ 2991us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:33.900841 (+ 1461us) write_op.cc:454] Released schema lock
0926 13:55:33.900894 (+ 53us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:33.939832 (+ 38938us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":374905,"num_ops":8,"prepare.queue_time_us":903091,"prepare.run_cpu_time_us":4995,"prepare.run_wall_time_us":420571,"replication_time_us":1256646,"spinlock_wait_cycles":17474304}]]}
I20260926 13:55:34.059398 9547 raft_consensus.cc:2749] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260926 13:55:34.065719 9618 log.cc:927] Time spent T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
I20260926 13:55:33.996742 9563 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:34.046382 9583 rpcz_store.cc:276] 0926 13:55:31.334026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.338927 (+ 4901us) service_pool.cc:224] Handling call
0926 13:55:34.036375 (+2697448us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.310940 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:32.311402 (+ 462us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.311490 (+ 88us) write_op.cc:435] Acquired schema lock
0926 13:55:32.311508 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:32.312405 (+ 897us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.312453 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.312480 (+ 27us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:32.329973 (+ 17493us) tablet.cc:701] Row locks acquired
0926 13:55:32.329993 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:32.330148 (+ 155us) write_op.cc:270] Start()
0926 13:55:32.330239 (+ 91us) write_op.cc:276] Timestamp: P: 1790430932330108 usec, L: 0
0926 13:55:32.330258 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.402528 (+ 72270us) log.cc:844] Serialized 950 byte log entry
0926 13:55:33.432023 (+1029495us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.976142 (+544119us) write_op.cc:301] APPLY: starting
0926 13:55:33.976242 (+ 100us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.976509 (+ 267us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.976594 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.035244 (+ 58650us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.035462 (+ 218us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.035507 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:34.035774 (+ 267us) log.cc:844] Serialized 106 byte log entry
0926 13:55:34.035940 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.036050 (+ 110us) write_op.cc:454] Released schema lock
0926 13:55:34.036095 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":543959,"mutex_wait_us":16123,"num_ops":15,"prepare.queue_time_us":936106,"prepare.run_cpu_time_us":3989,"prepare.run_wall_time_us":103059,"replication_time_us":1101676,"spinlock_wait_cycles":1920}]]}
I20260926 13:55:34.093550 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=48, attempt_no=0}) took 2984 ms. Trace:
I20260926 13:55:34.097338 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=41, attempt_no=0}) took 3070 ms. Trace:
I20260926 13:55:34.097893 9579 rpcz_store.cc:276] 0926 13:55:31.049662 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.057259 (+ 7597us) service_pool.cc:224] Handling call
0926 13:55:31.476941 (+419682us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b240006a5c8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7eece 00000000003e2a19 00007fdb02f50dd0 00007fdb02f5e03f 00007fdb0b886d55 00007fdb0b885006 00007fdb09f87084 00007fdb09f87012 00007fdb09f86f41
0926 13:55:34.097281 (+2620340us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.563730 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:32.564198 (+ 468us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.564225 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:32.564238 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:32.565174 (+ 936us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.565223 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.565248 (+ 25us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:32.568805 (+ 3557us) tablet.cc:701] Row locks acquired
0926 13:55:32.568824 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:32.575015 (+ 6191us) write_op.cc:270] Start()
0926 13:55:32.575124 (+ 109us) write_op.cc:276] Timestamp: P: 1790430932574965 usec, L: 0
0926 13:55:32.575142 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.665839 (+ 90697us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5400169a20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:32.666451 (+ 612us) log.cc:844] Serialized 950 byte log entry
0926 13:55:33.432465 (+766014us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.075479 (+643014us) write_op.cc:301] APPLY: starting
0926 13:55:34.075539 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.075787 (+ 248us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.075808 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.087681 (+ 11873us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.087903 (+ 222us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.087949 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:34.088232 (+ 283us) log.cc:844] Serialized 106 byte log entry
0926 13:55:34.096851 (+ 8619us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.096967 (+ 116us) write_op.cc:454] Released schema lock
0926 13:55:34.097013 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":3678336,"child_traces":[["op",{"apply.queue_time_us":642862,"mutex_wait_us":11104,"num_ops":15,"prepare.queue_time_us":984645,"prepare.run_cpu_time_us":5442,"prepare.run_wall_time_us":108490,"replication_time_us":857237,"spinlock_wait_cycles":5062016}]]}
I20260926 13:55:34.106519 9211 raft_consensus.cc:1240] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Rejecting Update request from peer 5036bd38367e48199b8de47d7853fc87 for earlier term 1. Current term is 2. Ops: []
I20260926 13:55:34.131973 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=67, attempt_no=0}) took 2662 ms. Trace:
I20260926 13:55:34.132416 9554 rpcz_store.cc:276] 0926 13:55:31.469904 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.470475 (+ 571us) service_pool.cc:224] Handling call
0926 13:55:34.131910 (+2661435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.486639 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:32.515182 (+ 28543us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.515208 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:32.515228 (+ 20us) tablet.cc:662] Decoding operations
0926 13:55:32.516735 (+ 1507us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.516800 (+ 65us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.516827 (+ 27us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:32.517816 (+ 989us) tablet.cc:701] Row locks acquired
0926 13:55:32.517831 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:32.517986 (+ 155us) write_op.cc:270] Start()
0926 13:55:32.518099 (+ 113us) write_op.cc:276] Timestamp: P: 1790430932517944 usec, L: 0
0926 13:55:32.518118 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.518685 (+ 567us) log.cc:844] Serialized 1036 byte log entry
0926 13:55:33.432249 (+913564us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.042554 (+610305us) write_op.cc:301] APPLY: starting
0926 13:55:34.042623 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.042952 (+ 329us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.043043 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.107480 (+ 64437us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.107706 (+ 226us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.107749 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.108046 (+ 297us) log.cc:844] Serialized 118 byte log entry
0926 13:55:34.131422 (+ 23376us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.131548 (+ 126us) write_op.cc:454] Released schema lock
0926 13:55:34.131602 (+ 54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":610000,"mutex_wait_us":13895,"num_ops":17,"prepare.queue_time_us":931056,"prepare.run_cpu_time_us":3851,"prepare.run_wall_time_us":46036,"replication_time_us":914024}]]}
I20260926 13:55:34.093959 9584 rpcz_store.cc:276] 0926 13:55:31.108942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.112134 (+ 3192us) service_pool.cc:224] Handling call
0926 13:55:34.093488 (+2981354us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.265878 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:32.266404 (+ 526us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.266435 (+ 31us) write_op.cc:435] Acquired schema lock
0926 13:55:32.266452 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:32.267575 (+ 1123us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.267620 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.267649 (+ 29us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:32.268593 (+ 944us) tablet.cc:701] Row locks acquired
0926 13:55:32.268613 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:32.283810 (+ 15197us) write_op.cc:270] Start()
0926 13:55:32.295490 (+ 11680us) write_op.cc:276] Timestamp: P: 1790430932268734 usec, L: 0
0926 13:55:32.301862 (+ 6372us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.310538 (+ 8676us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:33.431808 (+1121270us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.959289 (+527481us) write_op.cc:301] APPLY: starting
0926 13:55:33.963240 (+ 3951us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.972945 (+ 9705us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.973039 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.088937 (+115898us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.089176 (+ 239us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.089221 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:34.089540 (+ 319us) log.cc:844] Serialized 124 byte log entry
0926 13:55:34.093020 (+ 3480us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.093145 (+ 125us) write_op.cc:454] Released schema lock
0926 13:55:34.093194 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":514685,"mutex_wait_us":32736,"num_ops":18,"prepare.queue_time_us":1138394,"prepare.run_cpu_time_us":4043,"prepare.run_wall_time_us":44909,"replication_time_us":1129857}]]}
I20260926 13:55:34.143649 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=58, attempt_no=0}) took 2710 ms. Trace:
I20260926 13:55:34.144084 9579 rpcz_store.cc:276] 0926 13:55:31.449837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.466781 (+ 16944us) service_pool.cc:224] Handling call
0926 13:55:34.143587 (+2676806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.734093 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:31.800023 (+ 65930us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.801430 (+ 1407us) write_op.cc:435] Acquired schema lock
0926 13:55:31.801447 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.865105 (+ 63658us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.865147 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.865178 (+ 31us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.865906 (+ 728us) tablet.cc:701] Row locks acquired
0926 13:55:31.865925 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:31.866089 (+ 164us) write_op.cc:270] Start()
0926 13:55:31.866182 (+ 93us) write_op.cc:276] Timestamp: P: 1790430931866050 usec, L: 0
0926 13:55:31.866201 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.157227 (+291026us) log.cc:844] Serialized 821 byte log entry
0926 13:55:32.232929 (+ 75702us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001eb254. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:33.476663 (+1243734us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.102212 (+625549us) write_op.cc:301] APPLY: starting
0926 13:55:34.102288 (+ 76us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.102522 (+ 234us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.102544 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.142442 (+ 39898us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.142648 (+ 206us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.142693 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:34.142947 (+ 254us) log.cc:844] Serialized 88 byte log entry
0926 13:55:34.143118 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.143220 (+ 102us) write_op.cc:454] Released schema lock
0926 13:55:34.143265 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":625385,"mutex_wait_us":6367,"num_ops":12,"prepare.queue_time_us":156224,"prepare.run_cpu_time_us":8941,"prepare.run_wall_time_us":506439,"replication_time_us":1610363,"spinlock_wait_cycles":518894336}]]}
I20260926 13:55:34.174736 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=68, attempt_no=0}) took 2560 ms. Trace:
I20260926 13:55:34.175107 9603 raft_consensus.cc:2749] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260926 13:55:34.179837 9287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:34.180076 9563 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 election: Requested vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:34.182812 9363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:34.181882 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=60, attempt_no=0}) took 2882 ms. Trace:
I20260926 13:55:34.186116 9601 consensus_queue.cc:1059] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: INVALID_TERM, Last received: 1.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260926 13:55:34.187873 9588 raft_consensus.cc:3055] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Stepping down as leader of term 1
I20260926 13:55:34.188316 9588 raft_consensus.cc:740] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Running, Role: LEADER
I20260926 13:55:34.189216 9588 consensus_queue.cc:260] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:34.201413 9571 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=17, attempt_no=0}) took 3247 ms. Trace:
I20260926 13:55:34.190201 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=75, attempt_no=0}) took 2546 ms. Trace:
I20260926 13:55:34.184448 9557 rpcz_store.cc:276] 0926 13:55:31.299231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.300429 (+ 1198us) service_pool.cc:224] Handling call
0926 13:55:34.181824 (+2881395us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.467351 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:32.467846 (+ 495us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.467875 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:32.467903 (+ 28us) tablet.cc:662] Decoding operations
0926 13:55:32.469076 (+ 1173us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.469126 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.469156 (+ 30us) tablet.cc:685] Acquiring locks for 19 operations
0926 13:55:32.470107 (+ 951us) tablet.cc:701] Row locks acquired
0926 13:55:32.470127 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:32.627004 (+156877us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:32.627110 (+ 106us) write_op.cc:270] Start()
0926 13:55:32.627287 (+ 177us) write_op.cc:276] Timestamp: P: 1790430932627069 usec, L: 0
0926 13:55:32.627311 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.627862 (+ 551us) log.cc:844] Serialized 1122 byte log entry
0926 13:55:33.297631 (+669769us) op_driver.cc:464] REPLICATION: finished
0926 13:55:33.839094 (+541463us) write_op.cc:301] APPLY: starting
0926 13:55:33.841907 (+ 2813us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:33.891876 (+ 49969us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:33.893639 (+ 1763us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.078824 (+185185us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.079859 (+ 1035us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.094967 (+ 15108us) write_op.cc:312] APPLY: finished
0926 13:55:34.100772 (+ 5805us) log.cc:844] Serialized 131 byte log entry
0926 13:55:34.100965 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.101091 (+ 126us) write_op.cc:454] Released schema lock
0926 13:55:34.101140 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.181724 (+ 80584us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":520719,"mutex_wait_us":150,"num_ops":19,"prepare.queue_time_us":1165383,"prepare.run_cpu_time_us":15268,"prepare.run_wall_time_us":238583,"raft.queue_time_us":119395,"raft.run_cpu_time_us":34,"raft.run_wall_time_us":3676,"replication_time_us":665727,"spinlock_wait_cycles":116655872,"thread_start_us":33902,"threads_started":1}]]}
I20260926 13:55:34.191468 9182 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:34.193322 9608 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=63, attempt_no=0}) took 2869 ms. Trace:
I20260926 13:55:34.207888 9615 raft_consensus.cc:2749] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260926 13:55:34.207643 9608 rpcz_store.cc:276] 0926 13:55:31.323902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.324624 (+ 722us) service_pool.cc:224] Handling call
0926 13:55:31.395971 (+ 71347us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:34.193265 (+2797294us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.729999 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:32.730457 (+ 458us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.873830 (+143373us) write_op.cc:435] Acquired schema lock
0926 13:55:32.885220 (+ 11390us) tablet.cc:662] Decoding operations
0926 13:55:32.945663 (+ 60443us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.945712 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.945737 (+ 25us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:33.040812 (+ 95075us) tablet.cc:701] Row locks acquired
0926 13:55:33.042519 (+ 1707us) write_op.cc:260] PREPARE: finished
0926 13:55:33.056799 (+ 14280us) write_op.cc:270] Start()
0926 13:55:33.065191 (+ 8392us) write_op.cc:276] Timestamp: P: 1790430933055359 usec, L: 0
0926 13:55:33.065216 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.138643 (+ 73427us) log.cc:844] Serialized 735 byte log entry
0926 13:55:33.523719 (+385076us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.051664 (+527945us) write_op.cc:301] APPLY: starting
0926 13:55:34.051725 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.051951 (+ 226us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.052042 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.069637 (+ 17595us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.069826 (+ 189us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.069868 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.070115 (+ 247us) log.cc:844] Serialized 76 byte log entry
0926 13:55:34.070269 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.070365 (+ 96us) write_op.cc:454] Released schema lock
0926 13:55:34.070404 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.193155 (+122751us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"spinlock_wait_cycles":10022784,"child_traces":[["op",{"apply.queue_time_us":527786,"num_ops":10,"prepare.queue_time_us":1328205,"prepare.run_cpu_time_us":21474,"prepare.run_wall_time_us":421883,"replication_time_us":457903,"spinlock_wait_cycles":4924672}]]}
I20260926 13:55:34.056493 9564 rpcz_store.cc:276] 0926 13:55:31.181244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.300991 (+119747us) service_pool.cc:224] Handling call
0926 13:55:34.056035 (+2755044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.844319 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:31.845164 (+ 845us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.850623 (+ 5459us) write_op.cc:435] Acquired schema lock
0926 13:55:31.851770 (+ 1147us) tablet.cc:662] Decoding operations
0926 13:55:31.946403 (+ 94633us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.951740 (+ 5337us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.953236 (+ 1496us) tablet.cc:685] Acquiring locks for 6 operations
0926 13:55:32.005421 (+ 52185us) tablet.cc:701] Row locks acquired
0926 13:55:32.006290 (+ 869us) write_op.cc:260] PREPARE: finished
0926 13:55:32.038019 (+ 31729us) write_op.cc:270] Start()
0926 13:55:32.577204 (+539185us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b54000b2628. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0c2c1c21 00007fdb0c2c088c 00007fdb09cbe834 00007fdb09ca9496 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94
0926 13:55:32.577430 (+ 226us) write_op.cc:276] Timestamp: P: 1790430932037972 usec, L: 0
0926 13:55:32.577456 (+ 26us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.585950 (+ 8494us) log.cc:844] Serialized 562 byte log entry
0926 13:55:33.498960 (+913010us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.053851 (+554891us) write_op.cc:301] APPLY: starting
0926 13:55:34.053926 (+ 75us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.054088 (+ 162us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.054110 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.055020 (+ 910us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.055211 (+ 191us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.055260 (+ 49us) write_op.cc:312] APPLY: finished
0926 13:55:34.055473 (+ 213us) log.cc:844] Serialized 52 byte log entry
0926 13:55:34.055642 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.055722 (+ 80us) write_op.cc:454] Released schema lock
0926 13:55:34.055758 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":554686,"num_ops":6,"prepare.queue_time_us":541796,"prepare.run_cpu_time_us":19435,"prepare.run_wall_time_us":741884,"replication_time_us":919157,"spinlock_wait_cycles":12768128}]]}
I20260926 13:55:34.200697 9588 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:34.204226 9217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59498 (request call id 54) took 1022 ms. Trace:
I20260926 13:55:34.211805 9578 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=77, attempt_no=0}) took 2587 ms. Trace:
I20260926 13:55:34.175141 9583 rpcz_store.cc:276] 0926 13:55:31.620874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.624329 (+ 3455us) service_pool.cc:224] Handling call
0926 13:55:34.174676 (+2550347us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.233286 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:32.233810 (+ 524us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.342624 (+108814us) write_op.cc:435] Acquired schema lock
0926 13:55:32.342645 (+ 21us) tablet.cc:662] Decoding operations
0926 13:55:32.343895 (+ 1250us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.343947 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.343974 (+ 27us) tablet.cc:685] Acquiring locks for 22 operations
0926 13:55:32.345088 (+ 1114us) tablet.cc:701] Row locks acquired
0926 13:55:32.345108 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:32.345281 (+ 173us) write_op.cc:270] Start()
0926 13:55:32.345391 (+ 110us) write_op.cc:276] Timestamp: P: 1790430932345237 usec, L: 0
0926 13:55:32.345407 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.345976 (+ 569us) log.cc:844] Serialized 1251 byte log entry
0926 13:55:33.476949 (+1130973us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.163136 (+686187us) write_op.cc:301] APPLY: starting
0926 13:55:34.163203 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.164722 (+ 1519us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.164839 (+ 117us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.167632 (+ 2793us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.167888 (+ 256us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.167931 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.168297 (+ 366us) log.cc:844] Serialized 151 byte log entry
0926 13:55:34.174187 (+ 5890us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.174332 (+ 145us) write_op.cc:454] Released schema lock
0926 13:55:34.174387 (+ 55us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":686015,"num_ops":22,"prepare.queue_time_us":607431,"prepare.run_cpu_time_us":11099,"prepare.run_wall_time_us":174408,"replication_time_us":1131446}]]}
I20260926 13:55:34.202239 9571 rpcz_store.cc:276] 0926 13:55:30.958740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.972846 (+ 14106us) service_pool.cc:224] Handling call
0926 13:55:31.303952 (+331106us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:34.201349 (+2897397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.586403 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:32.586884 (+ 481us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.586918 (+ 34us) write_op.cc:435] Acquired schema lock
0926 13:55:32.586931 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:32.660324 (+ 73393us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.661610 (+ 1286us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.678737 (+ 17127us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:32.679538 (+ 801us) tablet.cc:701] Row locks acquired
0926 13:55:32.679554 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:32.679851 (+ 297us) write_op.cc:270] Start()
0926 13:55:32.890281 (+210430us) write_op.cc:276] Timestamp: P: 1790430932679675 usec, L: 0
0926 13:55:32.892635 (+ 2354us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.981471 (+ 88836us) log.cc:844] Serialized 864 byte log entry
0926 13:55:33.499263 (+517792us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.065502 (+566239us) write_op.cc:301] APPLY: starting
0926 13:55:34.067343 (+ 1841us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.137410 (+ 70067us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.137501 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.139170 (+ 1669us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.139376 (+ 206us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.139438 (+ 62us) write_op.cc:312] APPLY: finished
0926 13:55:34.139723 (+ 285us) log.cc:844] Serialized 94 byte log entry
0926 13:55:34.139904 (+ 181us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.140012 (+ 108us) write_op.cc:454] Released schema lock
0926 13:55:34.140057 (+ 45us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.201249 (+ 61192us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"spinlock_wait_cycles":14484864,"child_traces":[["op",{"apply.queue_time_us":559401,"mutex_wait_us":25776,"num_ops":13,"prepare.queue_time_us":1253064,"prepare.run_cpu_time_us":17442,"prepare.run_wall_time_us":396665,"replication_time_us":606534,"spinlock_wait_cycles":94416000}]]}
I20260926 13:55:34.219069 9608 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=54, attempt_no=0}) took 2926 ms. Trace:
I20260926 13:55:34.205494 9566 rpcz_store.cc:276] 0926 13:55:31.649337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.651672 (+ 2335us) service_pool.cc:224] Handling call
0926 13:55:34.190141 (+2538469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.159697 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:33.169380 (+ 9683us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.169408 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:33.169424 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:33.181276 (+ 11852us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.181319 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.181344 (+ 25us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:33.184246 (+ 2902us) tablet.cc:701] Row locks acquired
0926 13:55:33.184265 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:33.184411 (+ 146us) write_op.cc:270] Start()
0926 13:55:33.184516 (+ 105us) write_op.cc:276] Timestamp: P: 1790430933184373 usec, L: 0
0926 13:55:33.184534 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.185484 (+ 950us) log.cc:844] Serialized 778 byte log entry
0926 13:55:33.523956 (+338472us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.090287 (+566331us) write_op.cc:301] APPLY: starting
0926 13:55:34.090352 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.090569 (+ 217us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.090660 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.092156 (+ 1496us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.092434 (+ 278us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.092481 (+ 47us) write_op.cc:312] APPLY: finished
0926 13:55:34.092718 (+ 237us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.132638 (+ 39920us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.132766 (+ 128us) write_op.cc:454] Released schema lock
0926 13:55:34.132826 (+ 60us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.190044 (+ 57218us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":566182,"num_ops":11,"prepare.queue_time_us":1479134,"prepare.run_cpu_time_us":3600,"prepare.run_wall_time_us":39830,"replication_time_us":339335,"spinlock_wait_cycles":10676480}]]}
I20260926 13:55:34.222910 9578 rpcz_store.cc:276] 0926 13:55:31.624618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.631340 (+ 6722us) service_pool.cc:224] Handling call
0926 13:55:34.211731 (+2580391us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.018932 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:33.019409 (+ 477us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.019437 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:33.019450 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:33.020124 (+ 674us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.020174 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.020206 (+ 32us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:33.020706 (+ 500us) tablet.cc:701] Row locks acquired
0926 13:55:33.020724 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:33.020882 (+ 158us) write_op.cc:270] Start()
0926 13:55:33.020977 (+ 95us) write_op.cc:276] Timestamp: P: 1790430933020846 usec, L: 0
0926 13:55:33.021001 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.038810 (+ 17809us) log.cc:844] Serialized 701 byte log entry
0926 13:55:33.069246 (+ 30436us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b540035cb20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:33.502413 (+433167us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.091663 (+589250us) write_op.cc:301] APPLY: starting
0926 13:55:34.091731 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.091956 (+ 225us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.091979 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.097027 (+ 5048us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.097204 (+ 177us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.097246 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.097603 (+ 357us) log.cc:844] Serialized 70 byte log entry
0926 13:55:34.098291 (+ 688us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.098379 (+ 88us) write_op.cc:454] Released schema lock
0926 13:55:34.098420 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.211633 (+113213us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":589100,"mutex_wait_us":334,"num_ops":9,"prepare.queue_time_us":1356644,"prepare.run_cpu_time_us":3899,"prepare.run_wall_time_us":50478,"replication_time_us":480386,"spinlock_wait_cycles":197553664}]]}
I20260926 13:55:34.221295 9217 rpcz_store.cc:276] 0926 13:55:33.181340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:33.183627 (+ 2287us) service_pool.cc:224] Handling call
0926 13:55:33.256155 (+ 72528us) raft_consensus.cc:1471] Updating replica for 6 ops
0926 13:55:33.441574 (+185419us) raft_consensus.cc:1534] Early marking committed up to index 2
0926 13:55:33.465797 (+ 24223us) raft_consensus.cc:1539] Triggering prepare for 6 ops
0926 13:55:33.489293 (+ 23496us) write_op.cc:270] Start()
0926 13:55:33.497180 (+ 7887us) write_op.cc:276] Timestamp: P: 1790430931546164 usec, L: 0
0926 13:55:33.544701 (+ 47521us) write_op.cc:270] Start()
0926 13:55:33.549379 (+ 4678us) write_op.cc:276] Timestamp: P: 1790430931761767 usec, L: 0
0926 13:55:33.673675 (+124296us) write_op.cc:270] Start()
0926 13:55:33.673797 (+ 122us) write_op.cc:276] Timestamp: P: 1790430931869976 usec, L: 0
0926 13:55:33.768933 (+ 95136us) write_op.cc:270] Start()
0926 13:55:33.782309 (+ 13376us) write_op.cc:276] Timestamp: P: 1790430932297898 usec, L: 0
0926 13:55:33.818060 (+ 35751us) write_op.cc:270] Start()
0926 13:55:33.818172 (+ 112us) write_op.cc:276] Timestamp: P: 1790430932395557 usec, L: 0
0926 13:55:33.820279 (+ 2107us) write_op.cc:270] Start()
0926 13:55:33.840167 (+ 19888us) write_op.cc:276] Timestamp: P: 1790430932682197 usec, L: 0
0926 13:55:33.891995 (+ 51828us) log.cc:844] Serialized 5365 byte log entry
0926 13:55:33.969516 (+ 77521us) raft_consensus.cc:1645] Marking committed up to 2
0926 13:55:33.975368 (+ 5852us) raft_consensus.cc:1697] Filling consensus response to leader.
0926 13:55:34.015441 (+ 40073us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002ba2d4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0981e5c1 00007fdb0981cffe 00007fdb0b887659 00007fdb092c5d34 00007fdb092c5cc2 00007fdb092c5bf1 00007fdb092c5b6c 00007fdb092c4e22 00007fdb079ed09c 00007fdb079ec4d6
0926 13:55:34.015505 (+ 64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0926 13:55:34.203921 (+188416us) raft_consensus.cc:1685] finished
0926 13:55:34.203951 (+ 30us) raft_consensus.cc:1691] UpdateReplicas() finished
0926 13:55:34.204082 (+ 131us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.511945 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:33.512388 (+ 443us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.512415 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:33.512431 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:33.513219 (+ 788us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.513298 (+ 79us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.513325 (+ 27us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:33.514177 (+ 852us) tablet.cc:701] Row locks acquired
0926 13:55:33.514197 (+ 20us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:33.669683 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:33.761865 (+ 92182us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.761893 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:33.761910 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:33.762621 (+ 711us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.762687 (+ 66us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.762714 (+ 27us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:33.816316 (+ 53602us) tablet.cc:701] Row locks acquired
0926 13:55:33.816336 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:33.865081 (+ 48745us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6a72 00007fdb09ca9bc5 00007fdb09ca9381 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94
Related trace 'op':
0926 13:55:33.889246 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:33.916854 (+ 27608us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.916880 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:33.916893 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:33.917666 (+ 773us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.917727 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.917758 (+ 31us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:33.918586 (+ 828us) tablet.cc:701] Row locks acquired
0926 13:55:33.918606 (+ 20us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:33.918989 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:33.919419 (+ 430us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.919443 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:33.919461 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:33.942106 (+ 22645us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.959463 (+ 17357us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.960649 (+ 1186us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:33.997264 (+ 36615us) tablet.cc:701] Row locks acquired
0926 13:55:33.997285 (+ 21us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:33.997685 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:33.998121 (+ 436us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.998146 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:33.998161 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:33.998883 (+ 722us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.998948 (+ 65us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.998975 (+ 27us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:33.999774 (+ 799us) tablet.cc:701] Row locks acquired
0926 13:55:33.999793 (+ 19us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:34.000144 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:34.019180 (+ 19036us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:34.021028 (+ 1848us) write_op.cc:435] Acquired schema lock
0926 13:55:34.021040 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:34.088334 (+ 67294us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:34.088417 (+ 83us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:34.088445 (+ 28us) tablet.cc:685] Acquiring locks for 20 operations
0926 13:55:34.091538 (+ 3093us) tablet.cc:701] Row locks acquired
0926 13:55:34.091557 (+ 19us) write_op.cc:260] PREPARE: finished
Metrics: {"spinlock_wait_cycles":298625920,"thread_start_us":58837,"threads_started":1,"wal-append.queue_time_us":175500,"child_traces":[["op",{"num_ops":14,"partition_lock_wait_us":13,"prepare.queue_time_us":1450,"prepare.run_cpu_time_us":2488,"prepare.run_wall_time_us":2488}],["op",{"mutex_wait_us":14073,"num_ops":10,"partition_lock_wait_us":19,"prepare.queue_time_us":2579,"prepare.run_cpu_time_us":3397,"prepare.run_wall_time_us":291111,"spinlock_wait_cycles":5628160}],["op",{"num_ops":14,"partition_lock_wait_us":9,"prepare.queue_time_us":181828,"prepare.run_cpu_time_us":2649,"prepare.run_wall_time_us":33483}],["op",{"mutex_wait_us":4489,"num_ops":11,"partition_lock_wait_us":10,"prepare.queue_time_us":107719,"prepare.run_cpu_time_us":2392,"prepare.run_wall_time_us":78522}],["op",{"num_ops":13,"partition_lock_wait_us":9,"prepare.queue_time_us":179219,"prepare.run_cpu_time_us":2334,"prepare.run_wall_time_us":2335}],["op",{"mutex_wait_us":11812,"num_ops":20,"partition_lock_wait_us":12,"prepare.queue_time_us":150785,"prepare.run_cpu_time_us":3397,"prepare.run_wall_time_us":91630}]]}
I20260926 13:55:34.251103 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=51, attempt_no=0}) took 3138 ms. Trace:
I20260926 13:55:34.253094 9557 rpcz_store.cc:276] 0926 13:55:31.113151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.114168 (+ 1017us) service_pool.cc:224] Handling call
0926 13:55:34.251042 (+3136874us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.540203 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:31.585160 (+ 44957us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.586328 (+ 1168us) write_op.cc:435] Acquired schema lock
0926 13:55:31.586991 (+ 663us) tablet.cc:662] Decoding operations
0926 13:55:31.625625 (+ 38634us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.625669 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.625697 (+ 28us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:31.626380 (+ 683us) tablet.cc:701] Row locks acquired
0926 13:55:31.626396 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:31.626558 (+ 162us) write_op.cc:270] Start()
0926 13:55:31.626674 (+ 116us) write_op.cc:276] Timestamp: P: 1790430931626514 usec, L: 0
0926 13:55:31.626695 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.627240 (+ 545us) log.cc:844] Serialized 778 byte log entry
0926 13:55:33.836577 (+2209337us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.247993 (+411416us) write_op.cc:301] APPLY: starting
0926 13:55:34.248061 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.248279 (+ 218us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.248364 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.249927 (+ 1563us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.250188 (+ 261us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.250229 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:34.250484 (+ 255us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.250626 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.250727 (+ 101us) write_op.cc:454] Released schema lock
0926 13:55:34.250770 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":411274,"num_ops":11,"prepare.queue_time_us":343002,"prepare.run_cpu_time_us":3670,"prepare.run_wall_time_us":89864,"replication_time_us":2209789}]]}
I20260926 13:55:34.265049 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=34, attempt_no=0}) took 3314 ms. Trace:
I20260926 13:55:34.265530 9583 rpcz_store.cc:276] 0926 13:55:30.950333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.950648 (+ 315us) service_pool.cc:224] Handling call
0926 13:55:34.264995 (+3314347us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.433137 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:31.534899 (+101762us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.536543 (+ 1644us) write_op.cc:435] Acquired schema lock
0926 13:55:31.537417 (+ 874us) tablet.cc:662] Decoding operations
0926 13:55:31.588121 (+ 50704us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.588162 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.588186 (+ 24us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:31.589951 (+ 1765us) tablet.cc:701] Row locks acquired
0926 13:55:31.589971 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:31.590121 (+ 150us) write_op.cc:270] Start()
0926 13:55:31.590232 (+ 111us) write_op.cc:276] Timestamp: P: 1790430931590080 usec, L: 0
0926 13:55:31.590253 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.590818 (+ 565us) log.cc:844] Serialized 950 byte log entry
0926 13:55:33.720414 (+2129596us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.240983 (+520569us) write_op.cc:301] APPLY: starting
0926 13:55:34.241050 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.241318 (+ 268us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.241402 (+ 84us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.243356 (+ 1954us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.243582 (+ 226us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.243625 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.243919 (+ 294us) log.cc:844] Serialized 106 byte log entry
0926 13:55:34.264519 (+ 20600us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.264634 (+ 115us) write_op.cc:454] Released schema lock
0926 13:55:34.264682 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":520415,"num_ops":15,"prepare.queue_time_us":434611,"prepare.run_cpu_time_us":9183,"prepare.run_wall_time_us":159547,"replication_time_us":2130075,"spinlock_wait_cycles":1530624,"thread_start_us":18933,"threads_started":1}]]}
I20260926 13:55:34.273749 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=25, attempt_no=0}) took 3376 ms. Trace:
I20260926 13:55:34.274081 9579 rpcz_store.cc:276] 0926 13:55:30.897315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.899652 (+ 2337us) service_pool.cc:224] Handling call
0926 13:55:34.273705 (+3374053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.379593 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:31.382624 (+ 3031us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.384848 (+ 2224us) write_op.cc:435] Acquired schema lock
0926 13:55:31.385449 (+ 601us) tablet.cc:662] Decoding operations
0926 13:55:31.402187 (+ 16738us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.402666 (+ 479us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.403050 (+ 384us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:31.518518 (+115468us) tablet.cc:701] Row locks acquired
0926 13:55:31.518540 (+ 22us) write_op.cc:260] PREPARE: finished
0926 13:55:31.534055 (+ 15515us) write_op.cc:270] Start()
0926 13:55:31.536981 (+ 2926us) write_op.cc:276] Timestamp: P: 1790430931520817 usec, L: 0
0926 13:55:31.537003 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.577517 (+ 40514us) log.cc:844] Serialized 907 byte log entry
0926 13:55:33.720336 (+2142819us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.235693 (+515357us) write_op.cc:301] APPLY: starting
0926 13:55:34.235774 (+ 81us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.236029 (+ 255us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.236119 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.237973 (+ 1854us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.238153 (+ 180us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.238188 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:34.238407 (+ 219us) log.cc:844] Serialized 100 byte log entry
0926 13:55:34.273391 (+ 34984us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.273473 (+ 82us) write_op.cc:454] Released schema lock
0926 13:55:34.273511 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":515184,"num_ops":14,"prepare.queue_time_us":475394,"prepare.run_cpu_time_us":4904,"prepare.run_wall_time_us":198168,"replication_time_us":2182219,"spinlock_wait_cycles":1492736,"thread_start_us":34735,"threads_started":1}]]}
I20260926 13:55:34.263360 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=47, attempt_no=0}) took 3176 ms. Trace:
I20260926 13:55:34.224810 9608 rpcz_store.cc:276] 0926 13:55:31.292684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.304374 (+ 11690us) service_pool.cc:224] Handling call
0926 13:55:34.219013 (+2914639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.912462 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:32.912915 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.912939 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:32.912955 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:32.913664 (+ 709us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.917065 (+ 3401us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.917879 (+ 814us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:32.918482 (+ 603us) tablet.cc:701] Row locks acquired
0926 13:55:32.918502 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:33.002564 (+ 84062us) write_op.cc:270] Start()
0926 13:55:33.005858 (+ 3294us) write_op.cc:276] Timestamp: P: 1790430932918604 usec, L: 0
0926 13:55:33.006907 (+ 1049us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.073089 (+ 66182us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b540002fba0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:33.073667 (+ 578us) log.cc:844] Serialized 735 byte log entry
0926 13:55:33.671731 (+598064us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.214873 (+543142us) write_op.cc:301] APPLY: starting
0926 13:55:34.214946 (+ 73us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.215152 (+ 206us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.215175 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.216512 (+ 1337us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.216649 (+ 137us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.216679 (+ 30us) write_op.cc:312] APPLY: finished
0926 13:55:34.216917 (+ 238us) log.cc:844] Serialized 76 byte log entry
0926 13:55:34.218601 (+ 1684us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.218699 (+ 98us) write_op.cc:454] Released schema lock
0926 13:55:34.218743 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":540697,"mutex_wait_us":31978,"num_ops":10,"prepare.queue_time_us":1536590,"prepare.run_cpu_time_us":14811,"prepare.run_wall_time_us":161438,"replication_time_us":555510,"spinlock_wait_cycles":69127424}]]}
I20260926 13:55:34.281946 9586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=69, attempt_no=0}) took 2908 ms. Trace:
I20260926 13:55:34.282243 9586 rpcz_store.cc:276] 0926 13:55:31.373227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.374340 (+ 1113us) service_pool.cc:224] Handling call
0926 13:55:34.281891 (+2907551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.088625 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:33.098134 (+ 9509us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.098168 (+ 34us) write_op.cc:435] Acquired schema lock
0926 13:55:33.098185 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:33.100700 (+ 2515us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.100739 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.100783 (+ 44us) tablet.cc:685] Acquiring locks for 19 operations
0926 13:55:33.101765 (+ 982us) tablet.cc:701] Row locks acquired
0926 13:55:33.101779 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:33.101934 (+ 155us) write_op.cc:270] Start()
0926 13:55:33.102023 (+ 89us) write_op.cc:276] Timestamp: P: 1790430933101896 usec, L: 0
0926 13:55:33.102040 (+ 17us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.102572 (+ 532us) log.cc:844] Serialized 1122 byte log entry
0926 13:55:33.705007 (+602435us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.239020 (+534013us) write_op.cc:301] APPLY: starting
0926 13:55:34.239089 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.239415 (+ 326us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.239506 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.279684 (+ 40178us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.279926 (+ 242us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.279974 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:34.281288 (+ 1314us) log.cc:844] Serialized 131 byte log entry
0926 13:55:34.281452 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.281577 (+ 125us) write_op.cc:454] Released schema lock
0926 13:55:34.281623 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":533856,"num_ops":19,"prepare.queue_time_us":1677621,"prepare.run_cpu_time_us":9507,"prepare.run_wall_time_us":65538,"replication_time_us":601974}]]}
I20260926 13:55:34.284008 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=5, attempt_no=0}) took 3534 ms. Trace:
I20260926 13:55:34.276733 9566 rpcz_store.cc:276] 0926 13:55:31.086472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.087461 (+ 989us) service_pool.cc:224] Handling call
0926 13:55:34.262735 (+3175274us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.403567 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:31.404041 (+ 474us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.404067 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:31.404083 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:31.406933 (+ 2850us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.411452 (+ 4519us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.412211 (+ 759us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:31.475410 (+ 63199us) tablet.cc:701] Row locks acquired
0926 13:55:31.475430 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:31.475587 (+ 157us) write_op.cc:270] Start()
0926 13:55:31.475698 (+ 111us) write_op.cc:276] Timestamp: P: 1790430931475550 usec, L: 0
0926 13:55:31.475719 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.476303 (+ 584us) log.cc:844] Serialized 778 byte log entry
0926 13:55:33.836306 (+2360003us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.247056 (+410750us) write_op.cc:301] APPLY: starting
0926 13:55:34.247131 (+ 75us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.247367 (+ 236us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.247467 (+ 100us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.249289 (+ 1822us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.249595 (+ 306us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.249643 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:34.249904 (+ 261us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.251166 (+ 1262us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.251277 (+ 111us) write_op.cc:454] Released schema lock
0926 13:55:34.251325 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":410567,"num_ops":11,"prepare.queue_time_us":238695,"prepare.run_cpu_time_us":3475,"prepare.run_wall_time_us":72983,"replication_time_us":2360488}]]}
I20260926 13:55:34.284413 9584 rpcz_store.cc:276] 0926 13:55:30.749337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.750030 (+ 693us) service_pool.cc:224] Handling call
0926 13:55:30.875153 (+125123us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b540018be28. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0b7ed641 00007fdb0b814544 00007fdb09ca75ec 00007fdb09c6901b 00007fdb09c68df4 00007fdb0b885d5e 00007fdb09f87084 00007fdb09f87012 00007fdb09f86f41 00007fdb09f86ebc 00007fdb09f86172
0926 13:55:34.283947 (+3408794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.371089 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:31.371543 (+ 454us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.371568 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:31.371585 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:31.407529 (+ 35944us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.407573 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.407606 (+ 33us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:31.408534 (+ 928us) tablet.cc:701] Row locks acquired
0926 13:55:31.408549 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:31.408729 (+ 180us) write_op.cc:270] Start()
0926 13:55:31.408847 (+ 118us) write_op.cc:276] Timestamp: P: 1790430931408690 usec, L: 0
0926 13:55:31.408870 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.411770 (+ 2900us) log.cc:844] Serialized 993 byte log entry
0926 13:55:33.720160 (+2308390us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.222411 (+502251us) write_op.cc:301] APPLY: starting
0926 13:55:34.223212 (+ 801us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.261106 (+ 37894us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.271248 (+ 10142us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.282726 (+ 11478us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.282954 (+ 228us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.282997 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.283282 (+ 285us) log.cc:844] Serialized 112 byte log entry
0926 13:55:34.283515 (+ 233us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.283626 (+ 111us) write_op.cc:454] Released schema lock
0926 13:55:34.283671 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":2784000,"child_traces":[["op",{"apply.queue_time_us":493117,"num_ops":16,"prepare.queue_time_us":495311,"prepare.run_cpu_time_us":4140,"prepare.run_wall_time_us":44918,"replication_time_us":2311165}]]}
I20260926 13:55:34.301656 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=43, attempt_no=0}) took 3195 ms. Trace:
I20260926 13:55:34.302114 9579 rpcz_store.cc:276] 0926 13:55:31.106460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.106593 (+ 133us) service_pool.cc:224] Handling call
0926 13:55:34.301600 (+3195007us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.591182 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:31.591628 (+ 446us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.591654 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:31.591668 (+ 14us) tablet.cc:662] Decoding operations
0926 13:55:31.592456 (+ 788us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.592493 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.592521 (+ 28us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:31.650676 (+ 58155us) tablet.cc:701] Row locks acquired
0926 13:55:31.650693 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:31.658120 (+ 7427us) write_op.cc:270] Start()
0926 13:55:31.660180 (+ 2060us) write_op.cc:276] Timestamp: P: 1790430931656595 usec, L: 0
0926 13:55:31.661419 (+ 1239us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.724903 (+ 63484us) log.cc:844] Serialized 821 byte log entry
0926 13:55:33.768125 (+2043222us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.297780 (+529655us) write_op.cc:301] APPLY: starting
0926 13:55:34.297860 (+ 80us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.298051 (+ 191us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.299106 (+ 1055us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.300649 (+ 1543us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.300850 (+ 201us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.300886 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:34.301087 (+ 201us) log.cc:844] Serialized 88 byte log entry
0926 13:55:34.301234 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.301322 (+ 88us) write_op.cc:454] Released schema lock
0926 13:55:34.301358 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":529503,"mutex_wait_us":6359,"num_ops":12,"prepare.queue_time_us":482164,"prepare.run_cpu_time_us":3901,"prepare.run_wall_time_us":140954,"replication_time_us":2104105}]]}
I20260926 13:55:34.308921 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=97, attempt_no=0}) took 1813 ms. Trace:
I20260926 13:55:34.309307 9583 rpcz_store.cc:276] 0926 13:55:32.499603 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.502487 (+ 2884us) service_pool.cc:224] Handling call
0926 13:55:34.308862 (+1806375us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.558257 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5fcba31649db42f58ce04c10758ca297
0926 13:55:32.628500 (+ 70243us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.639272 (+ 10772us) write_op.cc:435] Acquired schema lock
0926 13:55:32.639290 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:32.757361 (+118071us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.762137 (+ 4776us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.766906 (+ 4769us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:32.895192 (+128286us) tablet.cc:701] Row locks acquired
0926 13:55:32.895897 (+ 705us) write_op.cc:260] PREPARE: finished
0926 13:55:32.917287 (+ 21390us) write_op.cc:270] Start()
0926 13:55:32.928286 (+ 10999us) write_op.cc:276] Timestamp: P: 1790430932913736 usec, L: 0
0926 13:55:32.936032 (+ 7746us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.954456 (+ 18424us) log.cc:844] Serialized 1045 byte log entry
0926 13:55:33.723481 (+769025us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.271057 (+547576us) write_op.cc:301] APPLY: starting
0926 13:55:34.271119 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.293264 (+ 22145us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.293364 (+ 100us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.295686 (+ 2322us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.307887 (+ 12201us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.307930 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.308222 (+ 292us) log.cc:844] Serialized 118 byte log entry
0926 13:55:34.308386 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.308501 (+ 115us) write_op.cc:454] Released schema lock
0926 13:55:34.308547 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":547429,"mutex_wait_us":2896,"num_ops":17,"prepare.queue_time_us":6400,"prepare.run_cpu_time_us":9650,"prepare.run_wall_time_us":414510,"replication_time_us":786639}]]}
I20260926 13:55:34.314265 9571 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=62, attempt_no=0}) took 3065 ms. Trace:
I20260926 13:55:34.320825 9571 rpcz_store.cc:276] 0926 13:55:31.248974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.285569 (+ 36595us) service_pool.cc:224] Handling call
0926 13:55:34.314206 (+3028637us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.389415 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:32.389910 (+ 495us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.389936 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:32.389948 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:32.390784 (+ 836us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.390831 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.390859 (+ 28us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:32.391743 (+ 884us) tablet.cc:701] Row locks acquired
0926 13:55:32.391761 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:32.391920 (+ 159us) write_op.cc:270] Start()
0926 13:55:32.392017 (+ 97us) write_op.cc:276] Timestamp: P: 1790430932391879 usec, L: 0
0926 13:55:32.392041 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.458076 (+ 66035us) log.cc:844] Serialized 907 byte log entry
0926 13:55:32.513072 (+ 54996us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b540035bc20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:33.818108 (+1305036us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.249789 (+431681us) write_op.cc:301] APPLY: starting
0926 13:55:34.249859 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.250107 (+ 248us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.250128 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.313052 (+ 62924us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.313290 (+ 238us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.313331 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:34.313596 (+ 265us) log.cc:844] Serialized 100 byte log entry
0926 13:55:34.313783 (+ 187us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.313893 (+ 110us) write_op.cc:454] Released schema lock
0926 13:55:34.313939 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":431508,"num_ops":14,"prepare.queue_time_us":1084916,"prepare.run_cpu_time_us":4459,"prepare.run_wall_time_us":123839,"replication_time_us":1425961,"spinlock_wait_cycles":9606400}]]}
I20260926 13:55:34.296219 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=18, attempt_no=0}) took 3459 ms. Trace:
I20260926 13:55:34.317839 9564 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=61, attempt_no=0}) took 3125 ms. Trace:
I20260926 13:55:34.324926 9554 rpcz_store.cc:276] 0926 13:55:30.837204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.846319 (+ 9115us) service_pool.cc:224] Handling call
0926 13:55:34.296171 (+3449852us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.578642 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:31.579123 (+ 481us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.579154 (+ 31us) write_op.cc:435] Acquired schema lock
0926 13:55:31.579177 (+ 23us) tablet.cc:662] Decoding operations
0926 13:55:31.581019 (+ 1842us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.581065 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.581094 (+ 29us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:31.583576 (+ 2482us) tablet.cc:701] Row locks acquired
0926 13:55:31.583594 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:31.726979 (+143385us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:31.727105 (+ 126us) write_op.cc:270] Start()
0926 13:55:31.727295 (+ 190us) write_op.cc:276] Timestamp: P: 1790430931727060 usec, L: 0
0926 13:55:31.727314 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.783186 (+ 55872us) log.cc:844] Serialized 993 byte log entry
0926 13:55:33.765558 (+1982372us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.293368 (+527810us) write_op.cc:301] APPLY: starting
0926 13:55:34.293437 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.293686 (+ 249us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.293702 (+ 16us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.295374 (+ 1672us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.295528 (+ 154us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.295556 (+ 28us) write_op.cc:312] APPLY: finished
0926 13:55:34.295739 (+ 183us) log.cc:844] Serialized 112 byte log entry
0926 13:55:34.295875 (+ 136us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.295950 (+ 75us) write_op.cc:454] Released schema lock
0926 13:55:34.295980 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":525280,"mutex_wait_us":1118,"num_ops":16,"prepare.queue_time_us":639660,"prepare.run_cpu_time_us":6510,"prepare.run_wall_time_us":212192,"replication_time_us":1999772,"spinlock_wait_cycles":4125952}]]}
I20260926 13:55:34.325903 9591 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=76, attempt_no=0}) took 2778 ms. Trace:
I20260926 13:55:34.325474 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=65, attempt_no=0}) took 2986 ms. Trace:
I20260926 13:55:34.330761 9591 rpcz_store.cc:276] 0926 13:55:31.547492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.547763 (+ 271us) service_pool.cc:224] Handling call
0926 13:55:34.325847 (+2778084us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.566098 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:32.597885 (+ 31787us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.597910 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:32.597926 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:32.599097 (+ 1171us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.599144 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.599173 (+ 29us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:32.600138 (+ 965us) tablet.cc:701] Row locks acquired
0926 13:55:32.600158 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:32.600332 (+ 174us) write_op.cc:270] Start()
0926 13:55:32.600452 (+ 120us) write_op.cc:276] Timestamp: P: 1790430932600290 usec, L: 0
0926 13:55:32.600474 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.601095 (+ 621us) log.cc:844] Serialized 1045 byte log entry
0926 13:55:33.818597 (+1217502us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.287820 (+469223us) write_op.cc:301] APPLY: starting
0926 13:55:34.287896 (+ 76us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.289274 (+ 1378us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.289376 (+ 102us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.320657 (+ 31281us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.320937 (+ 280us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.320985 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:34.321319 (+ 334us) log.cc:844] Serialized 118 byte log entry
0926 13:55:34.325425 (+ 4106us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.325545 (+ 120us) write_op.cc:454] Released schema lock
0926 13:55:34.325591 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":469086,"mutex_wait_us":18614,"num_ops":17,"prepare.queue_time_us":972371,"prepare.run_cpu_time_us":4025,"prepare.run_wall_time_us":70274,"replication_time_us":1218036}]]}
I20260926 13:55:34.332870 9557 rpcz_store.cc:276] 0926 13:55:31.343423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.368394 (+ 24971us) service_pool.cc:224] Handling call
0926 13:55:34.325413 (+2957019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.627631 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:31.628080 (+ 449us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.628109 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:31.628124 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:31.630762 (+ 2638us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.631586 (+ 824us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.632357 (+ 771us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:31.652600 (+ 20243us) tablet.cc:701] Row locks acquired
0926 13:55:31.652620 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:31.652778 (+ 158us) write_op.cc:270] Start()
0926 13:55:31.652880 (+ 102us) write_op.cc:276] Timestamp: P: 1790430931652721 usec, L: 0
0926 13:55:31.652896 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.653492 (+ 596us) log.cc:844] Serialized 649 byte log entry
0926 13:55:33.836816 (+2183324us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.261940 (+425124us) write_op.cc:301] APPLY: starting
0926 13:55:34.261999 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.262178 (+ 179us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.262274 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.291998 (+ 29724us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.292174 (+ 176us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.292217 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.292451 (+ 234us) log.cc:844] Serialized 64 byte log entry
0926 13:55:34.298755 (+ 6304us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.298854 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:34.298892 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.325310 (+ 26418us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":424975,"num_ops":8,"prepare.queue_time_us":256117,"prepare.run_cpu_time_us":3297,"prepare.run_wall_time_us":30483,"replication_time_us":2183808,"spinlock_wait_cycles":20200064}]]}
I20260926 13:55:34.344537 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=24, attempt_no=0}) took 3480 ms. Trace:
I20260926 13:55:34.345796 9608 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=70, attempt_no=0}) took 2964 ms. Trace:
I20260926 13:55:34.344954 9579 rpcz_store.cc:276] 0926 13:55:30.894484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:30.898641 (+ 4157us) service_pool.cc:224] Handling call
0926 13:55:30.938177 (+ 39536us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:34.344482 (+3406305us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.800205 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:31.841811 (+ 41606us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.842535 (+ 724us) write_op.cc:435] Acquired schema lock
0926 13:55:31.842894 (+ 359us) tablet.cc:662] Decoding operations
0926 13:55:32.373333 (+530439us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.374001 (+ 668us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.376443 (+ 2442us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:32.395025 (+ 18582us) tablet.cc:701] Row locks acquired
0926 13:55:32.395044 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:32.395196 (+ 152us) write_op.cc:270] Start()
0926 13:55:32.395288 (+ 92us) write_op.cc:276] Timestamp: P: 1790430932395155 usec, L: 0
0926 13:55:32.395305 (+ 17us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.395831 (+ 526us) log.cc:844] Serialized 907 byte log entry
0926 13:55:33.815722 (+1419891us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.332428 (+516706us) write_op.cc:301] APPLY: starting
0926 13:55:34.332488 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.332693 (+ 205us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.333650 (+ 957us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.335176 (+ 1526us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.335353 (+ 177us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.335388 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:34.343443 (+ 8055us) log.cc:844] Serialized 100 byte log entry
0926 13:55:34.344070 (+ 627us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.344161 (+ 91us) write_op.cc:454] Released schema lock
0926 13:55:34.344201 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":5305088,"child_traces":[["op",{"apply.queue_time_us":512792,"num_ops":14,"prepare.queue_time_us":823953,"prepare.run_cpu_time_us":58540,"prepare.run_wall_time_us":598890,"replication_time_us":1399594}]]}
I20260926 13:55:34.360996 9578 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=83, attempt_no=0}) took 2704 ms. Trace:
I20260926 13:55:34.363209 9571 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=87, attempt_no=0}) took 2519 ms. Trace:
I20260926 13:55:34.346279 9608 rpcz_store.cc:276] 0926 13:55:31.381833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.382010 (+ 177us) service_pool.cc:224] Handling call
0926 13:55:34.345738 (+2963728us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.710119 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:31.710624 (+ 505us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.710657 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:31.710671 (+ 14us) tablet.cc:662] Decoding operations
0926 13:55:31.720112 (+ 9441us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.720155 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.720185 (+ 30us) tablet.cc:685] Acquiring locks for 7 operations
0926 13:55:31.720627 (+ 442us) tablet.cc:701] Row locks acquired
0926 13:55:31.720657 (+ 30us) write_op.cc:260] PREPARE: finished
0926 13:55:31.720862 (+ 205us) write_op.cc:270] Start()
0926 13:55:31.720962 (+ 100us) write_op.cc:276] Timestamp: P: 1790430931720820 usec, L: 0
0926 13:55:31.720988 (+ 26us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.726424 (+ 5436us) log.cc:844] Serialized 605 byte log entry
0926 13:55:31.939638 (+213214us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54003ab4a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:33.837033 (+1897395us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.280617 (+443584us) write_op.cc:301] APPLY: starting
0926 13:55:34.280683 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.280884 (+ 201us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.280907 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.292003 (+ 11096us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.292283 (+ 280us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.292328 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:34.293152 (+ 824us) log.cc:844] Serialized 58 byte log entry
0926 13:55:34.293811 (+ 659us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.293895 (+ 84us) write_op.cc:454] Released schema lock
0926 13:55:34.293936 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.345640 (+ 51704us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":443417,"mutex_wait_us":9325,"num_ops":7,"prepare.queue_time_us":277556,"prepare.run_cpu_time_us":5407,"prepare.run_wall_time_us":229684,"replication_time_us":2115955,"spinlock_wait_cycles":384440448}]]}
I20260926 13:55:34.363646 9571 rpcz_store.cc:276] 0926 13:55:31.847009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.850381 (+ 3372us) service_pool.cc:224] Handling call
0926 13:55:34.363152 (+2512771us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.013163 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:33.013665 (+ 502us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.013694 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:33.013707 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:33.014474 (+ 767us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.014517 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.014549 (+ 32us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:33.015157 (+ 608us) tablet.cc:701] Row locks acquired
0926 13:55:33.015178 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:33.015348 (+ 170us) write_op.cc:270] Start()
0926 13:55:33.015452 (+ 104us) write_op.cc:276] Timestamp: P: 1790430933015297 usec, L: 0
0926 13:55:33.015474 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.016082 (+ 608us) log.cc:844] Serialized 744 byte log entry
0926 13:55:33.862138 (+846056us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.324435 (+462297us) write_op.cc:301] APPLY: starting
0926 13:55:34.324498 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.324710 (+ 212us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.324826 (+ 116us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.361573 (+ 36747us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.361827 (+ 254us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.361875 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:34.362107 (+ 232us) log.cc:844] Serialized 76 byte log entry
0926 13:55:34.362755 (+ 648us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.362856 (+ 101us) write_op.cc:454] Released schema lock
0926 13:55:34.362899 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":460539,"mutex_wait_us":2407,"num_ops":10,"prepare.queue_time_us":1148486,"prepare.run_cpu_time_us":3181,"prepare.run_wall_time_us":5562,"replication_time_us":846569}]]}
I20260926 13:55:34.367730 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=45, attempt_no=0}) took 3260 ms. Trace:
I20260926 13:55:34.348392 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=44, attempt_no=0}) took 3241 ms. Trace:
I20260926 13:55:34.369091 9554 rpcz_store.cc:276] 0926 13:55:31.106890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.107222 (+ 332us) service_pool.cc:224] Handling call
0926 13:55:34.348334 (+3241112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.739430 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:31.739907 (+ 477us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.739937 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:31.739956 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:31.799956 (+ 60000us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.802500 (+ 2544us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.802535 (+ 35us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:31.841531 (+ 38996us) tablet.cc:701] Row locks acquired
0926 13:55:31.841548 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:31.851024 (+ 9476us) write_op.cc:270] Start()
0926 13:55:31.858563 (+ 7539us) write_op.cc:276] Timestamp: P: 1790430931849724 usec, L: 0
0926 13:55:31.859457 (+ 894us) op_driver.cc:348] REPLICATION: starting
0926 13:55:31.871271 (+ 11814us) log.cc:844] Serialized 692 byte log entry
0926 13:55:33.816995 (+1945724us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.337680 (+520685us) write_op.cc:301] APPLY: starting
0926 13:55:34.337743 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.337946 (+ 203us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.338031 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.339336 (+ 1305us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.339515 (+ 179us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.339561 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:34.339783 (+ 222us) log.cc:844] Serialized 70 byte log entry
0926 13:55:34.347943 (+ 8160us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.348031 (+ 88us) write_op.cc:454] Released schema lock
0926 13:55:34.348071 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":520526,"mutex_wait_us":23350,"num_ops":9,"prepare.queue_time_us":622955,"prepare.run_cpu_time_us":4118,"prepare.run_wall_time_us":132078,"replication_time_us":1956360}]]}
I20260926 13:55:34.371737 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=73, attempt_no=0}) took 2946 ms. Trace:
I20260926 13:55:34.371930 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=64, attempt_no=0}) took 2921 ms. Trace:
I20260926 13:55:34.349715 9591 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=95, attempt_no=0}) took 2041 ms. Trace:
I20260926 13:55:34.372360 9579 rpcz_store.cc:276] 0926 13:55:31.458910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.459032 (+ 122us) service_pool.cc:224] Handling call
0926 13:55:34.371689 (+2912657us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.364147 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:32.364637 (+ 490us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.364663 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:32.364676 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:32.365338 (+ 662us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.365379 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.365409 (+ 30us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:32.365894 (+ 485us) tablet.cc:701] Row locks acquired
0926 13:55:32.365909 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:32.366067 (+ 158us) write_op.cc:270] Start()
0926 13:55:32.407409 (+ 41342us) write_op.cc:276] Timestamp: P: 1790430932366025 usec, L: 0
0926 13:55:32.409824 (+ 2415us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.488380 (+ 78556us) log.cc:844] Serialized 649 byte log entry
0926 13:55:33.843790 (+1355410us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.350478 (+506688us) write_op.cc:301] APPLY: starting
0926 13:55:34.350534 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.350689 (+ 155us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.350781 (+ 92us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.368196 (+ 17415us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.368339 (+ 143us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.368374 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:34.368558 (+ 184us) log.cc:844] Serialized 64 byte log entry
0926 13:55:34.368705 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.368804 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:34.368839 (+ 35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":506557,"num_ops":8,"prepare.queue_time_us":892443,"prepare.run_cpu_time_us":3401,"prepare.run_wall_time_us":128203,"raft.queue_time_us":47544,"raft.run_cpu_time_us":12,"raft.run_wall_time_us":11,"replication_time_us":1433859}]]}
I20260926 13:55:34.368134 9583 rpcz_store.cc:276] 0926 13:55:31.107273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.109123 (+ 1850us) service_pool.cc:224] Handling call
0926 13:55:34.367671 (+3258548us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:31.871637 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:31.872091 (+ 454us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:31.872117 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:31.872132 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:31.873019 (+ 887us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:31.873060 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:31.873088 (+ 28us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:31.967802 (+ 94714us) tablet.cc:701] Row locks acquired
0926 13:55:31.967826 (+ 24us) write_op.cc:260] PREPARE: finished
0926 13:55:31.986514 (+ 18688us) write_op.cc:270] Start()
0926 13:55:32.005168 (+ 18654us) write_op.cc:276] Timestamp: P: 1790430931978836 usec, L: 0
0926 13:55:32.005749 (+ 581us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.059365 (+ 53616us) log.cc:844] Serialized 950 byte log entry
0926 13:55:33.842330 (+1782965us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.343843 (+501513us) write_op.cc:301] APPLY: starting
0926 13:55:34.343906 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.344162 (+ 256us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.344244 (+ 82us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.366519 (+ 22275us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.366741 (+ 222us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.366795 (+ 54us) write_op.cc:312] APPLY: finished
0926 13:55:34.367067 (+ 272us) log.cc:844] Serialized 106 byte log entry
0926 13:55:34.367250 (+ 183us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.367363 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:34.367409 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":500157,"num_ops":15,"prepare.queue_time_us":720473,"prepare.run_cpu_time_us":4294,"prepare.run_wall_time_us":197143,"replication_time_us":1836484}]]}
I20260926 13:55:34.379742 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=42, attempt_no=0}) took 3297 ms. Trace:
I20260926 13:55:34.383285 9584 rpcz_store.cc:276] 0926 13:55:31.095486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.097947 (+ 2461us) service_pool.cc:224] Handling call
0926 13:55:34.379683 (+3281736us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.396215 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:32.396647 (+ 432us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.396676 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:32.396688 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:32.508446 (+111758us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.509863 (+ 1417us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.510787 (+ 924us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:32.521416 (+ 10629us) tablet.cc:701] Row locks acquired
0926 13:55:32.521440 (+ 24us) write_op.cc:260] PREPARE: finished
0926 13:55:32.521580 (+ 140us) write_op.cc:270] Start()
0926 13:55:32.521666 (+ 86us) write_op.cc:276] Timestamp: P: 1790430932521542 usec, L: 0
0926 13:55:32.521687 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.522251 (+ 564us) log.cc:844] Serialized 778 byte log entry
0926 13:55:33.843207 (+1320956us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.355146 (+511939us) write_op.cc:301] APPLY: starting
0926 13:55:34.373922 (+ 18776us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.376958 (+ 3036us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.377045 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.378447 (+ 1402us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.378803 (+ 356us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.378847 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:34.379086 (+ 239us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.379268 (+ 182us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.379368 (+ 100us) write_op.cc:454] Released schema lock
0926 13:55:34.379412 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":509369,"mutex_wait_us":410,"num_ops":11,"prepare.queue_time_us":1254706,"prepare.run_cpu_time_us":3997,"prepare.run_wall_time_us":126264,"replication_time_us":1318566}]]}
I20260926 13:55:34.391077 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=59, attempt_no=0}) took 2940 ms. Trace:
I20260926 13:55:34.326012 9564 rpcz_store.cc:276] 0926 13:55:31.192507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.193976 (+ 1469us) service_pool.cc:224] Handling call
0926 13:55:34.317782 (+3123806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.513387 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:32.513826 (+ 439us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.513852 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:32.513868 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:32.514736 (+ 868us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.514776 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.514803 (+ 27us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:32.516241 (+ 1438us) tablet.cc:701] Row locks acquired
0926 13:55:32.516261 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:32.516409 (+ 148us) write_op.cc:270] Start()
0926 13:55:32.516502 (+ 93us) write_op.cc:276] Timestamp: P: 1790430932516374 usec, L: 0
0926 13:55:32.516522 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.517075 (+ 553us) log.cc:844] Serialized 993 byte log entry
0926 13:55:33.818379 (+1301304us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.258875 (+440496us) write_op.cc:301] APPLY: starting
0926 13:55:34.258944 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.259240 (+ 296us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.259341 (+ 101us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.316617 (+ 57276us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.316859 (+ 242us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.316902 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.317187 (+ 285us) log.cc:844] Serialized 112 byte log entry
0926 13:55:34.317357 (+ 170us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.317469 (+ 112us) write_op.cc:454] Released schema lock
0926 13:55:34.317515 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":440348,"num_ops":16,"prepare.queue_time_us":1217778,"prepare.run_cpu_time_us":3490,"prepare.run_wall_time_us":11196,"replication_time_us":1301757}]]}
I20260926 13:55:34.376999 9591 rpcz_store.cc:276] 0926 13:55:32.308669 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.308819 (+ 150us) service_pool.cc:224] Handling call
0926 13:55:34.349660 (+2040841us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.072115 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:33.075481 (+ 3366us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.075508 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:33.075524 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:33.076246 (+ 722us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.076283 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.076315 (+ 32us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:33.076959 (+ 644us) tablet.cc:701] Row locks acquired
0926 13:55:33.076974 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:33.077132 (+ 158us) write_op.cc:270] Start()
0926 13:55:33.077222 (+ 90us) write_op.cc:276] Timestamp: P: 1790430933077085 usec, L: 0
0926 13:55:33.077242 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.077765 (+ 523us) log.cc:844] Serialized 787 byte log entry
0926 13:55:33.888438 (+810673us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.345525 (+457087us) write_op.cc:301] APPLY: starting
0926 13:55:34.345586 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.345795 (+ 209us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.345884 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.347292 (+ 1408us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.347549 (+ 257us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.347589 (+ 40us) write_op.cc:312] APPLY: finished
0926 13:55:34.348612 (+ 1023us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.349257 (+ 645us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.349367 (+ 110us) write_op.cc:454] Released schema lock
0926 13:55:34.349407 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":455982,"mutex_wait_us":35004,"num_ops":11,"prepare.queue_time_us":730136,"prepare.run_cpu_time_us":3021,"prepare.run_wall_time_us":5899,"replication_time_us":808181}]]}
I20260926 13:55:34.401659 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=56, attempt_no=0}) took 3027 ms. Trace:
I20260926 13:55:34.402045 9583 rpcz_store.cc:276] 0926 13:55:31.386274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.387466 (+ 1192us) service_pool.cc:224] Handling call
0926 13:55:34.401602 (+3014136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.575213 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:32.594621 (+ 19408us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.594648 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:32.594664 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:32.716904 (+122240us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.716948 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.716974 (+ 26us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:32.717920 (+ 946us) tablet.cc:701] Row locks acquired
0926 13:55:32.717939 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:32.718085 (+ 146us) write_op.cc:270] Start()
0926 13:55:32.718196 (+ 111us) write_op.cc:276] Timestamp: P: 1790430932718050 usec, L: 0
0926 13:55:32.718216 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.718831 (+ 615us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:33.873502 (+1154671us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.383780 (+510278us) write_op.cc:301] APPLY: starting
0926 13:55:34.383842 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.384152 (+ 310us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.384244 (+ 92us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.386699 (+ 2455us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.386968 (+ 269us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.387013 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:34.387334 (+ 321us) log.cc:844] Serialized 124 byte log entry
0926 13:55:34.401153 (+ 13819us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.401274 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:34.401321 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":508567,"num_ops":18,"prepare.queue_time_us":1150182,"prepare.run_cpu_time_us":4784,"prepare.run_wall_time_us":153488,"replication_time_us":1145965}]]}
I20260926 13:55:34.395480 9554 rpcz_store.cc:276] 0926 13:55:31.450256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.459250 (+ 8994us) service_pool.cc:224] Handling call
0926 13:55:34.391021 (+2931771us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.725142 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:32.831801 (+106659us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.832630 (+ 829us) write_op.cc:435] Acquired schema lock
0926 13:55:32.833583 (+ 953us) tablet.cc:662] Decoding operations
0926 13:55:32.867420 (+ 33837us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.867465 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.867492 (+ 27us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:32.868029 (+ 537us) tablet.cc:701] Row locks acquired
0926 13:55:32.868044 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:32.868200 (+ 156us) write_op.cc:270] Start()
0926 13:55:32.868294 (+ 94us) write_op.cc:276] Timestamp: P: 1790430932868159 usec, L: 0
0926 13:55:32.868314 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.910564 (+ 42250us) log.cc:844] Serialized 735 byte log entry
0926 13:55:33.888400 (+977836us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.388957 (+500557us) write_op.cc:301] APPLY: starting
0926 13:55:34.389021 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.389214 (+ 193us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.389299 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.390184 (+ 885us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.390310 (+ 126us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.390337 (+ 27us) write_op.cc:312] APPLY: finished
0926 13:55:34.390494 (+ 157us) log.cc:844] Serialized 76 byte log entry
0926 13:55:34.390633 (+ 139us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.390725 (+ 92us) write_op.cc:454] Released schema lock
0926 13:55:34.390765 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":499251,"num_ops":10,"prepare.queue_time_us":1175119,"prepare.run_cpu_time_us":3891,"prepare.run_wall_time_us":190809,"replication_time_us":1015278}]]}
I20260926 13:55:34.361424 9578 rpcz_store.cc:276] 0926 13:55:31.656270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.657005 (+ 735us) service_pool.cc:224] Handling call
0926 13:55:34.360931 (+2703926us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.710701 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 41c702c434fc4bcb828c246a7017a83a
0926 13:55:32.788348 (+ 77647us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.803946 (+ 15598us) write_op.cc:435] Acquired schema lock
0926 13:55:32.817607 (+ 13661us) tablet.cc:662] Decoding operations
0926 13:55:32.853589 (+ 35982us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.853633 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.853665 (+ 32us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:32.854566 (+ 901us) tablet.cc:701] Row locks acquired
0926 13:55:32.854584 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:32.854753 (+ 169us) write_op.cc:270] Start()
0926 13:55:32.890731 (+ 35978us) write_op.cc:276] Timestamp: P: 1790430932854710 usec, L: 0
0926 13:55:32.891783 (+ 1052us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.919559 (+ 27776us) log.cc:844] Serialized 959 byte log entry
0926 13:55:33.861557 (+941998us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.321852 (+460295us) write_op.cc:301] APPLY: starting
0926 13:55:34.321918 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.322172 (+ 254us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.322270 (+ 98us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.359317 (+ 37047us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.359530 (+ 213us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.359572 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.359834 (+ 262us) log.cc:844] Serialized 106 byte log entry
0926 13:55:34.360477 (+ 643us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.360590 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:34.360640 (+ 50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":131840,"child_traces":[["op",{"apply.queue_time_us":460147,"mutex_wait_us":114547,"num_ops":15,"prepare.queue_time_us":959148,"prepare.run_cpu_time_us":6107,"prepare.run_wall_time_us":257909,"replication_time_us":969657}]]}
I20260926 13:55:34.419050 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=85, attempt_no=0}) took 2695 ms. Trace:
I20260926 13:55:34.431185 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=72, attempt_no=0}) took 2959 ms. Trace:
I20260926 13:55:34.372128 9566 rpcz_store.cc:276] 0926 13:55:31.425096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.432342 (+ 7246us) service_pool.cc:224] Handling call
0926 13:55:34.371676 (+2939334us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.166925 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:33.174544 (+ 7619us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.174575 (+ 31us) write_op.cc:435] Acquired schema lock
0926 13:55:33.174594 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:33.175496 (+ 902us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.175543 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.175570 (+ 27us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:33.178737 (+ 3167us) tablet.cc:701] Row locks acquired
0926 13:55:33.178756 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:33.181727 (+ 2971us) write_op.cc:270] Start()
0926 13:55:33.183786 (+ 2059us) write_op.cc:276] Timestamp: P: 1790430933180016 usec, L: 0
0926 13:55:33.183807 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.236738 (+ 52931us) log.cc:844] Serialized 907 byte log entry
0926 13:55:33.511909 (+275171us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540002fba0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:33.776656 (+264747us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b58001c6ad0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb0977796c 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5 00007fdb02db8751
0926 13:55:33.906523 (+129867us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.368426 (+461903us) write_op.cc:301] APPLY: starting
0926 13:55:34.368487 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.368720 (+ 233us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.368739 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.370582 (+ 1843us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.370792 (+ 210us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.370836 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:34.371092 (+ 256us) log.cc:844] Serialized 100 byte log entry
0926 13:55:34.371265 (+ 173us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.371369 (+ 104us) write_op.cc:454] Released schema lock
0926 13:55:34.371417 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":461742,"num_ops":14,"prepare.queue_time_us":1560633,"prepare.run_cpu_time_us":7067,"prepare.run_wall_time_us":348189,"raft.queue_time_us":5510,"raft.run_cpu_time_us":11424,"raft.run_wall_time_us":254244,"replication_time_us":722611,"spinlock_wait_cycles":602359936}]]}
I20260926 13:55:34.432072 9579 rpcz_store.cc:276] 0926 13:55:31.471705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.476570 (+ 4865us) service_pool.cc:224] Handling call
0926 13:55:34.431131 (+2954561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.666828 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:32.667296 (+ 468us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.667323 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:32.667336 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:32.668114 (+ 778us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.668158 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.668184 (+ 26us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:32.741664 (+ 73480us) tablet.cc:701] Row locks acquired
0926 13:55:32.750130 (+ 8466us) write_op.cc:260] PREPARE: finished
0926 13:55:32.751744 (+ 1614us) write_op.cc:270] Start()
0926 13:55:32.751843 (+ 99us) write_op.cc:276] Timestamp: P: 1790430932751703 usec, L: 0
0926 13:55:32.751864 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.752427 (+ 563us) log.cc:844] Serialized 864 byte log entry
0926 13:55:33.980993 (+1228566us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.425413 (+444420us) write_op.cc:301] APPLY: starting
0926 13:55:34.425472 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.425658 (+ 186us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.425736 (+ 78us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.427157 (+ 1421us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.427321 (+ 164us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.427354 (+ 33us) write_op.cc:312] APPLY: finished
0926 13:55:34.427553 (+ 199us) log.cc:844] Serialized 94 byte log entry
0926 13:55:34.430756 (+ 3203us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.430846 (+ 90us) write_op.cc:454] Released schema lock
0926 13:55:34.430893 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":444267,"num_ops":13,"prepare.queue_time_us":1073928,"prepare.run_cpu_time_us":3383,"prepare.run_wall_time_us":86966,"replication_time_us":1229018}]]}
I20260926 13:55:34.444499 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=92, attempt_no=0}) took 1977 ms. Trace:
I20260926 13:55:34.444834 9554 rpcz_store.cc:276] 0926 13:55:32.466678 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.472384 (+ 5706us) service_pool.cc:224] Handling call
0926 13:55:32.625930 (+153546us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:34.444447 (+1818517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.151252 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:33.152507 (+ 1255us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.154471 (+ 1964us) write_op.cc:435] Acquired schema lock
0926 13:55:33.155994 (+ 1523us) tablet.cc:662] Decoding operations
0926 13:55:33.160764 (+ 4770us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.160808 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.160833 (+ 25us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:33.161451 (+ 618us) tablet.cc:701] Row locks acquired
0926 13:55:33.161471 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:33.161615 (+ 144us) write_op.cc:270] Start()
0926 13:55:33.161709 (+ 94us) write_op.cc:276] Timestamp: P: 1790430933161578 usec, L: 0
0926 13:55:33.161731 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.173610 (+ 11879us) log.cc:844] Serialized 787 byte log entry
0926 13:55:33.981479 (+807869us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.441879 (+460400us) write_op.cc:301] APPLY: starting
0926 13:55:34.441933 (+ 54us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.442101 (+ 168us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.442177 (+ 76us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.443502 (+ 1325us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.443719 (+ 217us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.443755 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:34.443939 (+ 184us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.444081 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.444168 (+ 87us) write_op.cc:454] Released schema lock
0926 13:55:34.444207 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":34863872,"child_traces":[["op",{"apply.queue_time_us":460273,"num_ops":11,"prepare.queue_time_us":369613,"prepare.run_cpu_time_us":3150,"prepare.run_wall_time_us":30939,"replication_time_us":819662,"spinlock_wait_cycles":2432}]]}
I20260926 13:55:34.448477 9586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=86, attempt_no=0}) took 2607 ms. Trace:
I20260926 13:55:34.448490 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=79, attempt_no=0}) took 2786 ms. Trace:
I20260926 13:55:34.452347 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=93, attempt_no=0}) took 2171 ms. Trace:
I20260926 13:55:34.419433 9584 rpcz_store.cc:276] 0926 13:55:31.732447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.732636 (+ 189us) service_pool.cc:224] Handling call
0926 13:55:34.418993 (+2686357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.912485 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:32.912956 (+ 471us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.912982 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:32.912999 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:32.926397 (+ 13398us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.926448 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.926475 (+ 27us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:32.927362 (+ 887us) tablet.cc:701] Row locks acquired
0926 13:55:32.927380 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:32.927537 (+ 157us) write_op.cc:270] Start()
0926 13:55:32.927632 (+ 95us) write_op.cc:276] Timestamp: P: 1790430932927498 usec, L: 0
0926 13:55:32.927650 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.981573 (+ 53923us) log.cc:844] Serialized 1002 byte log entry
0926 13:55:32.983600 (+ 2027us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b540022e554. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:33.897943 (+914343us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.393990 (+496047us) write_op.cc:301] APPLY: starting
0926 13:55:34.394052 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.394318 (+ 266us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.394340 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.417862 (+ 23522us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.418079 (+ 217us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.418121 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.418412 (+ 291us) log.cc:844] Serialized 112 byte log entry
0926 13:55:34.418578 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.418691 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:34.418737 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":494499,"num_ops":16,"prepare.queue_time_us":1088127,"prepare.run_cpu_time_us":4809,"prepare.run_wall_time_us":71254,"replication_time_us":965824,"spinlock_wait_cycles":35729280}]]}
I20260926 13:55:34.450551 9579 rpcz_store.cc:276] 0926 13:55:31.662254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.664205 (+ 1951us) service_pool.cc:224] Handling call
0926 13:55:34.447078 (+2782873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.753920 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:32.833628 (+ 79708us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.874165 (+ 40537us) write_op.cc:435] Acquired schema lock
0926 13:55:32.885733 (+ 11568us) tablet.cc:662] Decoding operations
0926 13:55:33.007681 (+121948us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.008334 (+ 653us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.008987 (+ 653us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:33.129093 (+120106us) tablet.cc:701] Row locks acquired
0926 13:55:33.129116 (+ 23us) write_op.cc:260] PREPARE: finished
0926 13:55:33.129275 (+ 159us) write_op.cc:270] Start()
0926 13:55:33.129381 (+ 106us) write_op.cc:276] Timestamp: P: 1790430933129236 usec, L: 0
0926 13:55:33.129401 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.129966 (+ 565us) log.cc:844] Serialized 873 byte log entry
0926 13:55:33.981261 (+851295us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.441290 (+460029us) write_op.cc:301] APPLY: starting
0926 13:55:34.441345 (+ 55us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.441537 (+ 192us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.441617 (+ 80us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.443157 (+ 1540us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.443321 (+ 164us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.443356 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:34.443579 (+ 223us) log.cc:844] Serialized 94 byte log entry
0926 13:55:34.446711 (+ 3132us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.446807 (+ 96us) write_op.cc:454] Released schema lock
0926 13:55:34.446846 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":459879,"mutex_wait_us":629,"num_ops":13,"prepare.queue_time_us":968846,"prepare.run_cpu_time_us":8883,"prepare.run_wall_time_us":377245,"replication_time_us":851759}]]}
I20260926 13:55:34.448918 9586 rpcz_store.cc:276] 0926 13:55:31.849445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.850755 (+ 1310us) service_pool.cc:224] Handling call
0926 13:55:34.448416 (+2597661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.457813 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:32.520715 (+ 62902us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.523194 (+ 2479us) write_op.cc:435] Acquired schema lock
0926 13:55:32.524526 (+ 1332us) tablet.cc:662] Decoding operations
0926 13:55:32.775950 (+251424us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.779020 (+ 3070us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.788166 (+ 9146us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:32.863842 (+ 75676us) tablet.cc:701] Row locks acquired
0926 13:55:32.863863 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:32.864026 (+ 163us) write_op.cc:270] Start()
0926 13:55:32.864129 (+ 103us) write_op.cc:276] Timestamp: P: 1790430932863989 usec, L: 0
0926 13:55:32.864151 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.865328 (+ 1177us) log.cc:844] Serialized 959 byte log entry
0926 13:55:33.936374 (+1071046us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.388202 (+451828us) write_op.cc:301] APPLY: starting
0926 13:55:34.388266 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.388526 (+ 260us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.388609 (+ 83us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.390553 (+ 1944us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.390769 (+ 216us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.390810 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:34.404267 (+ 13457us) log.cc:844] Serialized 106 byte log entry
0926 13:55:34.441319 (+ 37052us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.448050 (+ 6731us) write_op.cc:454] Released schema lock
0926 13:55:34.448106 (+ 56us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":451671,"mutex_wait_us":18584,"num_ops":15,"prepare.queue_time_us":400816,"prepare.run_cpu_time_us":5745,"prepare.run_wall_time_us":409101,"replication_time_us":1072126}]]}
I20260926 13:55:34.470172 9564 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=80, attempt_no=0}) took 2814 ms. Trace:
I20260926 13:55:34.481288 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=94, attempt_no=0}) took 2014 ms. Trace:
I20260926 13:55:34.481577 9608 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=82, attempt_no=0}) took 2755 ms. Trace:
I20260926 13:55:34.483282 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=81, attempt_no=0}) took 2815 ms. Trace:
I20260926 13:55:34.483870 9566 rpcz_store.cc:276] 0926 13:55:31.684143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.710938 (+ 26795us) service_pool.cc:224] Handling call
0926 13:55:34.483225 (+2772287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.556408 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:33.706940 (+150532us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.707944 (+ 1004us) write_op.cc:435] Acquired schema lock
0926 13:55:33.707958 (+ 14us) tablet.cc:662] Decoding operations
0926 13:55:33.736791 (+ 28833us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.736841 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.736869 (+ 28us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:33.737502 (+ 633us) tablet.cc:701] Row locks acquired
0926 13:55:33.737520 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:33.766900 (+ 29380us) write_op.cc:270] Start()
0926 13:55:33.773344 (+ 6444us) write_op.cc:276] Timestamp: P: 1790430933737648 usec, L: 0
0926 13:55:33.773402 (+ 58us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.774023 (+ 621us) log.cc:844] Serialized 787 byte log entry
0926 13:55:34.015775 (+241752us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.479806 (+464031us) write_op.cc:301] APPLY: starting
0926 13:55:34.479867 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.480076 (+ 209us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.480157 (+ 81us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.481585 (+ 1428us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.481847 (+ 262us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.481889 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.482132 (+ 243us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.482825 (+ 693us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.482925 (+ 100us) write_op.cc:454] Released schema lock
0926 13:55:34.482969 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":463877,"mutex_wait_us":13022,"num_ops":11,"prepare.queue_time_us":1710915,"prepare.run_cpu_time_us":5841,"prepare.run_wall_time_us":234690,"replication_time_us":242279}]]}
I20260926 13:55:34.452764 9557 rpcz_store.cc:276] 0926 13:55:32.300653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.300898 (+ 245us) service_pool.cc:224] Handling call
0926 13:55:34.452288 (+2151390us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.890119 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:32.891445 (+ 1326us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.891474 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:32.891492 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:32.902076 (+ 10584us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.902122 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.902147 (+ 25us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:32.902642 (+ 495us) tablet.cc:701] Row locks acquired
0926 13:55:32.902661 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:32.910476 (+ 7815us) write_op.cc:270] Start()
0926 13:55:32.917182 (+ 6706us) write_op.cc:276] Timestamp: P: 1790430932908482 usec, L: 0
0926 13:55:32.921031 (+ 3849us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.951451 (+ 30420us) log.cc:844] Serialized 658 byte log entry
0926 13:55:33.936977 (+985526us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.421656 (+484679us) write_op.cc:301] APPLY: starting
0926 13:55:34.447575 (+ 25919us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b60001941c8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09bdd1a1 00007fdb09d4d8eb 00007fdb09d4ff14 00007fdb09cc08eb 00007fdb09bbda93 00007fdb09bbfdc8 00007fdb09cbf044 00007fdb09caab8c 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9
0926 13:55:34.447644 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.447833 (+ 189us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.447855 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.451339 (+ 3484us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.451519 (+ 180us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.451558 (+ 39us) write_op.cc:312] APPLY: finished
0926 13:55:34.451753 (+ 195us) log.cc:844] Serialized 64 byte log entry
0926 13:55:34.451906 (+ 153us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.451998 (+ 92us) write_op.cc:454] Released schema lock
0926 13:55:34.452039 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":484531,"mutex_wait_us":113831,"num_ops":8,"prepare.queue_time_us":541781,"prepare.run_cpu_time_us":4279,"prepare.run_wall_time_us":61621,"replication_time_us":1008790,"spinlock_wait_cycles":47496576}]]}
I20260926 13:55:34.483233 9608 rpcz_store.cc:276] 0926 13:55:31.753532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.786869 (+ 33337us) service_pool.cc:224] Handling call
0926 13:55:34.481518 (+2694649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.223108 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:33.258485 (+ 35377us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.261408 (+ 2923us) write_op.cc:435] Acquired schema lock
0926 13:55:33.261419 (+ 11us) tablet.cc:662] Decoding operations
0926 13:55:33.274031 (+ 12612us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.274061 (+ 30us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.274078 (+ 17us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:33.291222 (+ 17144us) tablet.cc:701] Row locks acquired
0926 13:55:33.292890 (+ 1668us) write_op.cc:260] PREPARE: finished
0926 13:55:33.322861 (+ 29971us) write_op.cc:270] Start()
0926 13:55:33.326914 (+ 4053us) write_op.cc:276] Timestamp: P: 1790430933302038 usec, L: 0
0926 13:55:33.327521 (+ 607us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.518987 (+191466us) log.cc:844] Serialized 873 byte log entry
0926 13:55:33.692501 (+173514us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54000a73d4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:34.007169 (+314668us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.473463 (+466294us) write_op.cc:301] APPLY: starting
0926 13:55:34.473526 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.473757 (+ 231us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.473780 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.479859 (+ 6079us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.480084 (+ 225us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.480510 (+ 426us) write_op.cc:312] APPLY: finished
0926 13:55:34.480960 (+ 450us) log.cc:844] Serialized 94 byte log entry
0926 13:55:34.481118 (+ 158us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.481217 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:34.481262 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":458911,"num_ops":13,"prepare.queue_time_us":1415644,"prepare.run_cpu_time_us":16220,"prepare.run_wall_time_us":475562,"replication_time_us":678273,"spinlock_wait_cycles":433949568}]]}
I20260926 13:55:34.490976 9586 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=96, attempt_no=0}) took 2182 ms. Trace:
I20260926 13:55:34.492950 9586 rpcz_store.cc:276] 0926 13:55:32.308299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.308616 (+ 317us) service_pool.cc:224] Handling call
0926 13:55:34.490917 (+2182301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.692832 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:33.693244 (+ 412us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.693285 (+ 41us) write_op.cc:435] Acquired schema lock
0926 13:55:33.693299 (+ 14us) tablet.cc:662] Decoding operations
0926 13:55:33.694083 (+ 784us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.694124 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.694152 (+ 28us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:33.694929 (+ 777us) tablet.cc:701] Row locks acquired
0926 13:55:33.694950 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:33.844164 (+149214us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b2c0004bfa8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:33.844219 (+ 55us) write_op.cc:270] Start()
0926 13:55:33.844392 (+ 173us) write_op.cc:276] Timestamp: P: 1790430933698566 usec, L: 0
0926 13:55:33.844411 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.865097 (+ 20686us) log.cc:844] Serialized 830 byte log entry
0926 13:55:34.007423 (+142326us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.471532 (+464109us) write_op.cc:301] APPLY: starting
0926 13:55:34.471599 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.471811 (+ 212us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.471831 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.473477 (+ 1646us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.473673 (+ 196us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.473715 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.473958 (+ 243us) log.cc:844] Serialized 88 byte log entry
0926 13:55:34.480338 (+ 6380us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.480452 (+ 114us) write_op.cc:454] Released schema lock
0926 13:55:34.480499 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":463964,"mutex_wait_us":100639,"num_ops":12,"prepare.queue_time_us":1350102,"prepare.run_cpu_time_us":6687,"prepare.run_wall_time_us":173915,"replication_time_us":162905,"spinlock_wait_cycles":8051584}]]}
I20260926 13:55:34.492581 9571 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59510 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=90, attempt_no=0}) took 2227 ms. Trace:
I20260926 13:55:34.498780 9571 rpcz_store.cc:276] 0926 13:55:32.265152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.265271 (+ 119us) service_pool.cc:224] Handling call
0926 13:55:32.421994 (+156723us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b54000b2628. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0b7ed641 00007fdb0b8680fc 00007fdb0b89abec 00007fdb0b886cbb 00007fdb0b884fa2 00007fdb09f87084 00007fdb09f87012 00007fdb09f86f41 00007fdb09f86ebc 00007fdb09f86172 00007fdb079ed09c
0926 13:55:34.492529 (+2070535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.159892 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:33.209239 (+ 49347us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.211138 (+ 1899us) write_op.cc:435] Acquired schema lock
0926 13:55:33.216780 (+ 5642us) tablet.cc:662] Decoding operations
0926 13:55:33.245292 (+ 28512us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.245334 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.245365 (+ 31us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:33.246222 (+ 857us) tablet.cc:701] Row locks acquired
0926 13:55:33.246240 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:33.484715 (+238475us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b340003d0b8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:33.484838 (+ 123us) write_op.cc:270] Start()
0926 13:55:33.485035 (+ 197us) write_op.cc:276] Timestamp: P: 1790430933484797 usec, L: 0
0926 13:55:33.485055 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.485642 (+ 587us) log.cc:844] Serialized 959 byte log entry
0926 13:55:34.076043 (+590401us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.477110 (+401067us) write_op.cc:301] APPLY: starting
0926 13:55:34.477166 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.477380 (+ 214us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.477398 (+ 18us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.491571 (+ 14173us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.491741 (+ 170us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.491777 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:34.491995 (+ 218us) log.cc:844] Serialized 106 byte log entry
0926 13:55:34.492135 (+ 140us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.492231 (+ 96us) write_op.cc:454] Released schema lock
0926 13:55:34.492268 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":12352256,"child_traces":[["op",{"apply.queue_time_us":400906,"num_ops":15,"prepare.queue_time_us":730607,"prepare.run_cpu_time_us":18159,"prepare.run_wall_time_us":330835,"replication_time_us":585698,"spinlock_wait_cycles":2305920}]]}
I20260926 13:55:34.486193 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=99, attempt_no=0}) took 1927 ms. Trace:
I20260926 13:55:34.506615 9584 rpcz_store.cc:276] 0926 13:55:32.578147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.585314 (+ 7167us) service_pool.cc:224] Handling call
0926 13:55:34.486136 (+1900822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.131304 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:33.132737 (+ 1433us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.144104 (+ 11367us) write_op.cc:435] Acquired schema lock
0926 13:55:33.146613 (+ 2509us) tablet.cc:662] Decoding operations
0926 13:55:33.188199 (+ 41586us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.188240 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.194176 (+ 5936us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:33.197957 (+ 3781us) tablet.cc:701] Row locks acquired
0926 13:55:33.197975 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:33.198121 (+ 146us) write_op.cc:270] Start()
0926 13:55:33.198231 (+ 110us) write_op.cc:276] Timestamp: P: 1790430933198082 usec, L: 0
0926 13:55:33.198246 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.198785 (+ 539us) log.cc:844] Serialized 1002 byte log entry
0926 13:55:34.018907 (+820122us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.469566 (+450659us) write_op.cc:301] APPLY: starting
0926 13:55:34.482480 (+ 12914us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b60000c29c8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09bdd1a1 00007fdb09d4d8eb 00007fdb09d4ff14 00007fdb09cc08eb 00007fdb09bbda93 00007fdb09bbfdc8 00007fdb09cbf044 00007fdb09caab8c 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9
0926 13:55:34.482550 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.482840 (+ 290us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.482862 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.485028 (+ 2166us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.485246 (+ 218us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.485289 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:34.485577 (+ 288us) log.cc:844] Serialized 112 byte log entry
0926 13:55:34.485726 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.485839 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:34.485885 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":450514,"num_ops":16,"prepare.queue_time_us":242816,"prepare.run_cpu_time_us":3891,"prepare.run_wall_time_us":67696,"replication_time_us":820563,"spinlock_wait_cycles":16132864}]]}
I20260926 13:55:34.481684 9583 rpcz_store.cc:276] 0926 13:55:32.467005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.472832 (+ 5827us) service_pool.cc:224] Handling call
0926 13:55:32.538242 (+ 65410us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:34.481228 (+1942986us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.007255 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 04729c698ede46c78868c2040e9ad38b
0926 13:55:33.069796 (+ 62541us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.069831 (+ 35us) write_op.cc:435] Acquired schema lock
0926 13:55:33.070294 (+ 463us) tablet.cc:662] Decoding operations
0926 13:55:33.078215 (+ 7921us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.078253 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.078278 (+ 25us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:33.087792 (+ 9514us) tablet.cc:701] Row locks acquired
0926 13:55:33.087811 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:33.087959 (+ 148us) write_op.cc:270] Start()
0926 13:55:33.088051 (+ 92us) write_op.cc:276] Timestamp: P: 1790430933087920 usec, L: 0
0926 13:55:33.088070 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.095664 (+ 7594us) log.cc:844] Serialized 830 byte log entry
0926 13:55:34.018673 (+923009us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.443387 (+424714us) write_op.cc:301] APPLY: starting
0926 13:55:34.443454 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.443678 (+ 224us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.443763 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.445300 (+ 1537us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.445507 (+ 207us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.445548 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:34.445792 (+ 244us) log.cc:844] Serialized 88 byte log entry
0926 13:55:34.480798 (+ 35006us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.480918 (+ 120us) write_op.cc:454] Released schema lock
0926 13:55:34.480962 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":29882752,"child_traces":[["op",{"apply.queue_time_us":424559,"mutex_wait_us":716,"num_ops":12,"prepare.queue_time_us":97554,"prepare.run_cpu_time_us":4024,"prepare.run_wall_time_us":120148,"replication_time_us":930504}]]}
I20260926 13:55:34.498149 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=98, attempt_no=0}) took 2181 ms. Trace:
I20260926 13:55:34.523593 9566 rpcz_store.cc:276] 0926 13:55:32.398718 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.418426 (+ 19708us) service_pool.cc:224] Handling call
0926 13:55:34.498095 (+2079669us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.796997 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 5140fbbd182b49f993534b84130a185b
0926 13:55:33.797464 (+ 467us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.797494 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:33.797507 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:33.798443 (+ 936us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.798485 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.798509 (+ 24us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:33.799471 (+ 962us) tablet.cc:701] Row locks acquired
0926 13:55:33.799487 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:33.799635 (+ 148us) write_op.cc:270] Start()
0926 13:55:33.799728 (+ 93us) write_op.cc:276] Timestamp: P: 1790430933799594 usec, L: 0
0926 13:55:33.799747 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.800282 (+ 535us) log.cc:844] Serialized 1045 byte log entry
0926 13:55:34.016018 (+215736us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.488405 (+472387us) write_op.cc:301] APPLY: starting
0926 13:55:34.488465 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.488783 (+ 318us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.488884 (+ 101us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.496602 (+ 7718us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.496841 (+ 239us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.496887 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:34.497172 (+ 285us) log.cc:844] Serialized 118 byte log entry
0926 13:55:34.497331 (+ 159us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.497448 (+ 117us) write_op.cc:454] Released schema lock
0926 13:55:34.497492 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":472238,"mutex_wait_us":40238,"num_ops":17,"prepare.queue_time_us":1374441,"prepare.run_cpu_time_us":3510,"prepare.run_wall_time_us":4674,"replication_time_us":216191}]]}
I20260926 13:55:34.470588 9564 rpcz_store.cc:276] 0926 13:55:31.655882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.656416 (+ 534us) service_pool.cc:224] Handling call
0926 13:55:34.470111 (+2813695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.078144 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 802f137e22714b5ea0ee9530e62d2db1
0926 13:55:33.128211 (+ 50067us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.130148 (+ 1937us) write_op.cc:435] Acquired schema lock
0926 13:55:33.131564 (+ 1416us) tablet.cc:662] Decoding operations
0926 13:55:33.136533 (+ 4969us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.136579 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.136606 (+ 27us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:33.137493 (+ 887us) tablet.cc:701] Row locks acquired
0926 13:55:33.137512 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:33.137726 (+ 214us) write_op.cc:270] Start()
0926 13:55:33.137821 (+ 95us) write_op.cc:276] Timestamp: P: 1790430933137684 usec, L: 0
0926 13:55:33.137841 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.138424 (+ 583us) log.cc:844] Serialized 830 byte log entry
0926 13:55:34.041590 (+903166us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.454848 (+413258us) write_op.cc:301] APPLY: starting
0926 13:55:34.467138 (+ 12290us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.467372 (+ 234us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.467461 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.469067 (+ 1606us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.469263 (+ 196us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.469305 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.469556 (+ 251us) log.cc:844] Serialized 88 byte log entry
0926 13:55:34.469718 (+ 162us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.469813 (+ 95us) write_op.cc:454] Released schema lock
0926 13:55:34.469857 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":13568,"child_traces":[["op",{"apply.queue_time_us":397591,"mutex_wait_us":56321,"num_ops":12,"prepare.queue_time_us":1384699,"prepare.run_cpu_time_us":3623,"prepare.run_wall_time_us":69144,"replication_time_us":901969,"spinlock_wait_cycles":40320}]]}
I20260926 13:55:34.570878 9579 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=74, attempt_no=0}) took 3052 ms. Trace:
I20260926 13:55:34.571164 9579 rpcz_store.cc:276] 0926 13:55:31.535364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.540113 (+ 4749us) service_pool.cc:224] Handling call
0926 13:55:34.570822 (+3030709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.713892 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:32.714345 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.714370 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:32.714386 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:32.715088 (+ 702us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.715130 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.715159 (+ 29us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:32.715644 (+ 485us) tablet.cc:701] Row locks acquired
0926 13:55:32.715661 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:32.715804 (+ 143us) write_op.cc:270] Start()
0926 13:55:32.715913 (+ 109us) write_op.cc:276] Timestamp: P: 1790430932715769 usec, L: 0
0926 13:55:32.715930 (+ 17us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.716466 (+ 536us) log.cc:844] Serialized 692 byte log entry
0926 13:55:34.082841 (+1366375us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.549718 (+466877us) write_op.cc:301] APPLY: starting
0926 13:55:34.549776 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.549939 (+ 163us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.550019 (+ 80us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.568311 (+ 18292us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.568468 (+ 157us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.568505 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:34.568682 (+ 177us) log.cc:844] Serialized 70 byte log entry
0926 13:55:34.568870 (+ 188us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.568946 (+ 76us) write_op.cc:454] Released schema lock
0926 13:55:34.569008 (+ 62us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":466736,"num_ops":9,"prepare.queue_time_us":1067313,"prepare.run_cpu_time_us":2803,"prepare.run_wall_time_us":2803,"replication_time_us":1366823}]]}
I20260926 13:55:34.586184 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=91, attempt_no=0}) took 2166 ms. Trace:
I20260926 13:55:34.586602 9584 rpcz_store.cc:276] 0926 13:55:32.465897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.467115 (+ 1218us) service_pool.cc:224] Handling call
0926 13:55:32.666070 (+198955us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b340004fef8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:34.586123 (+1920053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.886278 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:32.886745 (+ 467us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.886769 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:32.886781 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:32.887606 (+ 825us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.887646 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.887673 (+ 27us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:32.910436 (+ 22763us) tablet.cc:701] Row locks acquired
0926 13:55:32.913800 (+ 3364us) write_op.cc:260] PREPARE: finished
0926 13:55:32.917854 (+ 4054us) write_op.cc:270] Start()
0926 13:55:33.003752 (+ 85898us) write_op.cc:276] Timestamp: P: 1790430932917814 usec, L: 0
0926 13:55:33.004825 (+ 1073us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.055420 (+ 50595us) log.cc:844] Serialized 873 byte log entry
0926 13:55:34.083060 (+1027640us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.556724 (+473664us) write_op.cc:301] APPLY: starting
0926 13:55:34.556802 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.557037 (+ 235us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.557128 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.575652 (+ 18524us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.575876 (+ 224us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.575920 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:34.576173 (+ 253us) log.cc:844] Serialized 94 byte log entry
0926 13:55:34.576307 (+ 134us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.576404 (+ 97us) write_op.cc:454] Released schema lock
0926 13:55:34.576449 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":7435648,"child_traces":[["op",{"apply.queue_time_us":473531,"mutex_wait_us":97230,"num_ops":13,"prepare.queue_time_us":97330,"prepare.run_cpu_time_us":16146,"prepare.run_wall_time_us":172146,"replication_time_us":1078152}]]}
I20260926 13:55:34.605481 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=71, attempt_no=0}) took 3134 ms. Trace:
I20260926 13:55:34.605901 9583 rpcz_store.cc:276] 0926 13:55:31.471340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.478122 (+ 6782us) service_pool.cc:224] Handling call
0926 13:55:34.605425 (+3127303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.498174 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:32.511466 (+ 13292us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.511494 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:32.511506 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:32.512254 (+ 748us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.512291 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.512317 (+ 26us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:32.513724 (+ 1407us) tablet.cc:701] Row locks acquired
0926 13:55:32.513740 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:32.513882 (+ 142us) write_op.cc:270] Start()
0926 13:55:32.513974 (+ 92us) write_op.cc:276] Timestamp: P: 1790430932513845 usec, L: 0
0926 13:55:32.513992 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.713180 (+199188us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b540016a218. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0abdd964 00007fdb097d8e69 00007fdb09794b51 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:32.713484 (+ 304us) log.cc:844] Serialized 778 byte log entry
0926 13:55:34.082585 (+1369101us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.547150 (+464565us) write_op.cc:301] APPLY: starting
0926 13:55:34.547215 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.547428 (+ 213us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.547448 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.562454 (+ 15006us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.568094 (+ 5640us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.572152 (+ 4058us) write_op.cc:312] APPLY: finished
0926 13:55:34.595770 (+ 23618us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.604819 (+ 9049us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.605114 (+ 295us) write_op.cc:454] Released schema lock
0926 13:55:34.605158 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":464390,"num_ops":11,"prepare.queue_time_us":938941,"prepare.run_cpu_time_us":5538,"prepare.run_wall_time_us":218147,"replication_time_us":1568494,"spinlock_wait_cycles":12551936}]]}
I20260926 13:55:34.612558 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=38, attempt_no=0}) took 3646 ms. Trace:
I20260926 13:55:34.614894 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=57, attempt_no=0}) took 3212 ms. Trace:
I20260926 13:55:34.615249 9554 rpcz_store.cc:276] 0926 13:55:31.411400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.413419 (+ 2019us) service_pool.cc:224] Handling call
0926 13:55:34.614840 (+3201421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.393259 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:32.393730 (+ 471us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.393756 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:32.393772 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:32.394555 (+ 783us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.394595 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.394625 (+ 30us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:32.395443 (+ 818us) tablet.cc:701] Row locks acquired
0926 13:55:32.395461 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:32.395602 (+ 141us) write_op.cc:270] Start()
0926 13:55:32.395708 (+ 106us) write_op.cc:276] Timestamp: P: 1790430932395557 usec, L: 0
0926 13:55:32.395723 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.396210 (+ 487us) log.cc:844] Serialized 864 byte log entry
0926 13:55:34.178077 (+1781867us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.612009 (+433932us) write_op.cc:301] APPLY: starting
0926 13:55:34.612065 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.612264 (+ 199us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.612350 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.613928 (+ 1578us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.614091 (+ 163us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.614128 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:34.614342 (+ 214us) log.cc:844] Serialized 94 byte log entry
0926 13:55:34.614488 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.614580 (+ 92us) write_op.cc:454] Released schema lock
0926 13:55:34.614617 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":433798,"num_ops":13,"prepare.queue_time_us":978430,"prepare.run_cpu_time_us":3140,"prepare.run_wall_time_us":3139,"replication_time_us":1782265}]]}
I20260926 13:55:34.629624 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=66, attempt_no=0}) took 3004 ms. Trace:
I20260926 13:55:34.629978 9584 rpcz_store.cc:276] 0926 13:55:31.625060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.631359 (+ 6299us) service_pool.cc:224] Handling call
0926 13:55:34.629569 (+2998210us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.732790 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:32.874226 (+141436us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.885802 (+ 11576us) write_op.cc:435] Acquired schema lock
0926 13:55:32.889089 (+ 3287us) tablet.cc:662] Decoding operations
0926 13:55:33.006239 (+117150us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.007729 (+ 1490us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.008370 (+ 641us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:33.089294 (+ 80924us) tablet.cc:701] Row locks acquired
0926 13:55:33.099697 (+ 10403us) write_op.cc:260] PREPARE: finished
0926 13:55:33.128383 (+ 28686us) write_op.cc:270] Start()
0926 13:55:33.138714 (+ 10331us) write_op.cc:276] Timestamp: P: 1790430933127758 usec, L: 0
0926 13:55:33.138736 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.176274 (+ 37538us) log.cc:844] Serialized 735 byte log entry
0926 13:55:34.178515 (+1002241us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.624467 (+445952us) write_op.cc:301] APPLY: starting
0926 13:55:34.624530 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.624726 (+ 196us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.624836 (+ 110us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.626136 (+ 1300us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.626327 (+ 191us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.626369 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:34.626593 (+ 224us) log.cc:844] Serialized 76 byte log entry
0926 13:55:34.629169 (+ 2576us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.629261 (+ 92us) write_op.cc:454] Released schema lock
0926 13:55:34.629303 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":1843456,"child_traces":[["op",{"apply.queue_time_us":445819,"num_ops":10,"prepare.queue_time_us":916730,"prepare.run_cpu_time_us":9365,"prepare.run_wall_time_us":455523,"replication_time_us":1033921}]]}
I20260926 13:55:34.636247 9554 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=84, attempt_no=0}) took 2973 ms. Trace:
I20260926 13:55:34.612906 9583 rpcz_store.cc:276] 0926 13:55:30.970183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.016095 (+ 45912us) service_pool.cc:224] Handling call
0926 13:55:34.612506 (+3596411us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.280430 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:32.296240 (+ 15810us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.296268 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:32.296280 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:32.297047 (+ 767us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.297097 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.297137 (+ 40us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:32.297772 (+ 635us) tablet.cc:701] Row locks acquired
0926 13:55:32.297787 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:32.297940 (+ 153us) write_op.cc:270] Start()
0926 13:55:32.298036 (+ 96us) write_op.cc:276] Timestamp: P: 1790430932297898 usec, L: 0
0926 13:55:32.298065 (+ 29us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.391919 (+ 93854us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b54003d16a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:32.392881 (+ 962us) log.cc:844] Serialized 778 byte log entry
0926 13:55:34.177845 (+1784964us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.609077 (+431232us) write_op.cc:301] APPLY: starting
0926 13:55:34.609135 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.609307 (+ 172us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.609323 (+ 16us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.610497 (+ 1174us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.610729 (+ 232us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.610765 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:34.610972 (+ 207us) log.cc:844] Serialized 82 byte log entry
0926 13:55:34.612151 (+ 1179us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.612239 (+ 88us) write_op.cc:454] Released schema lock
0926 13:55:34.612275 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":431087,"num_ops":11,"prepare.queue_time_us":1248285,"prepare.run_cpu_time_us":4850,"prepare.run_wall_time_us":112683,"replication_time_us":1879691,"spinlock_wait_cycles":16195456}]]}
I20260926 13:55:34.636595 9554 rpcz_store.cc:276] 0926 13:55:31.662640 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.662774 (+ 134us) service_pool.cc:224] Handling call
0926 13:55:34.636195 (+2973421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:32.396561 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:32.463322 (+ 66761us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:32.470619 (+ 7297us) write_op.cc:435] Acquired schema lock
0926 13:55:32.470638 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:32.507666 (+ 37028us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:32.509793 (+ 2127us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:32.510800 (+ 1007us) tablet.cc:685] Acquiring locks for 20 operations
0926 13:55:32.682060 (+171260us) tablet.cc:701] Row locks acquired
0926 13:55:32.682076 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:32.682239 (+ 163us) write_op.cc:270] Start()
0926 13:55:32.682336 (+ 97us) write_op.cc:276] Timestamp: P: 1790430932682197 usec, L: 0
0926 13:55:32.682355 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:32.682921 (+ 566us) log.cc:844] Serialized 1174 byte log entry
0926 13:55:34.178282 (+1495361us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.619534 (+441252us) write_op.cc:301] APPLY: starting
0926 13:55:34.619582 (+ 48us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.619846 (+ 264us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.619922 (+ 76us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.622002 (+ 2080us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.622184 (+ 182us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.622220 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:34.622492 (+ 272us) log.cc:844] Serialized 138 byte log entry
0926 13:55:34.635800 (+ 13308us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.635921 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:34.635969 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":441130,"num_ops":20,"prepare.queue_time_us":591391,"prepare.run_cpu_time_us":5275,"prepare.run_wall_time_us":322880,"replication_time_us":1495844}]]}
W20260926 13:55:34.658996 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:34.668665 9583 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=88, attempt_no=0}) took 2699 ms. Trace:
I20260926 13:55:34.669984 9583 rpcz_store.cc:276] 0926 13:55:31.969517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.969629 (+ 112us) service_pool.cc:224] Handling call
0926 13:55:34.668609 (+2698980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.206514 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:33.206945 (+ 431us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.206972 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:33.206988 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:33.207807 (+ 819us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.207847 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.207874 (+ 27us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:33.208678 (+ 804us) tablet.cc:701] Row locks acquired
0926 13:55:33.208693 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:33.218666 (+ 9973us) write_op.cc:270] Start()
0926 13:55:33.224403 (+ 5737us) write_op.cc:276] Timestamp: P: 1790430933217208 usec, L: 0
0926 13:55:33.225446 (+ 1043us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.254686 (+ 29240us) log.cc:844] Serialized 873 byte log entry
0926 13:55:34.178955 (+924269us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.638814 (+459859us) write_op.cc:301] APPLY: starting
0926 13:55:34.638874 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.639083 (+ 209us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.639164 (+ 81us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.640662 (+ 1498us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.640876 (+ 214us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.640916 (+ 40us) write_op.cc:312] APPLY: finished
0926 13:55:34.641140 (+ 224us) log.cc:844] Serialized 94 byte log entry
0926 13:55:34.668245 (+ 27105us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.668340 (+ 95us) write_op.cc:454] Released schema lock
0926 13:55:34.668379 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":459724,"num_ops":13,"prepare.queue_time_us":1200712,"prepare.run_cpu_time_us":3497,"prepare.run_wall_time_us":54737,"replication_time_us":953427}]]}
I20260926 13:55:34.679651 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=78, attempt_no=0}) took 3017 ms. Trace:
I20260926 13:55:34.680109 9584 rpcz_store.cc:276] 0926 13:55:31.661911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:31.664307 (+ 2396us) service_pool.cc:224] Handling call
0926 13:55:34.679594 (+3015287us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.187756 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c4eb5b0abcd4df983923718c800b998
0926 13:55:33.188188 (+ 432us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.188215 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:33.188227 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:33.191428 (+ 3201us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.191482 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.191513 (+ 31us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:33.192041 (+ 528us) tablet.cc:701] Row locks acquired
0926 13:55:33.192060 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:33.192211 (+ 151us) write_op.cc:270] Start()
0926 13:55:33.192305 (+ 94us) write_op.cc:276] Timestamp: P: 1790430933192170 usec, L: 0
0926 13:55:33.192320 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:33.205555 (+ 13235us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b54003d16a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:33.206139 (+ 584us) log.cc:844] Serialized 701 byte log entry
0926 13:55:34.178748 (+972609us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.633295 (+454547us) write_op.cc:301] APPLY: starting
0926 13:55:34.633363 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.633545 (+ 182us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.633566 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.634717 (+ 1151us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.634888 (+ 171us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.634935 (+ 47us) write_op.cc:312] APPLY: finished
0926 13:55:34.635150 (+ 215us) log.cc:844] Serialized 70 byte log entry
0926 13:55:34.679206 (+ 44056us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.679294 (+ 88us) write_op.cc:454] Released schema lock
0926 13:55:34.679336 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":454409,"num_ops":9,"prepare.queue_time_us":1367806,"prepare.run_cpu_time_us":4339,"prepare.run_wall_time_us":18624,"replication_time_us":986319,"spinlock_wait_cycles":21320064}]]}
W20260926 13:55:34.733250 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:34.738653 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:34.750720 9196 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:34.753352 9257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:40315, user_credentials={real_user=slave}} blocked reactor thread for 120026us
W20260926 13:55:34.798918 9194 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:34.799891 9196 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:34.823796 9193 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:34.836928 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=89, attempt_no=0}) took 2743 ms. Trace:
I20260926 13:55:34.837453 9566 rpcz_store.cc:276] 0926 13:55:32.134447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:32.145038 (+ 10591us) service_pool.cc:224] Handling call
0926 13:55:34.836858 (+2691820us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:33.866837 (+ 0us) write_op.cc:183] PREPARE: starting on tablet a6bc150b80ac43d98ea0998dc4e23d6f
0926 13:55:33.867290 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:33.867320 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:33.867339 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:33.868069 (+ 730us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:33.868109 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:33.868135 (+ 26us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:33.868731 (+ 596us) tablet.cc:701] Row locks acquired
0926 13:55:33.868765 (+ 34us) write_op.cc:260] PREPARE: finished
0926 13:55:33.938685 (+ 69920us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:33.938786 (+ 101us) write_op.cc:270] Start()
0926 13:55:33.938984 (+ 198us) write_op.cc:276] Timestamp: P: 1790430933938747 usec, L: 0
0926 13:55:33.939009 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:34.006286 (+ 67277us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b54003aa5a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:34.006847 (+ 561us) log.cc:844] Serialized 744 byte log entry
0926 13:55:34.201776 (+194929us) op_driver.cc:464] REPLICATION: finished
0926 13:55:34.786787 (+585011us) write_op.cc:301] APPLY: starting
0926 13:55:34.786861 (+ 74us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:34.787029 (+ 168us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:34.787045 (+ 16us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:34.788156 (+ 1111us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:34.788314 (+ 158us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:34.788350 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:34.788536 (+ 186us) log.cc:844] Serialized 76 byte log entry
0926 13:55:34.788697 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:34.793263 (+ 4566us) write_op.cc:454] Released schema lock
0926 13:55:34.793303 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:34.836728 (+ 43425us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":584859,"mutex_wait_us":119933,"num_ops":10,"prepare.queue_time_us":1524866,"prepare.run_cpu_time_us":7018,"prepare.run_wall_time_us":142044,"replication_time_us":262662,"spinlock_wait_cycles":85650304}]]}
W20260926 13:55:34.929008 9331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.130:35495, user_credentials={real_user=slave}} blocked reactor thread for 67720.9us
W20260926 13:55:34.935344 9182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.131:39167, user_credentials={real_user=slave}} blocked reactor thread for 57509.7us
W20260926 13:55:35.028932 9271 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.030990 9266 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.046233 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.055902 9272 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.208345 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.217916 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.317490 9397 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.130:35495, user_credentials={real_user=slave}} blocked reactor thread for 126595us
W20260926 13:55:35.342250 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.407012 9266 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.479681 9196 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.550359 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.535174 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.610270 9572 log.cc:927] Time spent T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260926 13:55:35.621399 9647 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:35.621930 9647 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:35.628618 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.655467 9195 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.656821 9191 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.656950 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.665982 9197 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.666157 9271 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
I20260926 13:55:35.672170 9647 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
W20260926 13:55:35.674383 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.683300 9271 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.686861 9257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:40315, user_credentials={real_user=slave}} blocked reactor thread for 289057us
W20260926 13:55:35.708412 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.709335 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.711967 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.714401 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.726814 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:35.733441 9364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:35.734068 9364 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 2.
I20260926 13:55:35.742794 9584 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:59772 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=127, attempt_no=0}) took 1017 ms. Trace:
I20260926 13:55:35.743149 9584 rpcz_store.cc:276] 0926 13:55:34.725639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:34.745322 (+ 19683us) service_pool.cc:224] Handling call
0926 13:55:35.742731 (+997409us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:35.032273 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f540c52111434b839719f0c1c0113620
0926 13:55:35.032692 (+ 419us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:35.032717 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:35.032733 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:35.144817 (+112084us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:35.144857 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:35.144885 (+ 28us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:35.145643 (+ 758us) tablet.cc:701] Row locks acquired
0926 13:55:35.145662 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:35.145811 (+ 149us) write_op.cc:270] Start()
0926 13:55:35.145904 (+ 93us) write_op.cc:276] Timestamp: P: 1790430935145764 usec, L: 0
0926 13:55:35.145923 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:35.146448 (+ 525us) log.cc:844] Serialized 916 byte log entry
0926 13:55:35.727257 (+580809us) op_driver.cc:464] REPLICATION: finished
0926 13:55:35.738954 (+ 11697us) write_op.cc:301] APPLY: starting
0926 13:55:35.739018 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:35.739237 (+ 219us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:35.739318 (+ 81us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:35.740825 (+ 1507us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:35.740998 (+ 173us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:35.741035 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:35.741248 (+ 213us) log.cc:844] Serialized 100 byte log entry
0926 13:55:35.742327 (+ 1079us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:35.742427 (+ 100us) write_op.cc:454] Released schema lock
0926 13:55:35.742469 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3257,"mutex_wait_us":21046,"num_ops":14,"prepare.queue_time_us":255399,"prepare.run_cpu_time_us":6013,"prepare.run_wall_time_us":114410,"replication_time_us":581231}]]}
I20260926 13:55:35.747750 9257 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters:
W20260926 13:55:35.752173 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.753561 9191 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:35.755052 9547 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:35.755437 9547 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5036bd38367e48199b8de47d7853fc87)
I20260926 13:55:35.755764 9547 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Advancing to term 2
W20260926 13:55:35.760149 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.761941 9191 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:35.728531 9211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
W20260926 13:55:35.789675 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
I20260926 13:55:35.788842 9211 raft_consensus.cc:2393] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 2: Already voted for candidate 31100581adf746139e2a9bf8203b65cf in this term.
W20260926 13:55:35.797067 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:35.797657 9271 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.803961 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.808190 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.802788 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:35.840149 9547 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:35.844439 9547 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:35.848080 9364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
W20260926 13:55:35.848910 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:35.851119 9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "963979ac151b4df2afabc1ab6a430b9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:35.851851 9214 raft_consensus.cc:2393] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 963979ac151b4df2afabc1ab6a430b9b in current term 2: Already voted for candidate 31100581adf746139e2a9bf8203b65cf in this term.
W20260926 13:55:35.856386 9197 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.869663 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:35.929911 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:35.932217 9566 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=129, attempt_no=0}) took 1203 ms. Trace:
I20260926 13:55:35.932590 9566 rpcz_store.cc:276] 0926 13:55:34.728808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:34.729079 (+ 271us) service_pool.cc:224] Handling call
0926 13:55:34.797250 (+ 68171us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:35.932160 (+1134910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:35.136065 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:35.136565 (+ 500us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:35.136595 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:35.136608 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:35.166372 (+ 29764us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:35.166443 (+ 71us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:35.166470 (+ 27us) tablet.cc:685] Acquiring locks for 20 operations
0926 13:55:35.167923 (+ 1453us) tablet.cc:701] Row locks acquired
0926 13:55:35.167939 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:35.295830 (+127891us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:35.295931 (+ 101us) write_op.cc:270] Start()
0926 13:55:35.296115 (+ 184us) write_op.cc:276] Timestamp: P: 1790430935295897 usec, L: 0
0926 13:55:35.296140 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:35.296769 (+ 629us) log.cc:844] Serialized 1175 byte log entry
0926 13:55:35.727280 (+430511us) op_driver.cc:464] REPLICATION: finished
0926 13:55:35.779077 (+ 51797us) write_op.cc:301] APPLY: starting
0926 13:55:35.779144 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:35.779449 (+ 305us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:35.779468 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:35.842331 (+ 62863us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:35.842460 (+ 129us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:35.842494 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:35.842671 (+ 177us) log.cc:844] Serialized 138 byte log entry
0926 13:55:35.842815 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:35.842892 (+ 77us) write_op.cc:454] Released schema lock
0926 13:55:35.842921 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:35.932056 (+ 89135us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"spinlock_wait_cycles":65684736,"child_traces":[["op",{"apply.queue_time_us":51628,"mutex_wait_us":18568,"num_ops":20,"prepare.queue_time_us":337637,"prepare.run_cpu_time_us":6157,"prepare.run_wall_time_us":161039,"raft.queue_time_us":364,"raft.run_cpu_time_us":873,"raft.run_wall_time_us":874,"replication_time_us":429018,"spinlock_wait_cycles":62603392,"thread_start_us":58620,"threads_started":1}]]}
I20260926 13:55:35.935338 9557 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=126, attempt_no=0}) took 1207 ms. Trace:
W20260926 13:55:35.904642 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:35.939177 9266 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
I20260926 13:55:35.938014 9364 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963979ac151b4df2afabc1ab6a430b9b in term 2.
I20260926 13:55:35.935698 9557 rpcz_store.cc:276] 0926 13:55:34.728169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:34.729118 (+ 949us) service_pool.cc:224] Handling call
0926 13:55:34.842723 (+113605us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:35.935284 (+1092561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:35.320740 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6210fe45bb654298a404f65b1c766d88
0926 13:55:35.321189 (+ 449us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:35.321234 (+ 45us) write_op.cc:435] Acquired schema lock
0926 13:55:35.321247 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:35.322460 (+ 1213us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:35.322497 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:35.322520 (+ 23us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:35.323101 (+ 581us) tablet.cc:701] Row locks acquired
0926 13:55:35.323118 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:35.323268 (+ 150us) write_op.cc:270] Start()
0926 13:55:35.323367 (+ 99us) write_op.cc:276] Timestamp: P: 1790430935323228 usec, L: 0
0926 13:55:35.323387 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:35.364615 (+ 41228us) log.cc:844] Serialized 787 byte log entry
0926 13:55:35.871388 (+506773us) op_driver.cc:464] REPLICATION: finished
0926 13:55:35.932779 (+ 61391us) write_op.cc:301] APPLY: starting
0926 13:55:35.932837 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:35.933013 (+ 176us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:35.933104 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:35.934316 (+ 1212us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:35.934539 (+ 223us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:35.934571 (+ 32us) write_op.cc:312] APPLY: finished
0926 13:55:35.934778 (+ 207us) log.cc:844] Serialized 82 byte log entry
0926 13:55:35.934933 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:35.935020 (+ 87us) write_op.cc:454] Released schema lock
0926 13:55:35.935055 (+ 35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":36046208,"child_traces":[["op",{"apply.queue_time_us":61221,"mutex_wait_us":15384,"num_ops":11,"prepare.queue_time_us":433336,"prepare.run_cpu_time_us":3866,"prepare.run_wall_time_us":45367,"raft.queue_time_us":408,"raft.run_cpu_time_us":1346,"raft.run_wall_time_us":53283,"replication_time_us":547899}]]}
I20260926 13:55:35.973270 9257 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:35.974308 9647 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:35.975087 9647 raft_consensus.cc:697] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 2 LEADER]: Becoming Leader. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Running, Role: LEADER
I20260926 13:55:35.975904 9647 consensus_queue.cc:237] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:35.984961 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Service unavailable: leader is not yet ready
W20260926 13:55:36.022266 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Service unavailable: leader is not yet ready
W20260926 13:55:36.042547 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.018323 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.060732 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.064620 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:36.012678 9657 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:36.073097 9657 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:36.092792 9657 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
W20260926 13:55:36.093959 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:36.095266 9290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
W20260926 13:55:36.097715 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.128356 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.129124 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.129163 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:36.141197 9365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87" is_pre_election: true
I20260926 13:55:36.141836 9365 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31100581adf746139e2a9bf8203b65cf in term 2.
I20260926 13:55:36.160549 9182 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf, 5036bd38367e48199b8de47d7853fc87; no voters: 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:36.162257 9634 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260926 13:55:36.162617 9634 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:36.162930 9634 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Advancing to term 3
I20260926 13:55:36.175127 9116 catalog_manager.cc:5838] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b reported cstate change: term changed from 1 to 2, leader changed from 5036bd38367e48199b8de47d7853fc87 (127.3.127.131) to 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130). New cstate: current_term: 2 leader_uuid: "963979ac151b4df2afabc1ab6a430b9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: UNKNOWN } } }
W20260926 13:55:36.196105 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.198655 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.208928 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.214406 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.215764 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.260157 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:36.241637 9634 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:36.303076 9366 raft_consensus.cc:1275] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Refusing update from remote peer 963979ac151b4df2afabc1ab6a430b9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20260926 13:55:36.310436 9547 consensus_queue.cc:1048] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260926 13:55:36.324955 9216 raft_consensus.cc:1240] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Rejecting Update request from peer 963979ac151b4df2afabc1ab6a430b9b for earlier term 2. Current term is 3. Ops: []
I20260926 13:55:36.329576 9647 consensus_queue.cc:1059] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
I20260926 13:55:36.333238 9647 raft_consensus.cc:3055] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 2 LEADER]: Stepping down as leader of term 2
I20260926 13:55:36.333631 9647 raft_consensus.cc:740] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963979ac151b4df2afabc1ab6a430b9b, State: Running, Role: LEADER
I20260926 13:55:36.331931 9634 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 3 election: Requested vote from peers 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495), 5036bd38367e48199b8de47d7853fc87 (127.3.127.131:39167)
I20260926 13:55:36.332516 9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:36.336210 9364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "31100581adf746139e2a9bf8203b65cf" candidate_term: 3 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "5036bd38367e48199b8de47d7853fc87"
I20260926 13:55:36.335608 9647 consensus_queue.cc:260] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.14, Last appended by leader: 14, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:36.349996 9647 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Advancing to term 3
W20260926 13:55:36.355471 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.050s ago.
W20260926 13:55:36.360440 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.055s ago.
I20260926 13:55:36.364073 9288 raft_consensus.cc:2410] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 31100581adf746139e2a9bf8203b65cf for term 3 because replica has last-logged OpId of term: 2 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 11.
W20260926 13:55:36.364354 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.059s ago.
I20260926 13:55:36.366994 9182 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31100581adf746139e2a9bf8203b65cf; no voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b
I20260926 13:55:36.367731 9634 raft_consensus.cc:2749] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260926 13:55:36.369288 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.064s ago.
W20260926 13:55:36.374380 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.376991 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.068s ago.
W20260926 13:55:36.380999 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.076s ago.
W20260926 13:55:36.384982 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.385293 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.387871 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.083s ago.
W20260926 13:55:36.391184 9628 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.086s ago.
W20260926 13:55:36.394699 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.400506 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.400557 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.404654 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.413721 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.415738 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.416774 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.418795 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.420011 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.426354 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.428627 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.429598 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.431361 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.433708 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.434559 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.435038 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.436735 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.443854 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.444789 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.449667 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.450567 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.456708 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.458061 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.458269 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.462141 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.464103 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.471740 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.475325 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.475785 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.481802 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.482630 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.493690 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.493680 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.496095 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.496115 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.496398 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.498785 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.504906 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.508687 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.512457 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.515134 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.518703 9341 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.519181 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.519393 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.520804 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.527024 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.531932 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.533664 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.539536 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.541738 9190 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.542613 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.543798 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.546919 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.548856 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.550057 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.551875 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.559757 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.567591 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.568204 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.573835 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.574156 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.574368 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.575590 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.577615 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.580209 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.596060 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.596814 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.598892 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.601620 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.601925 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.602406 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.608140 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.610206 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.621495 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.621994 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.624768 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.626787 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.627003 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.630092 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.631095 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.634909 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.648418 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.652314 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.657480 9269 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.657909 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.658250 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.660179 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.660187 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.660353 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.677562 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.683333 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.684350 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.684798 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.687455 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.688870 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.692283 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.694208 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.703961 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.711077 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.711354 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.713555 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.714067 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.715160 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.719077 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.721091 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.730100 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.736965 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.746336 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.746802 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.752063 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.752552 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.752843 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.753726 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.762632 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.768538 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.779316 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.780153 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.781396 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.783063 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.784494 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.787041 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.789388 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.795172 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.809162 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.812086 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.816642 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.817027 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.817028 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.818800 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.819134 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.824630 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.836733 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.846304 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.850569 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.853811 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.854212 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.858986 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.859184 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.863400 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.869542 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.878378 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.886512 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.887724 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.892704 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.893362 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.893362 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.896099 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.900894 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.907738 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.921610 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.923996 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.924296 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.926887 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.927054 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.928164 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.933333 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.944917 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.959030 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.962188 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.962865 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.964576 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.967360 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.969883 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.974062 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:36.977223 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.997834 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:36.998064 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:36.998474 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.000444 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.006609 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.009527 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.010216 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.013291 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.031283 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.034938 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.035447 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.039587 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.044463 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.046667 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.046908 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.052790 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.075548 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.076095 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.081012 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.083853 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.087167 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.087802 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.089931 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.090963 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.111864 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.115908 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.116837 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.121820 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.123581 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.126704 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.131237 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.131570 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.147648 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.153008 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.158463 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.161583 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.162204 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.165284 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.171932 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.172473 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.191525 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.197098 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.197674 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.204038 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.206089 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.210546 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.213636 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.213946 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.229288 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.238793 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.239111 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.244951 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.246737 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.250525 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.256834 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.261294 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.272728 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.280594 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.284785 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.285210 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.287678 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.292546 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.303350 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.303539 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.317340 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.328689 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.328927 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.337742 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.339936 9273 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.341542 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.343972 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.349205 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.359079 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.374807 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.379760 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.381582 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.384557 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.386255 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.388015 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.395381 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.403368 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.416205 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.426546 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.426736 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.428375 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.432873 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.437232 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.439718 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.452298 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.462049 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.472107 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.476068 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.479739 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.484577 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.485263 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.487587 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.495419 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.509248 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.520026 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.524349 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.524735 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.529740 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.531361 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.540460 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.541183 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.555181 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.572691 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.573325 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.573341 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.575774 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.582512 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.588680 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.593879 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.608346 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.622241 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.625986 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.628562 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.631155 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.631250 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.640275 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.642104 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.656448 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.673412 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.677485 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.678234 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.678754 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.680347 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.695515 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.695679 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.705608 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.725312 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.729034 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.732209 9198 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.733712 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.737411 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.745805 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.749425 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.761953 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.782596 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.784085 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.787483 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.789306 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.792608 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.797490 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.800303 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
W20260926 13:55:37.812237 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:37.817507 9636 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963979ac151b4df2afabc1ab6a430b9b)
I20260926 13:55:37.817907 9636 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:37.819491 9636 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:37.820040 9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 3 candidate_status { last_received { term: 2 index: 14 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf" is_pre_election: true
I20260926 13:55:37.820384 9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 3 candidate_status { last_received { term: 2 index: 14 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b" is_pre_election: true
I20260926 13:55:37.820811 9214 raft_consensus.cc:2393] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5036bd38367e48199b8de47d7853fc87 in current term 3: Already voted for candidate 31100581adf746139e2a9bf8203b65cf in this term.
I20260926 13:55:37.820991 9288 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 3.
I20260926 13:55:37.822011 9331 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:37.822676 9636 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260926 13:55:37.822939 9636 raft_consensus.cc:493] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 963979ac151b4df2afabc1ab6a430b9b)
I20260926 13:55:37.823204 9636 raft_consensus.cc:3060] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Advancing to term 3
I20260926 13:55:37.828390 9636 raft_consensus.cc:515] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
I20260926 13:55:37.830231 9636 leader_election.cc:290] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 3 election: Requested vote from peers 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315), 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495)
I20260926 13:55:37.830789 9214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 3 candidate_status { last_received { term: 2 index: 14 } } ignore_live_leader: false dest_uuid: "31100581adf746139e2a9bf8203b65cf"
I20260926 13:55:37.831040 9288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ec5b0032a4b08911b6e8b1658e45a" candidate_uuid: "5036bd38367e48199b8de47d7853fc87" candidate_term: 3 candidate_status { last_received { term: 2 index: 14 } } ignore_live_leader: false dest_uuid: "963979ac151b4df2afabc1ab6a430b9b"
I20260926 13:55:37.831454 9214 raft_consensus.cc:2393] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5036bd38367e48199b8de47d7853fc87 in current term 3: Already voted for candidate 31100581adf746139e2a9bf8203b65cf in this term.
I20260926 13:55:37.835882 9288 raft_consensus.cc:2468] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5036bd38367e48199b8de47d7853fc87 in term 3.
W20260926 13:55:37.836665 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Illegal state: replica 5036bd38367e48199b8de47d7853fc87 is not leader of this config: current role FOLLOWER
I20260926 13:55:37.836796 9331 leader_election.cc:304] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5036bd38367e48199b8de47d7853fc87, 963979ac151b4df2afabc1ab6a430b9b; no voters: 31100581adf746139e2a9bf8203b65cf
I20260926 13:55:37.837468 9636 raft_consensus.cc:2804] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 3 FOLLOWER]: Leader election won for term 3
I20260926 13:55:37.838475 9636 raft_consensus.cc:697] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 3 LEADER]: Becoming Leader. State: Replica: 5036bd38367e48199b8de47d7853fc87, State: Running, Role: LEADER
W20260926 13:55:37.840456 9347 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Service unavailable: leader is not yet ready
W20260926 13:55:37.840592 9340 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Service unavailable: leader is not yet ready
W20260926 13:55:37.841105 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Service unavailable: leader is not yet ready
I20260926 13:55:37.839296 9636 consensus_queue.cc:237] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.14, Last appended by leader: 13, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } }
W20260926 13:55:37.844300 9339 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59772: Service unavailable: leader is not yet ready
I20260926 13:55:37.849691 9116 catalog_manager.cc:5838] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 reported cstate change: term changed from 2 to 3, leader changed from 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130) to 5036bd38367e48199b8de47d7853fc87 (127.3.127.131). New cstate: current_term: 3 leader_uuid: "5036bd38367e48199b8de47d7853fc87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5036bd38367e48199b8de47d7853fc87" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 39167 } health_report { overall_health: HEALTHY } } }
W20260926 13:55:37.855188 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.863270 9270 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60080: Illegal state: replica 963979ac151b4df2afabc1ab6a430b9b is not leader of this config: current role FOLLOWER
W20260926 13:55:37.865002 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.890901 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
W20260926 13:55:37.896052 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:37.902808 9214 raft_consensus.cc:1275] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Refusing update from remote peer 5036bd38367e48199b8de47d7853fc87: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 3 index: 16. (index mismatch)
I20260926 13:55:37.902889 9288 raft_consensus.cc:1275] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 3 FOLLOWER]: Refusing update from remote peer 5036bd38367e48199b8de47d7853fc87: Log matching property violated. Preceding OpId in replica: term: 2 index: 14. Preceding OpId from leader: term: 3 index: 16. (index mismatch)
I20260926 13:55:37.904062 9665 consensus_queue.cc:1048] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31100581adf746139e2a9bf8203b65cf" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 8, Time since last communication: 0.000s
I20260926 13:55:37.904701 9636 consensus_queue.cc:1048] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963979ac151b4df2afabc1ab6a430b9b" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 35495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
W20260926 13:55:37.924489 9189 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:59510: Illegal state: replica 31100581adf746139e2a9bf8203b65cf is not leader of this config: current role FOLLOWER
I20260926 13:55:37.958811 9679 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=166, attempt_no=5}) took 1805 ms. Trace:
I20260926 13:55:37.959321 9679 rpcz_store.cc:276] 0926 13:55:36.153198 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:36.154445 (+ 1247us) service_pool.cc:224] Handling call
0926 13:55:36.170527 (+ 16082us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:37.958643 (+1788116us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:36.192433 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:36.192893 (+ 460us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:36.192920 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:36.192936 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:36.193745 (+ 809us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:36.193792 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:36.193822 (+ 30us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:36.194837 (+ 1015us) tablet.cc:701] Row locks acquired
0926 13:55:36.194857 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:36.256146 (+ 61289us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:36.256249 (+ 103us) write_op.cc:270] Start()
0926 13:55:36.256422 (+ 173us) write_op.cc:276] Timestamp: P: 1790430936256215 usec, L: 0
0926 13:55:36.256444 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:36.257001 (+ 557us) log.cc:844] Serialized 917 byte log entry
0926 13:55:37.932102 (+1675101us) op_driver.cc:464] REPLICATION: finished
0926 13:55:37.952300 (+ 20198us) write_op.cc:301] APPLY: starting
0926 13:55:37.952369 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:37.952646 (+ 277us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:37.952666 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:37.955014 (+ 2348us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:37.957612 (+ 2598us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:37.957660 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:37.957950 (+ 290us) log.cc:844] Serialized 100 byte log entry
0926 13:55:37.958142 (+ 192us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:37.958261 (+ 119us) write_op.cc:454] Released schema lock
0926 13:55:37.958314 (+ 53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":32622336,"child_traces":[["op",{"apply.queue_time_us":20012,"mutex_wait_us":1225,"num_ops":14,"prepare.queue_time_us":19373,"prepare.run_cpu_time_us":4984,"prepare.run_wall_time_us":67257,"raft.queue_time_us":1936,"raft.run_cpu_time_us":1436,"raft.run_wall_time_us":1504,"replication_time_us":1675538,"spinlock_wait_cycles":19277184,"thread_start_us":23053,"threads_started":1}]]}
I20260926 13:55:37.972332 9679 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60080 (ReqId={client: 1a858a81589e4790b5ef28266daf82e0, seq_no=199, attempt_no=6}) took 1821 ms. Trace:
I20260926 13:55:37.972819 9679 rpcz_store.cc:276] 0926 13:55:36.151175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:36.153259 (+ 2084us) service_pool.cc:224] Handling call
0926 13:55:36.173271 (+ 20012us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b34000b1b08. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:37.972277 (+1799006us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:36.261408 (+ 0us) write_op.cc:183] PREPARE: starting on tablet ab4ec5b0032a4b08911b6e8b1658e45a
0926 13:55:36.261849 (+ 441us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:36.261874 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:36.261886 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:36.303447 (+ 41561us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:36.303493 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:36.303520 (+ 27us) tablet.cc:685] Acquiring locks for 20 operations
0926 13:55:36.304485 (+ 965us) tablet.cc:701] Row locks acquired
0926 13:55:36.304501 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:36.304645 (+ 144us) write_op.cc:270] Start()
0926 13:55:36.304764 (+ 119us) write_op.cc:276] Timestamp: P: 1790430936304608 usec, L: 0
0926 13:55:36.304785 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:36.305350 (+ 565us) log.cc:844] Serialized 1175 byte log entry
0926 13:55:37.955504 (+1650154us) op_driver.cc:464] REPLICATION: finished
0926 13:55:37.964910 (+ 9406us) write_op.cc:301] APPLY: starting
0926 13:55:37.964978 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:37.965302 (+ 324us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:37.965391 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:37.971031 (+ 5640us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:37.971282 (+ 251us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:37.971325 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:37.971656 (+ 331us) log.cc:844] Serialized 138 byte log entry
0926 13:55:37.971827 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:37.971970 (+ 143us) write_op.cc:454] Released schema lock
0926 13:55:37.972019 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":41584896,"child_traces":[["op",{"apply.queue_time_us":9258,"mutex_wait_us":29202,"num_ops":20,"prepare.queue_time_us":86901,"prepare.run_cpu_time_us":3977,"prepare.run_wall_time_us":55802,"replication_time_us":1650628,"threads_started":1}]]}
I20260926 13:55:38.250301 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
W20260926 13:55:38.254066 9257 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260926 13:55:38.259604 9257 consensus_peers.cc:597] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b -> Peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Couldn't send request to peer 31100581adf746139e2a9bf8203b65cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:38.278611 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:38.279286 3582 tablet_replica.cc:333] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.279942 3582 raft_consensus.cc:2243] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.280514 3582 raft_consensus.cc:2272] T a6bc150b80ac43d98ea0998dc4e23d6f P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.282437 3582 tablet_replica.cc:333] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.282889 3582 raft_consensus.cc:2243] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.283255 3582 raft_consensus.cc:2272] T 8c4eb5b0abcd4df983923718c800b998 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.285161 3582 tablet_replica.cc:333] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.285626 3582 raft_consensus.cc:2243] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.286137 3582 raft_consensus.cc:2272] T 04729c698ede46c78868c2040e9ad38b P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.287951 3582 tablet_replica.cc:333] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.288436 3582 raft_consensus.cc:2243] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.288990 3582 raft_consensus.cc:2272] T ab4ec5b0032a4b08911b6e8b1658e45a P 31100581adf746139e2a9bf8203b65cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.291131 3582 tablet_replica.cc:333] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.291599 3582 raft_consensus.cc:2243] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.292155 3582 raft_consensus.cc:2272] T 5fcba31649db42f58ce04c10758ca297 P 31100581adf746139e2a9bf8203b65cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.294011 3582 tablet_replica.cc:333] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.294454 3582 raft_consensus.cc:2243] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.294826 3582 raft_consensus.cc:2272] T 6210fe45bb654298a404f65b1c766d88 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.296522 3582 tablet_replica.cc:333] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.296986 3582 raft_consensus.cc:2243] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.297688 3582 raft_consensus.cc:2272] T 802f137e22714b5ea0ee9530e62d2db1 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.299491 3582 tablet_replica.cc:333] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.299937 3582 raft_consensus.cc:2243] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.300544 3582 raft_consensus.cc:2272] T 41c702c434fc4bcb828c246a7017a83a P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.302315 3582 tablet_replica.cc:333] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.302729 3582 raft_consensus.cc:2243] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.303193 3582 raft_consensus.cc:2272] T f540c52111434b839719f0c1c0113620 P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.304864 3582 tablet_replica.cc:333] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf: stopping tablet replica
I20260926 13:55:38.305258 3582 raft_consensus.cc:2243] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.305768 3582 raft_consensus.cc:2272] T 5140fbbd182b49f993534b84130a185b P 31100581adf746139e2a9bf8203b65cf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:38.309969 9331 consensus_peers.cc:597] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 -> Peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Couldn't send request to peer 31100581adf746139e2a9bf8203b65cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260926 13:55:38.322546 9184 connection.cc:466] server connection from 127.0.0.1:59498 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59498 (request call id 128) could send its response
W20260926 13:55:38.330149 9331 consensus_peers.cc:597] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 -> Peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Couldn't send request to peer 31100581adf746139e2a9bf8203b65cf. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:40315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:38.331331 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
W20260926 13:55:38.352843 9257 consensus_peers.cc:597] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b -> Peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Couldn't send request to peer 31100581adf746139e2a9bf8203b65cf. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:40315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:38.353682 3582 tablet_server.cc:179] TabletServer@127.3.127.130:0 shutting down...
W20260926 13:55:38.369663 9331 consensus_peers.cc:597] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 -> Peer 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495): Couldn't send request to peer 963979ac151b4df2afabc1ab6a430b9b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260926 13:55:38.374963 9331 consensus_peers.cc:597] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 -> Peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Couldn't send request to peer 31100581adf746139e2a9bf8203b65cf. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:40315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:38.380528 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:38.381340 3582 tablet_replica.cc:333] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.382071 3582 raft_consensus.cc:2243] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.382650 3582 raft_consensus.cc:2272] T 41c702c434fc4bcb828c246a7017a83a P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.384505 3582 tablet_replica.cc:333] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.384985 3582 raft_consensus.cc:2243] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.385449 3582 raft_consensus.cc:2272] T f540c52111434b839719f0c1c0113620 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.387156 3582 tablet_replica.cc:333] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.387567 3582 raft_consensus.cc:2243] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.388168 3582 raft_consensus.cc:2272] T 5140fbbd182b49f993534b84130a185b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.390127 3582 tablet_replica.cc:333] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.390563 3582 raft_consensus.cc:2243] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 2 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.391139 3582 raft_consensus.cc:2272] T a6bc150b80ac43d98ea0998dc4e23d6f P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.392793 3582 tablet_replica.cc:333] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.393240 3582 raft_consensus.cc:2243] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.393658 3582 raft_consensus.cc:2272] T 8c4eb5b0abcd4df983923718c800b998 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.395262 3582 tablet_replica.cc:333] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.395668 3582 raft_consensus.cc:2243] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.396071 3582 raft_consensus.cc:2272] T 04729c698ede46c78868c2040e9ad38b P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.397773 3582 tablet_replica.cc:333] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.398191 3582 raft_consensus.cc:2243] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.398581 3582 raft_consensus.cc:2272] T ab4ec5b0032a4b08911b6e8b1658e45a P 963979ac151b4df2afabc1ab6a430b9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.400844 3582 tablet_replica.cc:333] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.401257 3582 raft_consensus.cc:2243] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.401659 3582 raft_consensus.cc:2272] T 802f137e22714b5ea0ee9530e62d2db1 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.403266 3582 tablet_replica.cc:333] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.403635 3582 raft_consensus.cc:2243] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.404211 3582 raft_consensus.cc:2272] T 6210fe45bb654298a404f65b1c766d88 P 963979ac151b4df2afabc1ab6a430b9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.405807 3582 tablet_replica.cc:333] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b: stopping tablet replica
I20260926 13:55:38.406168 3582 raft_consensus.cc:2243] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.406662 3582 raft_consensus.cc:2272] T 5fcba31649db42f58ce04c10758ca297 P 963979ac151b4df2afabc1ab6a430b9b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:38.427002 9331 consensus_peers.cc:597] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 -> Peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Couldn't send request to peer 31100581adf746139e2a9bf8203b65cf. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:40315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:38.435704 3582 tablet_server.cc:196] TabletServer@127.3.127.130:0 shutdown complete.
W20260926 13:55:38.437860 9331 consensus_peers.cc:597] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 -> Peer 963979ac151b4df2afabc1ab6a430b9b (127.3.127.130:35495): Couldn't send request to peer 963979ac151b4df2afabc1ab6a430b9b. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.130:35495: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:38.455397 3582 tablet_server.cc:179] TabletServer@127.3.127.131:0 shutting down...
W20260926 13:55:38.462599 9331 consensus_peers.cc:597] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 -> Peer 31100581adf746139e2a9bf8203b65cf (127.3.127.129:40315): Couldn't send request to peer 31100581adf746139e2a9bf8203b65cf. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:40315: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:38.475692 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:38.476272 3582 tablet_replica.cc:333] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.476801 3582 raft_consensus.cc:2243] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.477344 3582 raft_consensus.cc:2272] T 5140fbbd182b49f993534b84130a185b P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.479099 3582 tablet_replica.cc:333] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.479559 3582 raft_consensus.cc:2243] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.480187 3582 raft_consensus.cc:2272] T f540c52111434b839719f0c1c0113620 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.482086 3582 tablet_replica.cc:333] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.482522 3582 raft_consensus.cc:2243] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.482918 3582 raft_consensus.cc:2272] T 41c702c434fc4bcb828c246a7017a83a P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.484647 3582 tablet_replica.cc:333] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.485137 3582 raft_consensus.cc:2243] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 3 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.485744 3582 raft_consensus.cc:2272] T ab4ec5b0032a4b08911b6e8b1658e45a P 5036bd38367e48199b8de47d7853fc87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.487632 3582 tablet_replica.cc:333] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.488073 3582 raft_consensus.cc:2243] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.488662 3582 raft_consensus.cc:2272] T 04729c698ede46c78868c2040e9ad38b P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.490433 3582 tablet_replica.cc:333] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.490836 3582 raft_consensus.cc:2243] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.491420 3582 raft_consensus.cc:2272] T 8c4eb5b0abcd4df983923718c800b998 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.493209 3582 tablet_replica.cc:333] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.493669 3582 raft_consensus.cc:2243] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.494169 3582 raft_consensus.cc:2272] T a6bc150b80ac43d98ea0998dc4e23d6f P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.495842 3582 tablet_replica.cc:333] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.496258 3582 raft_consensus.cc:2243] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.496667 3582 raft_consensus.cc:2272] T 802f137e22714b5ea0ee9530e62d2db1 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.498404 3582 tablet_replica.cc:333] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.498790 3582 raft_consensus.cc:2243] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:38.499279 3582 raft_consensus.cc:2272] T 6210fe45bb654298a404f65b1c766d88 P 5036bd38367e48199b8de47d7853fc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.500893 3582 tablet_replica.cc:333] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87: stopping tablet replica
I20260926 13:55:38.501291 3582 raft_consensus.cc:2243] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 2 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.501884 3582 raft_consensus.cc:2272] T 5fcba31649db42f58ce04c10758ca297 P 5036bd38367e48199b8de47d7853fc87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.530515 3582 tablet_server.cc:196] TabletServer@127.3.127.131:0 shutdown complete.
I20260926 13:55:38.551306 3582 master.cc:562] Master@127.3.127.190:33623 shutting down...
I20260926 13:55:38.567713 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 2 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.568143 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9714e31f3fdd481d878fde11cc13c8ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.568432 3582 tablet_replica.cc:333] stopping tablet replica
I20260926 13:55:38.587055 3582 master.cc:584] Master@127.3.127.190:33623 shutdown complete.
[ OK ] PickServer/ReplicaSelectionTest.ReplicaSelection/0 (11932 ms)
[ RUN ] PickServer/ReplicaSelectionTest.ReplicaSelection/1
I20260926 13:55:38.622625 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:44467
I20260926 13:55:38.623678 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:38.629025 9701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:38.629132 9700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:38.629557 9703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:38.630339 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:38.631037 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:38.631203 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:38.631313 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430938631302 us; error 0 us; skew 500 ppm
I20260926 13:55:38.631721 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:38.633757 3582 webserver.cc:533] Webserver started at http://127.3.127.190:34087/ using document root <none> and password file <none>
I20260926 13:55:38.634192 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:38.634361 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:38.634610 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:38.635622 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "9ea95e465eea4cc4964d03e87a40a20f"
format_stamp: "Formatted at 2026-09-26 13:55:38 on dist-test-slave-fk7n"
I20260926 13:55:38.639725 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260926 13:55:38.642652 9708 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:38.643306 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:38.643550 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "9ea95e465eea4cc4964d03e87a40a20f"
format_stamp: "Formatted at 2026-09-26 13:55:38 on dist-test-slave-fk7n"
I20260926 13:55:38.643787 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:38.658717 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:38.659722 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:38.694085 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:44467
I20260926 13:55:38.694208 9759 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:44467 every 8 connection(s)
I20260926 13:55:38.697585 9760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:38.707580 9760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: Bootstrap starting.
I20260926 13:55:38.711961 9760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:38.715664 9760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: No bootstrap required, opened a new log
I20260926 13:55:38.717610 9760 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:38.717949 9760 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:38.718120 9760 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea95e465eea4cc4964d03e87a40a20f, State: Initialized, Role: FOLLOWER
I20260926 13:55:38.718570 9760 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:38.718976 9760 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:38.719151 9760 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:38.719347 9760 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:38.723591 9760 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:38.724018 9760 leader_election.cc:304] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ea95e465eea4cc4964d03e87a40a20f; no voters:
I20260926 13:55:38.724994 9760 leader_election.cc:290] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:38.725313 9763 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:38.726420 9763 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 LEADER]: Becoming Leader. State: Replica: 9ea95e465eea4cc4964d03e87a40a20f, State: Running, Role: LEADER
I20260926 13:55:38.727010 9763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:38.727568 9760 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:38.731029 9764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ea95e465eea4cc4964d03e87a40a20f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER } }
I20260926 13:55:38.731580 9764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:38.732203 9765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ea95e465eea4cc4964d03e87a40a20f. Latest consensus state: current_term: 1 leader_uuid: "9ea95e465eea4cc4964d03e87a40a20f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER } }
I20260926 13:55:38.732664 9765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:38.733284 9770 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:38.737703 9770 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:38.742009 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:38.745411 9770 catalog_manager.cc:1396] Generated new cluster ID: 1ac72ef4a3c944499a7ee8a8ab4798a3
I20260926 13:55:38.745625 9770 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:38.770392 9770 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:38.771456 9770 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:38.782328 9770 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: Generated new TSK 0
I20260926 13:55:38.782786 9770 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:38.808338 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:38.813659 9781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:38.814416 9782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:38.815727 9784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:38.816483 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:38.817317 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:38.817502 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:38.817658 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430938817642 us; error 0 us; skew 500 ppm
I20260926 13:55:38.818132 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:38.820210 3582 webserver.cc:533] Webserver started at http://127.3.127.129:43179/ using document root <none> and password file <none>
I20260926 13:55:38.820622 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:38.820814 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:38.821061 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:38.822043 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
format_stamp: "Formatted at 2026-09-26 13:55:38 on dist-test-slave-fk7n"
I20260926 13:55:38.826136 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260926 13:55:38.829118 9789 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:38.829809 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:38.830058 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
format_stamp: "Formatted at 2026-09-26 13:55:38 on dist-test-slave-fk7n"
I20260926 13:55:38.830299 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:38.850217 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:38.851233 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:38.852584 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:38.854593 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:38.854769 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:38.854979 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:38.855120 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:38.890903 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:33327
I20260926 13:55:38.891001 9851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:33327 every 8 connection(s)
I20260926 13:55:38.908193 9852 heartbeater.cc:344] Connected to a master server at 127.3.127.190:44467
I20260926 13:55:38.908511 9852 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:38.909183 9852 heartbeater.cc:507] Master 127.3.127.190:44467 requested a full tablet report, sending...
I20260926 13:55:38.910955 9725 ts_manager.cc:194] Registered new tserver with Master: 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:33327)
I20260926 13:55:38.911167 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.017254419s
I20260926 13:55:38.912537 9725 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50814
I20260926 13:55:38.929644 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:38.943652 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:38.958578 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:38.965188 3582 master.cc:562] Master@127.3.127.190:44467 shutting down...
I20260926 13:55:38.976711 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:38.977171 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:38.977519 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: stopping tablet replica
I20260926 13:55:38.995684 3582 master.cc:584] Master@127.3.127.190:44467 shutdown complete.
I20260926 13:55:39.006165 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:42917
I20260926 13:55:39.007140 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:39.011279 9862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:39.012095 9863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:39.012923 9865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:39.013339 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:39.014060 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:39.014222 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:39.014356 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430939014342 us; error 0 us; skew 500 ppm
I20260926 13:55:39.014828 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:39.016738 3582 webserver.cc:533] Webserver started at http://127.3.127.190:35605/ using document root <none> and password file <none>
I20260926 13:55:39.017146 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:39.017282 3582 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260926 13:55:39.020287 3582 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:39.022694 9870 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.023342 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260926 13:55:39.023594 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "9ea95e465eea4cc4964d03e87a40a20f"
format_stamp: "Formatted at 2026-09-26 13:55:38 on dist-test-slave-fk7n"
I20260926 13:55:39.023844 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:39.034006 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:39.034837 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:39.065869 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:42917
I20260926 13:55:39.065961 9921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:42917 every 8 connection(s)
I20260926 13:55:39.076066 9922 sys_catalog.cc:263] Verifying existing consensus state
I20260926 13:55:39.080472 9922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: Bootstrap starting.
I20260926 13:55:39.098292 9922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260926 13:55:39.099045 9922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: Bootstrap complete.
I20260926 13:55:39.101002 9922 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:39.101356 9922 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea95e465eea4cc4964d03e87a40a20f, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.101913 9922 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:39.102311 9922 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:39.102512 9922 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:39.102742 9922 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:39.106798 9922 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:39.107306 9922 leader_election.cc:304] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ea95e465eea4cc4964d03e87a40a20f; no voters:
I20260926 13:55:39.108376 9922 leader_election.cc:290] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260926 13:55:39.108619 9925 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:39.109835 9925 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 2 LEADER]: Becoming Leader. State: Replica: 9ea95e465eea4cc4964d03e87a40a20f, State: Running, Role: LEADER
I20260926 13:55:39.110443 9925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER }
I20260926 13:55:39.110905 9922 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:39.112982 9927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ea95e465eea4cc4964d03e87a40a20f. Latest consensus state: current_term: 2 leader_uuid: "9ea95e465eea4cc4964d03e87a40a20f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER } }
I20260926 13:55:39.113050 9926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9ea95e465eea4cc4964d03e87a40a20f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea95e465eea4cc4964d03e87a40a20f" member_type: VOTER } }
I20260926 13:55:39.113667 9927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:39.113669 9926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:39.116953 9931 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:39.124887 9931 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:39.125721 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:39.127758 9931 catalog_manager.cc:1308] Loaded cluster ID: 1ac72ef4a3c944499a7ee8a8ab4798a3
I20260926 13:55:39.127981 9931 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:39.131970 9931 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:39.134546 9931 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f: Loaded TSK: 0
I20260926 13:55:39.135175 9931 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:39.142725 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:39.147807 9942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:39.148833 9943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:39.149907 9945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:39.150148 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:39.150923 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:39.151101 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:39.151264 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430939151248 us; error 0 us; skew 500 ppm
I20260926 13:55:39.151744 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:39.153832 3582 webserver.cc:533] Webserver started at http://127.3.127.129:42601/ using document root <none> and password file <none>
I20260926 13:55:39.154247 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:39.154409 3582 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260926 13:55:39.157521 3582 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260926 13:55:39.159821 9950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.160473 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:39.160732 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
format_stamp: "Formatted at 2026-09-26 13:55:38 on dist-test-slave-fk7n"
I20260926 13:55:39.161026 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:39.172299 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:39.173246 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:39.174492 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:39.176446 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:39.176623 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.176851 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:39.176992 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.210357 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:40541
I20260926 13:55:39.210441 10012 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:40541 every 8 connection(s)
I20260926 13:55:39.214623 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:39.220463 10017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:39.221383 10018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:39.225191 3582 server_base.cc:1061] running on GCE node
W20260926 13:55:39.225786 10020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:39.226600 10013 heartbeater.cc:344] Connected to a master server at 127.3.127.190:42917
I20260926 13:55:39.226712 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260926 13:55:39.226958 10013 heartbeater.cc:461] Registering TS with master...
W20260926 13:55:39.226964 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:39.227298 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430939227279 us; error 0 us; skew 500 ppm
I20260926 13:55:39.227726 10013 heartbeater.cc:507] Master 127.3.127.190:42917 requested a full tablet report, sending...
I20260926 13:55:39.227821 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:39.230057 9887 ts_manager.cc:194] Registered new tserver with Master: 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541)
I20260926 13:55:39.230243 3582 webserver.cc:533] Webserver started at http://127.3.127.130:37401/ using document root <none> and password file <none>
I20260926 13:55:39.230858 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:39.231088 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:39.231400 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:39.232357 9887 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56676
I20260926 13:55:39.232863 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-1-root/instance:
uuid: "1d63c29c36a149a3b182bb644a756216"
format_stamp: "Formatted at 2026-09-26 13:55:39 on dist-test-slave-fk7n"
I20260926 13:55:39.237183 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260926 13:55:39.240013 10025 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.240676 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:39.240972 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-1-root
uuid: "1d63c29c36a149a3b182bb644a756216"
format_stamp: "Formatted at 2026-09-26 13:55:39 on dist-test-slave-fk7n"
I20260926 13:55:39.241218 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:39.257937 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:39.258899 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:39.260157 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:39.262153 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:39.262332 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.262614 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:39.262770 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.298660 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.130:41257
I20260926 13:55:39.298753 10087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.130:41257 every 8 connection(s)
I20260926 13:55:39.303016 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:39.309345 10091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:39.311512 10092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:39.313045 10094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:39.313535 10088 heartbeater.cc:344] Connected to a master server at 127.3.127.190:42917
I20260926 13:55:39.313849 10088 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:39.314128 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:39.314683 10088 heartbeater.cc:507] Master 127.3.127.190:42917 requested a full tablet report, sending...
I20260926 13:55:39.315142 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:39.315408 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:39.315611 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430939315591 us; error 0 us; skew 500 ppm
I20260926 13:55:39.316136 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:39.316735 9887 ts_manager.cc:194] Registered new tserver with Master: 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:39.318264 9887 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56688
I20260926 13:55:39.318410 3582 webserver.cc:533] Webserver started at http://127.3.127.131:34345/ using document root <none> and password file <none>
I20260926 13:55:39.318889 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:39.319073 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:39.319355 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:39.320721 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-2-root/instance:
uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
format_stamp: "Formatted at 2026-09-26 13:55:39 on dist-test-slave-fk7n"
I20260926 13:55:39.324806 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260926 13:55:39.327672 10099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.328320 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:39.328576 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-2-root
uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
format_stamp: "Formatted at 2026-09-26 13:55:39 on dist-test-slave-fk7n"
I20260926 13:55:39.328850 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_1.1790430890430161-3582-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:39.338950 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:39.339979 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:39.341274 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:39.343295 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:39.343478 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.343685 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:39.343830 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:39.379276 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.131:35405
I20260926 13:55:39.379383 10161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.131:35405 every 8 connection(s)
I20260926 13:55:39.391404 10162 heartbeater.cc:344] Connected to a master server at 127.3.127.190:42917
I20260926 13:55:39.391746 10162 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:39.392380 10162 heartbeater.cc:507] Master 127.3.127.190:42917 requested a full tablet report, sending...
I20260926 13:55:39.394138 9887 ts_manager.cc:194] Registered new tserver with Master: 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:39.395159 3582 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013040501s
I20260926 13:55:39.395342 9887 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56694
I20260926 13:55:39.416831 9887 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56702:
name: "replica_selection"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 10
seed: 0
}
}
W20260926 13:55:39.419133 9887 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replica_selection in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260926 13:55:39.496446 10053 tablet_service.cc:1511] Processing CreateTablet for tablet 6155ca469bbe44b5aa53b1187d8b2275 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.497859 10053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6155ca469bbe44b5aa53b1187d8b2275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.500834 10052 tablet_service.cc:1511] Processing CreateTablet for tablet f1e5c84225d648068b3f09943afc68fd (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.502081 10052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e5c84225d648068b3f09943afc68fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.510504 9978 tablet_service.cc:1511] Processing CreateTablet for tablet 6155ca469bbe44b5aa53b1187d8b2275 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.511705 9978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6155ca469bbe44b5aa53b1187d8b2275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.513831 9977 tablet_service.cc:1511] Processing CreateTablet for tablet f1e5c84225d648068b3f09943afc68fd (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.515069 9977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e5c84225d648068b3f09943afc68fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.517333 9970 tablet_service.cc:1511] Processing CreateTablet for tablet de68f7f38cd24ca6a790bf0fdef2e2ee (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.518504 9970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de68f7f38cd24ca6a790bf0fdef2e2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.518594 9969 tablet_service.cc:1511] Processing CreateTablet for tablet e4f583082bc049b4ae9a7c2220868f51 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.519727 9969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f583082bc049b4ae9a7c2220868f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.521085 9971 tablet_service.cc:1511] Processing CreateTablet for tablet c914e93a086e481b94f4bed906ebfa4a (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.521862 10127 tablet_service.cc:1511] Processing CreateTablet for tablet 6155ca469bbe44b5aa53b1187d8b2275 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.522284 9975 tablet_service.cc:1511] Processing CreateTablet for tablet 523e7742341b4ca8a544a267c5395c42 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.526364 10125 tablet_service.cc:1511] Processing CreateTablet for tablet e5fe5d563d764533891c35615cf01b45 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.527329 10122 tablet_service.cc:1511] Processing CreateTablet for tablet f1955e4b3c9e48b0b2f0e17785af7393 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.527683 10124 tablet_service.cc:1511] Processing CreateTablet for tablet 523e7742341b4ca8a544a267c5395c42 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.528162 10118 tablet_service.cc:1511] Processing CreateTablet for tablet e4f583082bc049b4ae9a7c2220868f51 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.521096 9976 tablet_service.cc:1511] Processing CreateTablet for tablet e5fe5d563d764533891c35615cf01b45 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.529356 10119 tablet_service.cc:1511] Processing CreateTablet for tablet de68f7f38cd24ca6a790bf0fdef2e2ee (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.529495 10126 tablet_service.cc:1511] Processing CreateTablet for tablet f1e5c84225d648068b3f09943afc68fd (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.525624 9974 tablet_service.cc:1511] Processing CreateTablet for tablet 6918359cdac249d28234d5119e4093df (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.529264 9971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c914e93a086e481b94f4bed906ebfa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.530887 9974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6918359cdac249d28234d5119e4093df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.531147 9972 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae0b96000a041c5b2805e677eacb595 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.532264 9972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae0b96000a041c5b2805e677eacb595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.533103 9976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5fe5d563d764533891c35615cf01b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.533767 10123 tablet_service.cc:1511] Processing CreateTablet for tablet 6918359cdac249d28234d5119e4093df (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.534758 9975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523e7742341b4ca8a544a267c5395c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.535437 10121 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae0b96000a041c5b2805e677eacb595 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.537106 9973 tablet_service.cc:1511] Processing CreateTablet for tablet f1955e4b3c9e48b0b2f0e17785af7393 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.538259 9973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1955e4b3c9e48b0b2f0e17785af7393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.541631 10120 tablet_service.cc:1511] Processing CreateTablet for tablet c914e93a086e481b94f4bed906ebfa4a (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.543768 10052 tablet_service.cc:1511] Processing CreateTablet for tablet e5fe5d563d764533891c35615cf01b45 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.544931 10052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5fe5d563d764533891c35615cf01b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.545823 10051 tablet_service.cc:1511] Processing CreateTablet for tablet 523e7742341b4ca8a544a267c5395c42 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.546377 10048 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae0b96000a041c5b2805e677eacb595 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.547057 10051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523e7742341b4ca8a544a267c5395c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.545826 10047 tablet_service.cc:1511] Processing CreateTablet for tablet c914e93a086e481b94f4bed906ebfa4a (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.548511 10047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c914e93a086e481b94f4bed906ebfa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.549786 10050 tablet_service.cc:1511] Processing CreateTablet for tablet 6918359cdac249d28234d5119e4093df (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.550966 10050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6918359cdac249d28234d5119e4093df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.553054 10048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae0b96000a041c5b2805e677eacb595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.553838 10049 tablet_service.cc:1511] Processing CreateTablet for tablet f1955e4b3c9e48b0b2f0e17785af7393 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.555029 10049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1955e4b3c9e48b0b2f0e17785af7393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.564429 10046 tablet_service.cc:1511] Processing CreateTablet for tablet de68f7f38cd24ca6a790bf0fdef2e2ee (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.565712 10046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de68f7f38cd24ca6a790bf0fdef2e2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.566325 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f583082bc049b4ae9a7c2220868f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.569368 10125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5fe5d563d764533891c35615cf01b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.570286 10121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae0b96000a041c5b2805e677eacb595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.571010 10126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e5c84225d648068b3f09943afc68fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.572209 10124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 523e7742341b4ca8a544a267c5395c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.573818 10122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1955e4b3c9e48b0b2f0e17785af7393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.576205 10123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6918359cdac249d28234d5119e4093df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.577760 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de68f7f38cd24ca6a790bf0fdef2e2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.585072 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c914e93a086e481b94f4bed906ebfa4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.604399 10127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6155ca469bbe44b5aa53b1187d8b2275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.657981 10178 tablet_bootstrap.cc:492] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:39.665385 10179 tablet_bootstrap.cc:492] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:39.673511 10053 tablet_service.cc:1511] Processing CreateTablet for tablet e4f583082bc049b4ae9a7c2220868f51 (DEFAULT_TABLE table=replica_selection [id=d29460e11e3548d9a7db279c406d30b4]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:39.674814 10053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f583082bc049b4ae9a7c2220868f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:39.683997 10180 tablet_bootstrap.cc:492] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:39.684900 10178 tablet_bootstrap.cc:654] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.686969 10179 tablet_bootstrap.cc:654] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.690217 10180 tablet_bootstrap.cc:654] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.693663 10178 tablet_bootstrap.cc:492] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:39.694002 10178 ts_tablet_manager.cc:1403] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.000s
I20260926 13:55:39.695883 10178 raft_consensus.cc:359] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.696362 10178 raft_consensus.cc:385] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.696599 10178 raft_consensus.cc:740] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.697224 10178 consensus_queue.cc:260] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.698976 10088 heartbeater.cc:499] Master 127.3.127.190:42917 was elected leader, sending a full tablet report...
I20260926 13:55:39.699690 10179 tablet_bootstrap.cc:492] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:39.700049 10179 ts_tablet_manager.cc:1403] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.000s
I20260926 13:55:39.701932 10178 ts_tablet_manager.cc:1434] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260926 13:55:39.702878 10178 tablet_bootstrap.cc:492] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:39.702729 10179 raft_consensus.cc:359] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.703408 10180 tablet_bootstrap.cc:492] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:39.703505 10179 raft_consensus.cc:385] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.703933 10179 raft_consensus.cc:740] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.703958 10180 ts_tablet_manager.cc:1403] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.009s
I20260926 13:55:39.704875 10179 consensus_queue.cc:260] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.706971 10180 raft_consensus.cc:359] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.707715 10180 raft_consensus.cc:385] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.708051 10180 raft_consensus.cc:740] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.709355 10178 tablet_bootstrap.cc:654] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.708966 10180 consensus_queue.cc:260] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.717475 10162 heartbeater.cc:499] Master 127.3.127.190:42917 was elected leader, sending a full tablet report...
I20260926 13:55:39.726495 10180 ts_tablet_manager.cc:1434] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.022s user 0.008s sys 0.004s
I20260926 13:55:39.727418 10180 tablet_bootstrap.cc:492] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:39.733600 10180 tablet_bootstrap.cc:654] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.737943 10179 ts_tablet_manager.cc:1434] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.038s user 0.012s sys 0.026s
I20260926 13:55:39.738871 10179 tablet_bootstrap.cc:492] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:39.739044 10013 heartbeater.cc:499] Master 127.3.127.190:42917 was elected leader, sending a full tablet report...
I20260926 13:55:39.739607 10178 tablet_bootstrap.cc:492] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:39.740058 10178 ts_tablet_manager.cc:1403] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.024s
I20260926 13:55:39.742880 10178 raft_consensus.cc:359] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.743589 10178 raft_consensus.cc:385] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.743854 10178 raft_consensus.cc:740] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.744592 10178 consensus_queue.cc:260] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.745213 10179 tablet_bootstrap.cc:654] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.746876 10178 ts_tablet_manager.cc:1434] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260926 13:55:39.747730 10178 tablet_bootstrap.cc:492] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:39.753787 10178 tablet_bootstrap.cc:654] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.758884 10179 tablet_bootstrap.cc:492] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:39.759218 10178 tablet_bootstrap.cc:492] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:39.759326 10179 ts_tablet_manager.cc:1403] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.012s
I20260926 13:55:39.759656 10178 ts_tablet_manager.cc:1403] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.008s
I20260926 13:55:39.759303 10180 tablet_bootstrap.cc:492] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:39.761282 10180 ts_tablet_manager.cc:1403] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.034s user 0.015s sys 0.001s
I20260926 13:55:39.762004 10178 raft_consensus.cc:359] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.762306 10179 raft_consensus.cc:359] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.762844 10178 raft_consensus.cc:385] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.763258 10179 raft_consensus.cc:385] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.763430 10178 raft_consensus.cc:740] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.763643 10179 raft_consensus.cc:740] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.764015 10180 raft_consensus.cc:359] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.764335 10178 consensus_queue.cc:260] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.764997 10180 raft_consensus.cc:385] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.765324 10180 raft_consensus.cc:740] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.764474 10179 consensus_queue.cc:260] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.766559 10178 ts_tablet_manager.cc:1434] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260926 13:55:39.766209 10180 consensus_queue.cc:260] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.767443 10179 ts_tablet_manager.cc:1434] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260926 13:55:39.767508 10178 tablet_bootstrap.cc:492] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:39.772023 10179 tablet_bootstrap.cc:492] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:39.773952 10178 tablet_bootstrap.cc:654] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.775491 10180 ts_tablet_manager.cc:1434] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260926 13:55:39.777879 10180 tablet_bootstrap.cc:492] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:39.783438 10179 tablet_bootstrap.cc:654] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.784011 10180 tablet_bootstrap.cc:654] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.788267 10178 tablet_bootstrap.cc:492] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:39.788290 10179 tablet_bootstrap.cc:492] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:39.788797 10178 ts_tablet_manager.cc:1403] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.011s
I20260926 13:55:39.788919 10179 ts_tablet_manager.cc:1403] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.002s
I20260926 13:55:39.791124 10180 tablet_bootstrap.cc:492] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:39.791087 10179 raft_consensus.cc:359] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.791625 10180 ts_tablet_manager.cc:1403] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.009s
I20260926 13:55:39.791680 10179 raft_consensus.cc:385] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.791441 10178 raft_consensus.cc:359] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.792098 10179 raft_consensus.cc:740] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.792187 10178 raft_consensus.cc:385] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.792541 10178 raft_consensus.cc:740] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.792734 10179 consensus_queue.cc:260] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.793444 10178 consensus_queue.cc:260] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.794741 10179 ts_tablet_manager.cc:1434] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260926 13:55:39.794404 10180 raft_consensus.cc:359] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.795167 10180 raft_consensus.cc:385] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.795482 10180 raft_consensus.cc:740] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.795719 10179 tablet_bootstrap.cc:492] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:39.796344 10180 consensus_queue.cc:260] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.797497 10178 ts_tablet_manager.cc:1434] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260926 13:55:39.798439 10178 tablet_bootstrap.cc:492] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:39.801030 10180 ts_tablet_manager.cc:1434] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260926 13:55:39.802043 10179 tablet_bootstrap.cc:654] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.804373 10178 tablet_bootstrap.cc:654] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
W20260926 13:55:39.802337 10089 tablet.cc:2433] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260926 13:55:39.802014 10180 tablet_bootstrap.cc:492] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:39.817029 10180 tablet_bootstrap.cc:654] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.819694 10179 tablet_bootstrap.cc:492] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:39.819990 10178 tablet_bootstrap.cc:492] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:39.820201 10179 ts_tablet_manager.cc:1403] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.008s
I20260926 13:55:39.820556 10178 ts_tablet_manager.cc:1403] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.011s
I20260926 13:55:39.823133 10179 raft_consensus.cc:359] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.823954 10179 raft_consensus.cc:385] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.823602 10178 raft_consensus.cc:359] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.824352 10179 raft_consensus.cc:740] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.824592 10178 raft_consensus.cc:385] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.825030 10178 raft_consensus.cc:740] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.825258 10179 consensus_queue.cc:260] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.825954 10178 consensus_queue.cc:260] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.827482 10179 ts_tablet_manager.cc:1434] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260926 13:55:39.828398 10179 tablet_bootstrap.cc:492] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:39.831321 10178 ts_tablet_manager.cc:1434] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260926 13:55:39.832383 10178 tablet_bootstrap.cc:492] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:39.837371 10179 tablet_bootstrap.cc:654] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.838759 10178 tablet_bootstrap.cc:654] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.841252 10180 tablet_bootstrap.cc:492] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:39.841740 10180 ts_tablet_manager.cc:1403] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.040s user 0.022s sys 0.009s
I20260926 13:55:39.844630 10180 raft_consensus.cc:359] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.845439 10180 raft_consensus.cc:385] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.845777 10180 raft_consensus.cc:740] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.846647 10180 consensus_queue.cc:260] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.848444 10179 tablet_bootstrap.cc:492] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:39.848860 10180 ts_tablet_manager.cc:1434] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260926 13:55:39.848956 10179 ts_tablet_manager.cc:1403] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.021s user 0.013s sys 0.003s
I20260926 13:55:39.850018 10180 tablet_bootstrap.cc:492] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:39.851861 10179 raft_consensus.cc:359] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.852581 10179 raft_consensus.cc:385] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.852936 10179 raft_consensus.cc:740] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.853685 10179 consensus_queue.cc:260] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.855162 10178 tablet_bootstrap.cc:492] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:39.855652 10178 ts_tablet_manager.cc:1403] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.023s user 0.022s sys 0.000s
I20260926 13:55:39.857265 10180 tablet_bootstrap.cc:654] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.857537 10179 ts_tablet_manager.cc:1434] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260926 13:55:39.858541 10179 tablet_bootstrap.cc:492] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:39.858367 10178 raft_consensus.cc:359] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.859143 10178 raft_consensus.cc:385] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.859490 10178 raft_consensus.cc:740] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.859699 10186 raft_consensus.cc:493] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:39.860131 10186 raft_consensus.cc:515] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.860301 10178 consensus_queue.cc:260] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.862556 10186 leader_election.cc:290] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:39.864738 10179 tablet_bootstrap.cc:654] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.865967 10178 ts_tablet_manager.cc:1434] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260926 13:55:39.866809 10178 tablet_bootstrap.cc:492] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:39.872407 10178 tablet_bootstrap.cc:654] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.873364 10185 raft_consensus.cc:493] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:39.873812 10185 raft_consensus.cc:515] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.876276 10185 leader_election.cc:290] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:39.878441 10179 tablet_bootstrap.cc:492] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:39.878819 10179 ts_tablet_manager.cc:1403] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.003s
I20260926 13:55:39.881373 10179 raft_consensus.cc:359] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.882144 10179 raft_consensus.cc:385] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.882501 10179 raft_consensus.cc:740] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.883246 10179 consensus_queue.cc:260] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.884220 10185 raft_consensus.cc:493] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:39.883064 9988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c914e93a086e481b94f4bed906ebfa4a" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:39.884684 10185 raft_consensus.cc:515] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.885161 9988 raft_consensus.cc:2468] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in term 0.
I20260926 13:55:39.886497 10185 leader_election.cc:290] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:39.886689 10101 leader_election.cc:304] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:39.889707 10186 raft_consensus.cc:2804] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:39.890154 10186 raft_consensus.cc:493] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:39.890537 10186 raft_consensus.cc:3060] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:39.896790 10179 ts_tablet_manager.cc:1434] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.018s user 0.002s sys 0.009s
I20260926 13:55:39.897868 10179 tablet_bootstrap.cc:492] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:39.904107 10179 tablet_bootstrap.cc:654] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:39.907171 10184 raft_consensus.cc:493] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:39.907657 10184 raft_consensus.cc:515] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.917125 10184 leader_election.cc:290] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:39.935361 10204 raft_consensus.cc:493] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:39.935850 10204 raft_consensus.cc:515] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.937768 10204 leader_election.cc:290] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:39.939364 10180 tablet_bootstrap.cc:492] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:39.939864 10180 ts_tablet_manager.cc:1403] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.005s
I20260926 13:55:39.941443 10186 raft_consensus.cc:515] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.945369 10184 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:39.947116 10184 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.949165 10184 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:39.948563 10180 raft_consensus.cc:359] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.950965 10180 raft_consensus.cc:385] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:39.951710 10180 raft_consensus.cc:740] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:39.951923 9988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c914e93a086e481b94f4bed906ebfa4a" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:39.952613 9988 raft_consensus.cc:3060] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:39.959501 10209 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:39.959990 10209 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.960646 9988 raft_consensus.cc:2468] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in term 1.
I20260926 13:55:39.962234 10101 leader_election.cc:304] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:39.964001 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:39.970165 10186 leader_election.cc:290] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:39.970757 10186 raft_consensus.cc:2804] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:39.971212 10186 raft_consensus.cc:697] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 LEADER]: Becoming Leader. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Running, Role: LEADER
I20260926 13:55:39.972000 10186 consensus_queue.cc:237] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.972980 10184 raft_consensus.cc:493] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.009058 10184 raft_consensus.cc:515] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.011102 10184 leader_election.cc:290] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
W20260926 13:55:39.978267 10101 leader_election.cc:343] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:39.979094 10180 consensus_queue.cc:260] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.013453 10180 ts_tablet_manager.cc:1434] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260926 13:55:40.013808 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6918359cdac249d28234d5119e4093df" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.014478 10180 tablet_bootstrap.cc:492] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:40.015257 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.015934 10136 raft_consensus.cc:2468] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:39.986555 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c914e93a086e481b94f4bed906ebfa4a" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:39.987962 10062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
W20260926 13:55:40.017994 10029 leader_election.cc:343] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:39.989360 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c914e93a086e481b94f4bed906ebfa4a" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:40.018756 10029 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:40.018079 10062 raft_consensus.cc:2468] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in term 0.
I20260926 13:55:40.019811 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.020479 10136 raft_consensus.cc:2468] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:40.021828 10029 leader_election.cc:304] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:40.022857 10184 raft_consensus.cc:2804] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.023226 10184 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.023524 10184 raft_consensus.cc:3060] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
W20260926 13:55:40.025295 10103 leader_election.cc:343] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257): Illegal state: must be running to vote when last-logged opid is not known
W20260926 13:55:40.026283 10103 leader_election.cc:343] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.027189 10103 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6
I20260926 13:55:40.027948 10180 tablet_bootstrap.cc:654] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.031052 10212 raft_consensus.cc:2804] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.031450 10212 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.031750 10212 raft_consensus.cc:3060] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.033771 10184 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:39.962069 10209 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:40.039158 10212 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.041736 10212 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:40.042232 9988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:40.043738 10062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:40.045529 10062 raft_consensus.cc:2393] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
W20260926 13:55:40.046754 10101 leader_election.cc:343] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.048216 10213 raft_consensus.cc:2804] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.048661 10213 raft_consensus.cc:493] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.049016 10213 raft_consensus.cc:3060] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.050577 10178 tablet_bootstrap.cc:492] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:40.051064 10178 ts_tablet_manager.cc:1403] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.184s user 0.070s sys 0.098s
I20260926 13:55:40.053215 10103 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216
I20260926 13:55:40.054231 10212 raft_consensus.cc:2749] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.053985 10178 raft_consensus.cc:359] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.054785 10179 tablet_bootstrap.cc:492] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:40.054818 10178 raft_consensus.cc:385] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.055457 10179 ts_tablet_manager.cc:1403] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.158s user 0.068s sys 0.075s
I20260926 13:55:40.055811 10178 raft_consensus.cc:740] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.056219 10215 raft_consensus.cc:493] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.056639 10215 raft_consensus.cc:515] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.056696 10178 consensus_queue.cc:260] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.058620 10179 raft_consensus.cc:359] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.059376 10179 raft_consensus.cc:385] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.059823 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6155ca469bbe44b5aa53b1187d8b2275" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.060566 10180 tablet_bootstrap.cc:492] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:40.063418 10063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68f7f38cd24ca6a790bf0fdef2e2ee" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.063429 10180 ts_tablet_manager.cc:1403] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.003s
I20260926 13:55:40.061654 10062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.062489 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.064889 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.063544 10212 raft_consensus.cc:493] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.064035 10063 raft_consensus.cc:2468] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 0.
I20260926 13:55:40.065485 9986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
W20260926 13:55:40.066009 10029 leader_election.cc:343] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.066120 9986 raft_consensus.cc:2468] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:40.066516 9954 leader_election.cc:304] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:40.066654 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6155ca469bbe44b5aa53b1187d8b2275" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.067128 9985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:40.067464 10204 raft_consensus.cc:2804] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.067922 10204 raft_consensus.cc:493] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260926 13:55:40.068075 10027 leader_election.cc:343] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.068270 10204 raft_consensus.cc:3060] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.061167 10179 raft_consensus.cc:740] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.070041 10179 consensus_queue.cc:260] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.067368 9987 raft_consensus.cc:2468] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:40.070686 10178 ts_tablet_manager.cc:1434] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.019s user 0.013s sys 0.000s
I20260926 13:55:40.071679 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.072240 10137 raft_consensus.cc:2468] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 0.
I20260926 13:55:40.072598 10179 ts_tablet_manager.cc:1434] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.017s user 0.005s sys 0.001s
I20260926 13:55:40.060258 10217 raft_consensus.cc:493] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.073490 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.070429 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.073873 10217 raft_consensus.cc:515] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.074328 10136 raft_consensus.cc:2393] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d63c29c36a149a3b182bb644a756216 in current term 1: Already voted for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in this term.
I20260926 13:55:40.075361 10178 tablet_bootstrap.cc:492] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
W20260926 13:55:40.076462 10027 leader_election.cc:343] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.077896 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.078421 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68f7f38cd24ca6a790bf0fdef2e2ee" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.078464 9987 raft_consensus.cc:2468] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:40.079227 10027 leader_election.cc:304] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters: 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.069239 10184 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.079959 10061 raft_consensus.cc:2468] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 0.
I20260926 13:55:40.080417 9954 leader_election.cc:304] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:40.080991 10184 raft_consensus.cc:2804] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.081302 10185 raft_consensus.cc:2804] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.064381 9988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6918359cdac249d28234d5119e4093df" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.073565 10179 tablet_bootstrap.cc:492] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:40.081760 10185 raft_consensus.cc:493] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.082193 10185 raft_consensus.cc:3060] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.082386 10178 tablet_bootstrap.cc:654] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.066025 10212 raft_consensus.cc:515] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.081382 10184 raft_consensus.cc:493] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.085016 10184 raft_consensus.cc:3060] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.085996 10212 leader_election.cc:290] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:40.087291 9988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f583082bc049b4ae9a7c2220868f51" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.075973 10217 leader_election.cc:290] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
W20260926 13:55:40.090351 10101 leader_election.cc:343] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.091995 10179 tablet_bootstrap.cc:654] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.088492 9954 leader_election.cc:304] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:40.098762 10184 raft_consensus.cc:515] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.100132 10184 leader_election.cc:290] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.085088 10029 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.092890 10185 raft_consensus.cc:515] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.101876 10185 leader_election.cc:290] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.093281 10180 raft_consensus.cc:359] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.102445 10180 raft_consensus.cc:385] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.102499 10185 raft_consensus.cc:2804] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.102888 10180 raft_consensus.cc:740] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.103044 10184 raft_consensus.cc:2749] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.103283 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6155ca469bbe44b5aa53b1187d8b2275" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.103657 10185 raft_consensus.cc:493] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.104071 10185 raft_consensus.cc:3060] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.103693 10180 consensus_queue.cc:260] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.093822 10178 tablet_bootstrap.cc:492] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:40.094947 10215 leader_election.cc:290] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.095153 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f583082bc049b4ae9a7c2220868f51" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.105104 10178 ts_tablet_manager.cc:1403] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.005s
I20260926 13:55:40.095580 10213 raft_consensus.cc:515] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.095885 9884 catalog_manager.cc:5838] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131). New cstate: current_term: 1 leader_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: HEALTHY } } }
W20260926 13:55:40.106633 10103 leader_election.cc:343] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.107069 10103 leader_election.cc:304] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216
W20260926 13:55:40.105034 10029 leader_election.cc:343] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.107564 10178 raft_consensus.cc:359] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.108213 10178 raft_consensus.cc:385] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.108450 10178 raft_consensus.cc:740] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.110533 10212 raft_consensus.cc:2749] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.110674 10180 ts_tablet_manager.cc:1434] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260926 13:55:40.111723 10180 tablet_bootstrap.cc:492] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:40.097186 10027 leader_election.cc:304] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:40.088887 10204 raft_consensus.cc:515] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.112255 10185 raft_consensus.cc:515] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.112233 10178 consensus_queue.cc:260] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.101945 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.114233 10185 leader_election.cc:290] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.114218 10204 leader_election.cc:290] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
W20260926 13:55:40.116118 10029 leader_election.cc:343] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.116937 10215 raft_consensus.cc:2804] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.117384 10215 raft_consensus.cc:493] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.117767 10215 raft_consensus.cc:3060] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.120429 10178 ts_tablet_manager.cc:1434] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260926 13:55:40.121320 10178 tablet_bootstrap.cc:492] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:40.122083 10180 tablet_bootstrap.cc:654] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.126600 10062 raft_consensus.cc:2393] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
I20260926 13:55:40.126986 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:40.127511 10213 leader_election.cc:290] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.127737 10061 raft_consensus.cc:2393] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
W20260926 13:55:40.131224 10027 leader_election.cc:343] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.133175 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.133730 10136 raft_consensus.cc:3060] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.133862 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.137347 10179 tablet_bootstrap.cc:492] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:40.137825 10179 ts_tablet_manager.cc:1403] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.007s
I20260926 13:55:40.139278 10178 tablet_bootstrap.cc:654] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.139081 10215 raft_consensus.cc:515] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.140475 10213 raft_consensus.cc:493] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.140779 10136 raft_consensus.cc:2468] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:40.140125 10179 raft_consensus.cc:359] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.141736 10215 leader_election.cc:290] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.141812 10179 raft_consensus.cc:385] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.142738 10179 raft_consensus.cc:740] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.143265 10179 consensus_queue.cc:260] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.145053 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68f7f38cd24ca6a790bf0fdef2e2ee" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.145691 10179 ts_tablet_manager.cc:1434] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260926 13:55:40.146772 10179 tablet_bootstrap.cc:492] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:40.146605 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68f7f38cd24ca6a790bf0fdef2e2ee" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:40.147081 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.147473 10061 raft_consensus.cc:3060] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.141680 10027 leader_election.cc:304] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.148909 10215 raft_consensus.cc:2749] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.149683 10062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:40.150787 10062 raft_consensus.cc:2393] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
I20260926 13:55:40.145356 10029 leader_election.cc:304] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
W20260926 13:55:40.152522 10029 leader_election.cc:343] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.153211 10215 raft_consensus.cc:2804] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:40.153663 10215 raft_consensus.cc:697] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Becoming Leader. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Running, Role: LEADER
I20260926 13:55:40.154377 10179 tablet_bootstrap.cc:654] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.154417 10215 consensus_queue.cc:237] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.142056 10213 raft_consensus.cc:515] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.158900 10213 leader_election.cc:290] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.159718 9988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6155ca469bbe44b5aa53b1187d8b2275" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:40.160351 9988 raft_consensus.cc:3060] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.159637 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e5c84225d648068b3f09943afc68fd" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:40.161306 9987 raft_consensus.cc:2393] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d63c29c36a149a3b182bb644a756216 in current term 1: Already voted for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in this term.
I20260926 13:55:40.163311 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1955e4b3c9e48b0b2f0e17785af7393" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.163872 10136 raft_consensus.cc:2468] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:40.165153 10029 leader_election.cc:304] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:40.165920 10213 raft_consensus.cc:2804] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.166291 10213 raft_consensus.cc:493] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.166632 10213 raft_consensus.cc:3060] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.167301 9988 raft_consensus.cc:2468] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:40.169214 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.171608 10180 tablet_bootstrap.cc:492] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:40.172168 10180 ts_tablet_manager.cc:1403] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.061s user 0.012s sys 0.002s
I20260926 13:55:40.172974 10213 raft_consensus.cc:515] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.175034 10180 raft_consensus.cc:359] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.175786 10180 raft_consensus.cc:385] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.176086 10180 raft_consensus.cc:740] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.158981 10061 raft_consensus.cc:2468] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 1.
I20260926 13:55:40.167588 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1955e4b3c9e48b0b2f0e17785af7393" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.177038 9987 raft_consensus.cc:2468] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:40.178927 10213 leader_election.cc:290] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.178640 10180 consensus_queue.cc:260] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.177049 10027 leader_election.cc:304] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters: 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.181720 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1955e4b3c9e48b0b2f0e17785af7393" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:40.182257 9987 raft_consensus.cc:3060] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
W20260926 13:55:40.184146 9954 leader_election.cc:343] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
W20260926 13:55:40.185061 9954 leader_election.cc:343] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
W20260926 13:55:40.186158 9954 leader_election.cc:343] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
W20260926 13:55:40.186762 9954 leader_election.cc:343] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.187649 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1955e4b3c9e48b0b2f0e17785af7393" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.160255 9985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:40.188827 9985 raft_consensus.cc:2393] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d63c29c36a149a3b182bb644a756216 in current term 1: Already voted for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in this term.
I20260926 13:55:40.189563 9987 raft_consensus.cc:2468] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:40.190064 10136 raft_consensus.cc:3060] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.190991 10180 ts_tablet_manager.cc:1434] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.018s user 0.002s sys 0.005s
I20260926 13:55:40.192903 10180 tablet_bootstrap.cc:492] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:40.198385 10027 leader_election.cc:304] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.200461 10184 raft_consensus.cc:493] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.201056 10027 leader_election.cc:304] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:40.201530 10219 raft_consensus.cc:2749] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.201915 10217 raft_consensus.cc:2804] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:40.202358 10217 raft_consensus.cc:697] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Becoming Leader. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Running, Role: LEADER
I20260926 13:55:40.202248 9954 leader_election.cc:304] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6; no voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.200918 10184 raft_consensus.cc:515] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.204901 10213 raft_consensus.cc:2804] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:40.207229 10221 raft_consensus.cc:2749] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.205215 10217 consensus_queue.cc:237] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.206436 10136 raft_consensus.cc:2468] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:40.208954 9954 leader_election.cc:304] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6; no voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.209203 10184 leader_election.cc:290] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.207234 10213 raft_consensus.cc:697] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Becoming Leader. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Running, Role: LEADER
I20260926 13:55:40.210204 10213 consensus_queue.cc:237] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.210846 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0b96000a041c5b2805e677eacb595" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
W20260926 13:55:40.212131 10029 leader_election.cc:343] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.207481 10180 tablet_bootstrap.cc:654] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.214967 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0b96000a041c5b2805e677eacb595" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.215600 9987 raft_consensus.cc:2468] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 0.
I20260926 13:55:40.218789 10178 tablet_bootstrap.cc:492] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:40.219480 10178 ts_tablet_manager.cc:1403] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.098s user 0.028s sys 0.038s
I20260926 13:55:40.219627 10221 raft_consensus.cc:2749] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.220784 10027 leader_election.cc:304] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters: 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.218732 9886 catalog_manager.cc:5838] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d63c29c36a149a3b182bb644a756216 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "1d63c29c36a149a3b182bb644a756216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:40.222095 10178 raft_consensus.cc:359] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.222393 9954 leader_election.cc:304] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters: 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.222718 10178 raft_consensus.cc:385] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.223009 10178 raft_consensus.cc:740] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.223196 10221 raft_consensus.cc:2804] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:40.223675 10221 raft_consensus.cc:697] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Running, Role: LEADER
I20260926 13:55:40.223618 10178 consensus_queue.cc:260] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.224603 10221 consensus_queue.cc:237] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.224599 10215 raft_consensus.cc:2804] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.225962 10178 ts_tablet_manager.cc:1434] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260926 13:55:40.225961 10215 raft_consensus.cc:493] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.226528 10215 raft_consensus.cc:3060] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.226987 10178 tablet_bootstrap.cc:492] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216: Bootstrap starting.
I20260926 13:55:40.232450 10178 tablet_bootstrap.cc:654] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.234387 10215 raft_consensus.cc:515] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.236605 10179 tablet_bootstrap.cc:492] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:40.237062 10179 ts_tablet_manager.cc:1403] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.091s user 0.025s sys 0.008s
I20260926 13:55:40.237805 10215 leader_election.cc:290] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.239503 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0b96000a041c5b2805e677eacb595" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
W20260926 13:55:40.240981 10029 leader_election.cc:343] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.239591 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0b96000a041c5b2805e677eacb595" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:40.241683 9987 raft_consensus.cc:3060] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.242129 10204 raft_consensus.cc:493] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.242545 10204 raft_consensus.cc:515] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.244402 10204 leader_election.cc:290] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.248653 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f583082bc049b4ae9a7c2220868f51" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.249924 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f583082bc049b4ae9a7c2220868f51" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.250625 10136 raft_consensus.cc:2468] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 0.
I20260926 13:55:40.252105 10178 tablet_bootstrap.cc:492] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216: No bootstrap required, opened a new log
I20260926 13:55:40.252612 10178 ts_tablet_manager.cc:1403] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.007s
I20260926 13:55:40.252017 9954 leader_election.cc:304] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:40.254606 10221 raft_consensus.cc:2804] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260926 13:55:40.254719 9954 leader_election.cc:343] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:40.255020 10221 raft_consensus.cc:493] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.255435 10221 raft_consensus.cc:3060] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.255304 10179 raft_consensus.cc:359] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.259720 10179 raft_consensus.cc:385] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.260429 10179 raft_consensus.cc:740] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.251673 9884 catalog_manager.cc:5838] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d63c29c36a149a3b182bb644a756216 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "1d63c29c36a149a3b182bb644a756216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:40.255103 10178 raft_consensus.cc:359] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.263692 9886 catalog_manager.cc:5838] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:40.264081 10178 raft_consensus.cc:385] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.262259 9884 catalog_manager.cc:5838] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d63c29c36a149a3b182bb644a756216 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "1d63c29c36a149a3b182bb644a756216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:40.265087 10179 consensus_queue.cc:260] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.265295 10178 raft_consensus.cc:740] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.268453 10221 raft_consensus.cc:515] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.269500 10179 ts_tablet_manager.cc:1434] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.032s user 0.005s sys 0.001s
I20260926 13:55:40.269263 10178 consensus_queue.cc:260] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.270469 10179 tablet_bootstrap.cc:492] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Bootstrap starting.
I20260926 13:55:40.270802 10221 leader_election.cc:290] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.271143 10178 ts_tablet_manager.cc:1434] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216: Time spent starting tablet: real 0.018s user 0.004s sys 0.002s
I20260926 13:55:40.267710 9987 raft_consensus.cc:2468] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:40.273057 10027 leader_election.cc:304] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters: 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.273767 10215 raft_consensus.cc:2804] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:40.274194 10215 raft_consensus.cc:697] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Becoming Leader. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Running, Role: LEADER
I20260926 13:55:40.274333 10180 tablet_bootstrap.cc:492] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:40.274293 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f583082bc049b4ae9a7c2220868f51" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:40.274878 10180 ts_tablet_manager.cc:1403] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.083s user 0.009s sys 0.013s
I20260926 13:55:40.274871 10061 raft_consensus.cc:3060] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.274976 10215 consensus_queue.cc:237] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.276026 10179 tablet_bootstrap.cc:654] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.277457 10180 raft_consensus.cc:359] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.278137 10180 raft_consensus.cc:385] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.278461 10180 raft_consensus.cc:740] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.279313 10180 consensus_queue.cc:260] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.281280 10180 ts_tablet_manager.cc:1434] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260926 13:55:40.282124 10180 tablet_bootstrap.cc:492] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:40.283084 10061 raft_consensus.cc:2468] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 1.
I20260926 13:55:40.283456 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f583082bc049b4ae9a7c2220868f51" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.285374 10136 raft_consensus.cc:3060] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.286276 9954 leader_election.cc:304] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:40.287140 10180 tablet_bootstrap.cc:654] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.287165 10221 raft_consensus.cc:2804] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:40.288408 10221 raft_consensus.cc:697] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Running, Role: LEADER
I20260926 13:55:40.289649 10221 consensus_queue.cc:237] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.292249 10136 raft_consensus.cc:2468] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 1.
I20260926 13:55:40.297555 10180 tablet_bootstrap.cc:492] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:40.297971 10180 ts_tablet_manager.cc:1403] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20260926 13:55:40.300431 10180 raft_consensus.cc:359] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.301049 10180 raft_consensus.cc:385] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.301319 10180 raft_consensus.cc:740] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.302297 10179 tablet_bootstrap.cc:492] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6: No bootstrap required, opened a new log
I20260926 13:55:40.301972 10180 consensus_queue.cc:260] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.302745 10179 ts_tablet_manager.cc:1403] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.001s
I20260926 13:55:40.303864 10180 ts_tablet_manager.cc:1434] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260926 13:55:40.304719 10180 tablet_bootstrap.cc:492] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Bootstrap starting.
I20260926 13:55:40.305213 10179 raft_consensus.cc:359] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.305963 10179 raft_consensus.cc:385] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.305218 9884 catalog_manager.cc:5838] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d63c29c36a149a3b182bb644a756216 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "1d63c29c36a149a3b182bb644a756216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:40.306241 10179 raft_consensus.cc:740] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.306941 10179 consensus_queue.cc:260] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.309104 10179 ts_tablet_manager.cc:1434] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260926 13:55:40.310298 10180 tablet_bootstrap.cc:654] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:40.316916 10180 tablet_bootstrap.cc:492] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e: No bootstrap required, opened a new log
I20260926 13:55:40.317299 10180 ts_tablet_manager.cc:1403] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260926 13:55:40.319362 9886 catalog_manager.cc:5838] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:40.319803 10180 raft_consensus.cc:359] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.320699 10180 raft_consensus.cc:385] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:40.320998 10180 raft_consensus.cc:740] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Initialized, Role: FOLLOWER
I20260926 13:55:40.321580 10180 consensus_queue.cc:260] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.323258 10180 ts_tablet_manager.cc:1434] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260926 13:55:40.372179 10221 raft_consensus.cc:493] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.372597 10221 raft_consensus.cc:515] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.374148 10221 leader_election.cc:290] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.374923 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6918359cdac249d28234d5119e4093df" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.375188 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6918359cdac249d28234d5119e4093df" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.375438 10061 raft_consensus.cc:2468] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 0.
I20260926 13:55:40.375728 10136 raft_consensus.cc:2468] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 0.
I20260926 13:55:40.376348 9954 leader_election.cc:304] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:40.377058 10221 raft_consensus.cc:2804] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:40.377395 10221 raft_consensus.cc:493] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:40.377729 10221 raft_consensus.cc:3060] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.382535 10221 raft_consensus.cc:515] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.384054 10221 leader_election.cc:290] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Requested vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.384603 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6918359cdac249d28234d5119e4093df" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:40.385104 10061 raft_consensus.cc:3060] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.385128 10136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6918359cdac249d28234d5119e4093df" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:40.385725 10136 raft_consensus.cc:3060] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.391786 10061 raft_consensus.cc:2468] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 1.
I20260926 13:55:40.391963 10136 raft_consensus.cc:2468] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in term 1.
I20260926 13:55:40.392881 9954 leader_election.cc:304] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:40.393450 10221 raft_consensus.cc:2804] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:40.393790 10221 raft_consensus.cc:697] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 LEADER]: Becoming Leader. State: Replica: 1ab9fbd9150c4c3ba9f1b2b987535aa6, State: Running, Role: LEADER
I20260926 13:55:40.394477 10221 consensus_queue.cc:237] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.400286 9886 catalog_manager.cc:5838] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:40.403373 10212 raft_consensus.cc:493] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.403728 10212 raft_consensus.cc:515] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.405596 10212 leader_election.cc:290] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:40.406203 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.406697 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.406924 9987 raft_consensus.cc:2393] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in current term 1: Already voted for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in this term.
I20260926 13:55:40.407425 10061 raft_consensus.cc:2393] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
I20260926 13:55:40.408347 10103 leader_election.cc:304] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216
I20260926 13:55:40.408928 10212 raft_consensus.cc:3060] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.413161 10212 raft_consensus.cc:2749] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.456861 10212 consensus_queue.cc:1048] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.464231 10186 raft_consensus.cc:493] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.464725 10186 raft_consensus.cc:515] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.466281 10061 raft_consensus.cc:3060] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.469658 10062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6155ca469bbe44b5aa53b1187d8b2275" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.470738 10186 leader_election.cc:290] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541)
I20260926 13:55:40.471436 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6155ca469bbe44b5aa53b1187d8b2275" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.472141 9987 raft_consensus.cc:2393] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
I20260926 13:55:40.473435 10103 leader_election.cc:304] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216
I20260926 13:55:40.474334 10186 raft_consensus.cc:3060] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.476130 10212 consensus_queue.cc:1048] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.479032 10186 raft_consensus.cc:2749] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.553202 10186 raft_consensus.cc:493] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.553599 10186 raft_consensus.cc:515] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.555294 10186 leader_election.cc:290] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:40.556017 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0b96000a041c5b2805e677eacb595" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.556715 9987 raft_consensus.cc:2393] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
I20260926 13:55:40.556721 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae0b96000a041c5b2805e677eacb595" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.558009 10103 leader_election.cc:304] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216
I20260926 13:55:40.558585 10186 raft_consensus.cc:3060] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.563210 10186 raft_consensus.cc:2749] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.619545 10215 consensus_queue.cc:1048] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.628739 10213 consensus_queue.cc:1048] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.646581 10213 consensus_queue.cc:1048] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.655045 10184 consensus_queue.cc:1048] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.658246 10217 consensus_queue.cc:1048] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.668641 10215 consensus_queue.cc:1048] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.674530 10217 consensus_queue.cc:1048] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.684171 10221 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.684652 10221 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.686575 10221 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:40.687548 10184 consensus_queue.cc:1048] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.687696 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.688433 10061 raft_consensus.cc:2393] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in current term 1: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
I20260926 13:55:40.690308 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:40.690912 10137 raft_consensus.cc:2393] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in current term 1: Already voted for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in this term.
I20260926 13:55:40.692348 9954 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6; no voters: 1d63c29c36a149a3b182bb644a756216, 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:40.694036 10221 raft_consensus.cc:3060] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.699184 10221 raft_consensus.cc:2749] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.747076 10221 consensus_queue.cc:1048] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.758961 10204 consensus_queue.cc:1048] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.766227 10186 raft_consensus.cc:493] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:40.766618 10186 raft_consensus.cc:515] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:40.768289 10186 leader_election.cc:290] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:40.769018 9985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68f7f38cd24ca6a790bf0fdef2e2ee" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:40.769719 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de68f7f38cd24ca6a790bf0fdef2e2ee" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:40.770432 10061 raft_consensus.cc:2393] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in current term 1: Already voted for candidate 1ab9fbd9150c4c3ba9f1b2b987535aa6 in this term.
I20260926 13:55:40.771306 10103 leader_election.cc:304] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216
I20260926 13:55:40.772334 10186 raft_consensus.cc:3060] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:40.777118 10186 raft_consensus.cc:2749] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:40.781881 10204 consensus_queue.cc:1048] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.790838 10256 consensus_queue.cc:1048] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:40.798125 10256 consensus_queue.cc:1048] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260926 13:55:40.809270 10204 consensus_queue.cc:1048] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:41.771438 10184 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:41.772078 10184 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.772718 10264 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:41.773308 10264 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.774281 10184 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:41.774981 9985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:41.775441 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:41.775992 9985 raft_consensus.cc:2468] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:41.776149 10137 raft_consensus.cc:2468] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:41.776587 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:41.776614 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216" is_pre_election: true
I20260926 13:55:41.777323 9987 raft_consensus.cc:2468] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in term 1.
I20260926 13:55:41.777383 10061 raft_consensus.cc:2468] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in term 1.
I20260926 13:55:41.777772 10264 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:41.777690 10027 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:41.778702 10184 raft_consensus.cc:2804] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:41.778638 10101 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters:
I20260926 13:55:41.779106 10184 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:41.779471 10264 raft_consensus.cc:2804] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:41.779480 10184 raft_consensus.cc:3060] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:41.779822 10264 raft_consensus.cc:493] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:41.780166 10264 raft_consensus.cc:3060] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:41.785782 10184 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.785827 10264 raft_consensus.cc:515] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.787511 10264 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 2 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257)
I20260926 13:55:41.788151 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:41.788484 9985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:41.788796 9987 raft_consensus.cc:3060] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:41.789379 10061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d63c29c36a149a3b182bb644a756216"
I20260926 13:55:41.789973 10061 raft_consensus.cc:2393] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in current term 2: Already voted for candidate 1d63c29c36a149a3b182bb644a756216 in this term.
I20260926 13:55:41.789180 10184 leader_election.cc:290] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:41.791366 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5fe5d563d764533891c35615cf01b45" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:41.792188 10137 raft_consensus.cc:2393] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d63c29c36a149a3b182bb644a756216 in current term 2: Already voted for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in this term.
I20260926 13:55:41.793254 10029 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d63c29c36a149a3b182bb644a756216; no voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e
I20260926 13:55:41.794235 10184 raft_consensus.cc:2749] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260926 13:55:41.796484 9987 raft_consensus.cc:2468] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e0a32adc7734ac2bd3fedddfd8fa72e in term 2.
I20260926 13:55:41.797441 10101 leader_election.cc:304] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 4e0a32adc7734ac2bd3fedddfd8fa72e; no voters: 1d63c29c36a149a3b182bb644a756216
I20260926 13:55:41.798318 10264 raft_consensus.cc:2804] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:41.799120 10264 raft_consensus.cc:697] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 LEADER]: Becoming Leader. State: Replica: 4e0a32adc7734ac2bd3fedddfd8fa72e, State: Running, Role: LEADER
I20260926 13:55:41.799928 10264 consensus_queue.cc:237] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.807302 9884 catalog_manager.cc:5838] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e reported cstate change: term changed from 0 to 2, leader changed from <none> to 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131). New cstate: current_term: 2 leader_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:41.966032 10184 raft_consensus.cc:493] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:41.966572 10184 raft_consensus.cc:515] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.968109 10184 leader_election.cc:290] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:41.968873 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" is_pre_election: true
I20260926 13:55:41.969135 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" is_pre_election: true
I20260926 13:55:41.969571 9987 raft_consensus.cc:2468] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:41.969797 10137 raft_consensus.cc:2468] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 1.
I20260926 13:55:41.970602 10027 leader_election.cc:304] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:41.971220 10184 raft_consensus.cc:2804] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260926 13:55:41.971491 10184 raft_consensus.cc:493] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:41.971745 10184 raft_consensus.cc:3060] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:41.976305 10184 raft_consensus.cc:515] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.977690 10184 leader_election.cc:290] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 election: Requested vote from peers 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541), 4e0a32adc7734ac2bd3fedddfd8fa72e (127.3.127.131:35405)
I20260926 13:55:41.978331 9987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6"
I20260926 13:55:41.978595 10137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "523e7742341b4ca8a544a267c5395c42" candidate_uuid: "1d63c29c36a149a3b182bb644a756216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e"
I20260926 13:55:41.978782 9987 raft_consensus.cc:3060] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:41.979055 10137 raft_consensus.cc:3060] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:41.983063 9987 raft_consensus.cc:2468] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 2.
I20260926 13:55:41.983639 10137 raft_consensus.cc:2468] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d63c29c36a149a3b182bb644a756216 in term 2.
I20260926 13:55:41.983927 10027 leader_election.cc:304] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9fbd9150c4c3ba9f1b2b987535aa6, 1d63c29c36a149a3b182bb644a756216; no voters:
I20260926 13:55:41.984580 10184 raft_consensus.cc:2804] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:41.985661 10184 raft_consensus.cc:697] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 2 LEADER]: Becoming Leader. State: Replica: 1d63c29c36a149a3b182bb644a756216, State: Running, Role: LEADER
I20260926 13:55:41.986377 10184 consensus_queue.cc:237] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } }
I20260926 13:55:41.993499 9884 catalog_manager.cc:5838] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1d63c29c36a149a3b182bb644a756216 (127.3.127.130). New cstate: current_term: 2 leader_uuid: "1d63c29c36a149a3b182bb644a756216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:42.217379 9987 raft_consensus.cc:1275] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Refusing update from remote peer 4e0a32adc7734ac2bd3fedddfd8fa72e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:42.218580 10264 consensus_queue.cc:1048] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:42.229358 10061 raft_consensus.cc:1275] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Refusing update from remote peer 4e0a32adc7734ac2bd3fedddfd8fa72e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:42.231208 10265 consensus_queue.cc:1048] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d63c29c36a149a3b182bb644a756216" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:42.554787 10137 raft_consensus.cc:1275] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Refusing update from remote peer 1d63c29c36a149a3b182bb644a756216: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:42.556324 10184 consensus_queue.cc:1048] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0a32adc7734ac2bd3fedddfd8fa72e" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 35405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:42.594641 9985 raft_consensus.cc:1275] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Refusing update from remote peer 1d63c29c36a149a3b182bb644a756216: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260926 13:55:42.596925 10290 consensus_queue.cc:1048] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ab9fbd9150c4c3ba9f1b2b987535aa6" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260926 13:55:42.670010 10285 meta_cache.cc:1261] Time spent looking up entry by key: real 0.057s user 0.004s sys 0.000s
W20260926 13:55:42.670588 10277 meta_cache.cc:1261] Time spent looking up entry by key: real 0.080s user 0.006s sys 0.005s
W20260926 13:55:42.671715 10287 meta_cache.cc:1261] Time spent looking up entry by key: real 0.086s user 0.005s sys 0.003s
W20260926 13:55:42.671936 10284 meta_cache.cc:1261] Time spent looking up entry by key: real 0.057s user 0.000s sys 0.007s
W20260926 13:55:43.273057 10027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:40541, user_credentials={real_user=slave}} blocked reactor thread for 43790.3us
W20260926 13:55:43.414600 10337 log.cc:927] Time spent T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Append to log took a long time: real 0.087s user 0.001s sys 0.000s
I20260926 13:55:43.893472 10338 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=46, attempt_no=0}) took 1004 ms. Trace:
I20260926 13:55:43.898183 10322 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=12, attempt_no=0}) took 1096 ms. Trace:
W20260926 13:55:43.901119 10360 log.cc:927] Time spent T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Append to log took a long time: real 0.105s user 0.001s sys 0.001s
I20260926 13:55:43.898584 10322 rpcz_store.cc:276] 0926 13:55:42.801276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.801409 (+ 133us) service_pool.cc:224] Handling call
0926 13:55:43.898002 (+1096593us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.845506 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:42.893474 (+ 47968us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.893503 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:42.893518 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:42.939262 (+ 45744us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.950696 (+ 11434us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.950726 (+ 30us) tablet.cc:685] Acquiring locks for 21 operations
0926 13:55:42.951866 (+ 1140us) tablet.cc:701] Row locks acquired
0926 13:55:42.951881 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:42.952148 (+ 267us) write_op.cc:270] Start()
0926 13:55:42.952260 (+ 112us) write_op.cc:276] Timestamp: P: 1790430942952111 usec, L: 0
0926 13:55:42.952278 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.952917 (+ 639us) log.cc:844] Serialized 1208 byte log entry
0926 13:55:43.067857 (+114940us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b440002534c. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02cd8775 00007fdb02cd9192 00007fdb093c83bb 00007fdb093c3c9f 00007fdb02d9908c 00007fdb0bc4d0f9 00007fdb02db560b 00007fdb02db390b 00007fdb02db5b72 00007fdb093b63fb
0926 13:55:43.563835 (+495978us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.785577 (+221742us) write_op.cc:301] APPLY: starting
0926 13:55:43.785647 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:43.786074 (+ 427us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:43.786098 (+ 24us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:43.796144 (+ 10046us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:43.896970 (+100826us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:43.897014 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:43.897344 (+ 330us) log.cc:844] Serialized 144 byte log entry
0926 13:55:43.897535 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:43.897685 (+ 150us) write_op.cc:454] Released schema lock
0926 13:55:43.897732 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":221574,"num_ops":21,"prepare.queue_time_us":20033,"prepare.run_cpu_time_us":34070,"prepare.run_wall_time_us":354767,"replication_time_us":611400,"spinlock_wait_cycles":15216896,"thread_start_us":220149,"threads_started":2,"wal-append.queue_time_us":225745}]]}
I20260926 13:55:43.893919 10338 rpcz_store.cc:276] 0926 13:55:42.889207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.890805 (+ 1598us) service_pool.cc:224] Handling call
0926 13:55:43.893288 (+1002483us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.530866 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:43.531289 (+ 423us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.531315 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.531330 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:43.532152 (+ 822us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.534846 (+ 2694us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.534874 (+ 28us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:43.535731 (+ 857us) tablet.cc:701] Row locks acquired
0926 13:55:43.535749 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:43.551282 (+ 15533us) write_op.cc:270] Start()
0926 13:55:43.551380 (+ 98us) write_op.cc:276] Timestamp: P: 1790430943551245 usec, L: 0
0926 13:55:43.551402 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.551928 (+ 526us) log.cc:844] Serialized 907 byte log entry
0926 13:55:43.598304 (+ 46376us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b540009d6a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:43.598522 (+ 218us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.729138 (+130616us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b540009d6a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979e056 00007fdb097979ca 00007fdb09796c44 00007fdb097773da 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94
0926 13:55:43.734555 (+ 5417us) spinlock_profiling.cc:243] Waited 927 us on lock 0x7b540009d6a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb09796672 00007fdb097773da 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5
0926 13:55:43.847108 (+112553us) write_op.cc:301] APPLY: starting
0926 13:55:43.847188 (+ 80us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:43.847436 (+ 248us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:43.847458 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:43.863490 (+ 16032us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:43.863705 (+ 215us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:43.863747 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:43.864006 (+ 259us) log.cc:844] Serialized 100 byte log entry
0926 13:55:43.892853 (+ 28847us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:43.892967 (+ 114us) write_op.cc:454] Released schema lock
0926 13:55:43.893016 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":248423,"mutex_wait_us":4600,"num_ops":14,"prepare.queue_time_us":629309,"prepare.run_cpu_time_us":4694,"prepare.run_wall_time_us":111516,"raft.queue_time_us":2034,"raft.run_cpu_time_us":9294,"raft.run_wall_time_us":195829,"replication_time_us":47020,"spinlock_wait_cycles":10174208}]]}
I20260926 13:55:43.962442 10348 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=13, attempt_no=0}) took 1112 ms. Trace:
I20260926 13:55:43.962965 10348 rpcz_store.cc:276] 0926 13:55:42.820352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.833732 (+ 13380us) service_pool.cc:224] Handling call
0926 13:55:43.931665 (+1097933us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.427411 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:43.427857 (+ 446us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.427885 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:43.427901 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.473144 (+ 45243us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.473194 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.473221 (+ 27us) tablet.cc:685] Acquiring locks for 22 operations
0926 13:55:43.474338 (+ 1117us) tablet.cc:701] Row locks acquired
0926 13:55:43.474359 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:43.474515 (+ 156us) write_op.cc:270] Start()
0926 13:55:43.474612 (+ 97us) write_op.cc:276] Timestamp: P: 1790430943474475 usec, L: 0
0926 13:55:43.474635 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.475205 (+ 570us) log.cc:844] Serialized 1251 byte log entry
0926 13:55:43.530619 (+ 55414us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b1800213dc0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb02db6492 00007fdb02db8751 00007fdb02db8709 00007fdb02db8699 00007fdb02db8661 00007fdb02db795d 000000000041fb94 000000000041f9d9 00007fdb02d9981a
0926 13:55:43.538552 (+ 7933us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.804065 (+265513us) write_op.cc:301] APPLY: starting
0926 13:55:43.804140 (+ 75us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:43.804591 (+ 451us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:43.827422 (+ 22831us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:43.903666 (+ 76244us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:43.903934 (+ 268us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:43.903978 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:43.904304 (+ 326us) log.cc:844] Serialized 151 byte log entry
0926 13:55:43.904481 (+ 177us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:43.904623 (+ 142us) write_op.cc:454] Released schema lock
0926 13:55:43.904682 (+ 59us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":265340,"num_ops":22,"prepare.queue_time_us":591952,"prepare.run_cpu_time_us":4194,"prepare.run_wall_time_us":93381,"raft.queue_time_us":1824,"raft.run_cpu_time_us":748,"raft.run_wall_time_us":748,"replication_time_us":63792,"spinlock_wait_cycles":16042880}]]}
I20260926 13:55:44.039248 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=66, attempt_no=0}) took 1043 ms. Trace:
I20260926 13:55:44.039990 10339 rpcz_store.cc:276] 0926 13:55:43.002038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.005711 (+ 3673us) service_pool.cc:224] Handling call
0926 13:55:44.039070 (+1033359us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.575605 (+ 0us) write_op.cc:183] PREPARE: starting on tablet de68f7f38cd24ca6a790bf0fdef2e2ee
0926 13:55:43.576274 (+ 669us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.576300 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.576313 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.577110 (+ 797us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.577149 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.577183 (+ 34us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.577950 (+ 767us) tablet.cc:701] Row locks acquired
0926 13:55:43.577969 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.578108 (+ 139us) write_op.cc:270] Start()
0926 13:55:43.578218 (+ 110us) write_op.cc:276] Timestamp: P: 1790430943578073 usec, L: 0
0926 13:55:43.578232 (+ 14us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.578755 (+ 523us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.587047 (+ 8292us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b58000e57d0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb0977796c 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5 00007fdb02db8751
0926 13:55:43.589345 (+ 2298us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.966862 (+377517us) write_op.cc:301] APPLY: starting
0926 13:55:43.966930 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:43.967176 (+ 246us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:43.967198 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:43.969178 (+ 1980us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:43.969378 (+ 200us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:43.969420 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:43.969673 (+ 253us) log.cc:844] Serialized 94 byte log entry
0926 13:55:43.969832 (+ 159us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:43.969951 (+ 119us) write_op.cc:454] Released schema lock
0926 13:55:43.969995 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:44.038904 (+ 68909us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b340000e128. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":377375,"mutex_wait_us":60067,"num_ops":13,"prepare.queue_time_us":454445,"prepare.run_cpu_time_us":3239,"prepare.run_wall_time_us":3457,"raft.queue_time_us":194,"raft.run_cpu_time_us":1546,"raft.run_wall_time_us":7946,"replication_time_us":11019,"spinlock_wait_cycles":64817664}]]}
I20260926 13:55:44.058019 10338 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=55, attempt_no=0}) took 1166 ms. Trace:
I20260926 13:55:44.052991 10348 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=27, attempt_no=0}) took 1231 ms. Trace:
I20260926 13:55:44.064886 10348 rpcz_store.cc:276] 0926 13:55:42.821462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.822890 (+ 1428us) service_pool.cc:224] Handling call
0926 13:55:44.052934 (+1230044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.941555 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:42.966590 (+ 25035us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.966682 (+ 92us) write_op.cc:435] Acquired schema lock
0926 13:55:42.966698 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:42.967936 (+ 1238us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.967977 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.968003 (+ 26us) tablet.cc:685] Acquiring locks for 21 operations
0926 13:55:42.969583 (+ 1580us) tablet.cc:701] Row locks acquired
0926 13:55:42.969601 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:42.969754 (+ 153us) write_op.cc:270] Start()
0926 13:55:42.969844 (+ 90us) write_op.cc:276] Timestamp: P: 1790430942969715 usec, L: 0
0926 13:55:42.969866 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.970396 (+ 530us) log.cc:844] Serialized 1208 byte log entry
0926 13:55:43.744646 (+774250us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.036823 (+292177us) write_op.cc:301] APPLY: starting
0926 13:55:44.036891 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.037246 (+ 355us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.037338 (+ 92us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.039963 (+ 2625us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.040224 (+ 261us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.040266 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.040613 (+ 347us) log.cc:844] Serialized 144 byte log entry
0926 13:55:44.052338 (+ 11725us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.052547 (+ 209us) write_op.cc:454] Released schema lock
0926 13:55:44.052602 (+ 55us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":285773,"num_ops":21,"prepare.queue_time_us":111354,"prepare.run_cpu_time_us":4163,"prepare.run_wall_time_us":30942,"replication_time_us":774625}]]}
I20260926 13:55:44.061900 10338 rpcz_store.cc:276] 0926 13:55:42.889602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.889761 (+ 159us) service_pool.cc:224] Handling call
0926 13:55:44.055909 (+1166148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.973640 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:42.974059 (+ 419us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.974084 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:42.974100 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:42.974593 (+ 493us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.974649 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.974675 (+ 26us) tablet.cc:685] Acquiring locks for 6 operations
0926 13:55:42.975104 (+ 429us) tablet.cc:701] Row locks acquired
0926 13:55:42.975118 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:42.975260 (+ 142us) write_op.cc:270] Start()
0926 13:55:42.975348 (+ 88us) write_op.cc:276] Timestamp: P: 1790430942975219 usec, L: 0
0926 13:55:42.975367 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.975918 (+ 551us) log.cc:844] Serialized 562 byte log entry
0926 13:55:43.745182 (+769264us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.043688 (+298506us) write_op.cc:301] APPLY: starting
0926 13:55:44.043754 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.043915 (+ 161us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.044012 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.054443 (+ 10431us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.054609 (+ 166us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.054651 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.054856 (+ 205us) log.cc:844] Serialized 52 byte log entry
0926 13:55:44.055521 (+ 665us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.055605 (+ 84us) write_op.cc:454] Released schema lock
0926 13:55:44.055647 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":298359,"mutex_wait_us":2470,"num_ops":6,"prepare.queue_time_us":73486,"prepare.run_cpu_time_us":2472,"prepare.run_wall_time_us":2471,"replication_time_us":769729}]]}
I20260926 13:55:44.074756 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=24, attempt_no=0}) took 1197 ms. Trace:
I20260926 13:55:44.075165 10339 rpcz_store.cc:276] 0926 13:55:42.892228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.896223 (+ 3995us) service_pool.cc:224] Handling call
0926 13:55:44.074700 (+1178477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.987398 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:42.987825 (+ 427us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.987855 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:42.987870 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:42.988603 (+ 733us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.988650 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.988675 (+ 25us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:42.989372 (+ 697us) tablet.cc:701] Row locks acquired
0926 13:55:42.989388 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:42.989536 (+ 148us) write_op.cc:270] Start()
0926 13:55:42.989632 (+ 96us) write_op.cc:276] Timestamp: P: 1790430942989497 usec, L: 0
0926 13:55:42.989649 (+ 17us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.990256 (+ 607us) log.cc:844] Serialized 778 byte log entry
0926 13:55:43.722154 (+731898us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.071593 (+349439us) write_op.cc:301] APPLY: starting
0926 13:55:44.071659 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.071865 (+ 206us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.071961 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.073507 (+ 1546us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.073779 (+ 272us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.073826 (+ 47us) write_op.cc:312] APPLY: finished
0926 13:55:44.074075 (+ 249us) log.cc:844] Serialized 82 byte log entry
0926 13:55:44.074251 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.074350 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:44.074398 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":349264,"mutex_wait_us":9682,"num_ops":11,"prepare.queue_time_us":58194,"prepare.run_cpu_time_us":3092,"prepare.run_wall_time_us":4252,"replication_time_us":732388,"thread_start_us":66996,"threads_started":1}]]}
I20260926 13:55:44.056638 10315 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=36, attempt_no=0}) took 1168 ms. Trace:
I20260926 13:55:44.082412 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=53, attempt_no=0}) took 1099 ms. Trace:
I20260926 13:55:44.082871 10354 rpcz_store.cc:276] 0926 13:55:42.982956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.983064 (+ 108us) service_pool.cc:224] Handling call
0926 13:55:44.082215 (+1099151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.446513 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.446940 (+ 427us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.446966 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.446983 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.448059 (+ 1076us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.448105 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.448130 (+ 25us) tablet.cc:685] Acquiring locks for 19 operations
0926 13:55:43.496597 (+ 48467us) tablet.cc:701] Row locks acquired
0926 13:55:43.496624 (+ 27us) write_op.cc:260] PREPARE: finished
0926 13:55:43.496797 (+ 173us) write_op.cc:270] Start()
0926 13:55:43.496900 (+ 103us) write_op.cc:276] Timestamp: P: 1790430943496757 usec, L: 0
0926 13:55:43.496916 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.497490 (+ 574us) log.cc:844] Serialized 1122 byte log entry
0926 13:55:43.602581 (+105091us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.016151 (+413570us) write_op.cc:301] APPLY: starting
0926 13:55:44.076902 (+ 60751us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b60001f7dc8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09bdd1a1 00007fdb09d4d8eb 00007fdb09d4ff14 00007fdb09cc08eb 00007fdb09bbda93 00007fdb09bbfdc8 00007fdb09cbf044 00007fdb09caab8c 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9
0926 13:55:44.076976 (+ 74us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.077309 (+ 333us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.077330 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.080417 (+ 3087us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.080680 (+ 263us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.080723 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:44.081054 (+ 331us) log.cc:844] Serialized 131 byte log entry
0926 13:55:44.081762 (+ 708us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.081895 (+ 133us) write_op.cc:454] Released schema lock
0926 13:55:44.081947 (+ 52us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":413402,"num_ops":19,"prepare.queue_time_us":462083,"prepare.run_cpu_time_us":3808,"prepare.run_wall_time_us":51210,"replication_time_us":105545,"spinlock_wait_cycles":38180096}]]}
I20260926 13:55:44.089440 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=32, attempt_no=0}) took 1118 ms. Trace:
I20260926 13:55:44.090575 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=15, attempt_no=0}) took 1269 ms. Trace:
I20260926 13:55:44.083550 10322 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=43, attempt_no=0}) took 1137 ms. Trace:
I20260926 13:55:44.094738 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=26, attempt_no=0}) took 1182 ms. Trace:
I20260926 13:55:44.089907 10352 rpcz_store.cc:276] 0926 13:55:42.970607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.970734 (+ 127us) service_pool.cc:224] Handling call
0926 13:55:44.089266 (+1118532us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.396226 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.396700 (+ 474us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.396737 (+ 37us) write_op.cc:435] Acquired schema lock
0926 13:55:43.396771 (+ 34us) tablet.cc:662] Decoding operations
0926 13:55:43.401376 (+ 4605us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.401426 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.401465 (+ 39us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.445246 (+ 43781us) tablet.cc:701] Row locks acquired
0926 13:55:43.445263 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:43.445404 (+ 141us) write_op.cc:270] Start()
0926 13:55:43.445530 (+ 126us) write_op.cc:276] Timestamp: P: 1790430943445366 usec, L: 0
0926 13:55:43.445546 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.446119 (+ 573us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.544734 (+ 98615us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.955693 (+410959us) write_op.cc:301] APPLY: starting
0926 13:55:43.955762 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:43.955988 (+ 226us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:43.956074 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.014394 (+ 58320us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.014657 (+ 263us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.014702 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.014969 (+ 267us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.038527 (+ 23558us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b60001f7dc8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09bdd1a1 00007fdb09d4dfb5 00007fdb09d4ff64 00007fdb09cbe683 00007fdb09cbfad6 00007fdb09cbf53c 00007fdb09cab599 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9
0926 13:55:44.038575 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.038681 (+ 106us) write_op.cc:454] Released schema lock
0926 13:55:44.038729 (+ 48us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:44.089167 (+ 50438us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":402703,"num_ops":13,"prepare.queue_time_us":424123,"prepare.run_cpu_time_us":3853,"prepare.run_wall_time_us":50132,"replication_time_us":99066,"spinlock_wait_cycles":101790720}]]}
I20260926 13:55:44.095165 10312 rpcz_store.cc:276] 0926 13:55:42.912404 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.918931 (+ 6527us) service_pool.cc:224] Handling call
0926 13:55:44.094567 (+1175636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.087102 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:43.087541 (+ 439us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.087569 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:43.087587 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:43.088428 (+ 841us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.088469 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.088501 (+ 32us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:43.089393 (+ 892us) tablet.cc:701] Row locks acquired
0926 13:55:43.089413 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:43.089574 (+ 161us) write_op.cc:270] Start()
0926 13:55:43.089691 (+ 117us) write_op.cc:276] Timestamp: P: 1790430943089524 usec, L: 0
0926 13:55:43.089709 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.090301 (+ 592us) log.cc:844] Serialized 950 byte log entry
0926 13:55:43.470839 (+380538us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.638451 (+167612us) write_op.cc:301] APPLY: starting
0926 13:55:43.640893 (+ 2442us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:43.661332 (+ 20439us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:43.663806 (+ 2474us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.021201 (+357395us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.021421 (+ 220us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.021466 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.021743 (+ 277us) log.cc:844] Serialized 106 byte log entry
0926 13:55:44.021932 (+ 189us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.034000 (+ 12068us) write_op.cc:454] Released schema lock
0926 13:55:44.034054 (+ 54us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:44.094466 (+ 60412us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":167452,"mutex_wait_us":5937,"num_ops":15,"prepare.queue_time_us":166556,"prepare.run_cpu_time_us":3444,"prepare.run_wall_time_us":4509,"replication_time_us":381040,"spinlock_wait_cycles":71505152}]]}
I20260926 13:55:44.091121 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=37, attempt_no=0}) took 1119 ms. Trace:
I20260926 13:55:44.111896 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=29, attempt_no=0}) took 1199 ms. Trace:
I20260926 13:55:44.132167 10356 rpcz_store.cc:276] 0926 13:55:42.914406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.917295 (+ 2889us) service_pool.cc:224] Handling call
0926 13:55:44.111718 (+1194423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.243302 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.243780 (+ 478us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.243808 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:43.243828 (+ 20us) tablet.cc:662] Decoding operations
0926 13:55:43.244506 (+ 678us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.244549 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.244577 (+ 28us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:43.282526 (+ 37949us) tablet.cc:701] Row locks acquired
0926 13:55:43.286861 (+ 4335us) write_op.cc:260] PREPARE: finished
0926 13:55:43.390726 (+103865us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.390825 (+ 99us) write_op.cc:270] Start()
0926 13:55:43.391021 (+ 196us) write_op.cc:276] Timestamp: P: 1790430943390794 usec, L: 0
0926 13:55:43.391043 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.391601 (+ 558us) log.cc:844] Serialized 692 byte log entry
0926 13:55:43.544466 (+152865us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.958383 (+413917us) write_op.cc:301] APPLY: starting
0926 13:55:43.980803 (+ 22420us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:43.981028 (+ 225us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:43.981046 (+ 18us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.005337 (+ 24291us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.005529 (+ 192us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.005584 (+ 55us) write_op.cc:312] APPLY: finished
0926 13:55:44.005802 (+ 218us) log.cc:844] Serialized 70 byte log entry
0926 13:55:44.029057 (+ 23255us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.041641 (+ 12584us) write_op.cc:454] Released schema lock
0926 13:55:44.041691 (+ 50us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:44.111616 (+ 69925us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":387037,"mutex_wait_us":2189,"num_ops":9,"prepare.queue_time_us":316571,"prepare.run_cpu_time_us":11202,"prepare.run_wall_time_us":149320,"replication_time_us":153321,"spinlock_wait_cycles":55216768}]]}
I20260926 13:55:44.135840 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=61, attempt_no=0}) took 1061 ms. Trace:
I20260926 13:55:44.136234 10312 rpcz_store.cc:276] 0926 13:55:43.074619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.079431 (+ 4812us) service_pool.cc:224] Handling call
0926 13:55:44.135782 (+1056351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.500971 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.501429 (+ 458us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.501456 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:43.501477 (+ 21us) tablet.cc:662] Decoding operations
0926 13:55:43.522512 (+ 21035us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.522554 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.522583 (+ 29us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:43.523499 (+ 916us) tablet.cc:701] Row locks acquired
0926 13:55:43.523514 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:43.523656 (+ 142us) write_op.cc:270] Start()
0926 13:55:43.523781 (+ 125us) write_op.cc:276] Timestamp: P: 1790430943523622 usec, L: 0
0926 13:55:43.523800 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.524342 (+ 542us) log.cc:844] Serialized 907 byte log entry
0926 13:55:43.603028 (+ 78686us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.126405 (+523377us) write_op.cc:301] APPLY: starting
0926 13:55:44.126473 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.126706 (+ 233us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.126791 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.134154 (+ 7363us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.134370 (+ 216us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.134411 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:44.134673 (+ 262us) log.cc:844] Serialized 100 byte log entry
0926 13:55:44.135356 (+ 683us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.135469 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:44.135513 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":523235,"num_ops":14,"prepare.queue_time_us":416009,"prepare.run_cpu_time_us":3492,"prepare.run_wall_time_us":23594,"replication_time_us":79149}]]}
I20260926 13:55:44.119889 10343 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=48, attempt_no=0}) took 1172 ms. Trace:
I20260926 13:55:44.141140 10343 rpcz_store.cc:276] 0926 13:55:42.947766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.951672 (+ 3906us) service_pool.cc:224] Handling call
0926 13:55:44.119707 (+1168035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.158224 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:43.158697 (+ 473us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.158725 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:43.158742 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.159557 (+ 815us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.159602 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.159629 (+ 27us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.160400 (+ 771us) tablet.cc:701] Row locks acquired
0926 13:55:43.160420 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:43.160579 (+ 159us) write_op.cc:270] Start()
0926 13:55:43.160677 (+ 98us) write_op.cc:276] Timestamp: P: 1790430943160535 usec, L: 0
0926 13:55:43.160698 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.161414 (+ 716us) log.cc:844] Serialized 821 byte log entry
0926 13:55:43.744686 (+583272us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.113137 (+368451us) write_op.cc:301] APPLY: starting
0926 13:55:44.113203 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.113422 (+ 219us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.113511 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.118039 (+ 4528us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.118240 (+ 201us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.118282 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.118521 (+ 239us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.119243 (+ 722us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.119390 (+ 147us) write_op.cc:454] Released schema lock
0926 13:55:44.119434 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":368298,"num_ops":12,"prepare.queue_time_us":200547,"prepare.run_cpu_time_us":3308,"prepare.run_wall_time_us":3416,"replication_time_us":583886}]]}
I20260926 13:55:44.143603 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=73, attempt_no=0}) took 1058 ms. Trace:
I20260926 13:55:44.145375 10356 rpcz_store.cc:276] 0926 13:55:43.084971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.092768 (+ 7797us) service_pool.cc:224] Handling call
0926 13:55:44.143548 (+1050780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.524712 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.525654 (+ 942us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.525687 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:43.525704 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.526816 (+ 1112us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.526854 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.526882 (+ 28us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:43.527785 (+ 903us) tablet.cc:701] Row locks acquired
0926 13:55:43.527800 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:43.527932 (+ 132us) write_op.cc:270] Start()
0926 13:55:43.528014 (+ 82us) write_op.cc:276] Timestamp: P: 1790430943527895 usec, L: 0
0926 13:55:43.528033 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.528543 (+ 510us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:43.603236 (+ 74693us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.135722 (+532486us) write_op.cc:301] APPLY: starting
0926 13:55:44.135786 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.136147 (+ 361us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.136238 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.141712 (+ 5474us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.141961 (+ 249us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.142006 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.142390 (+ 384us) log.cc:844] Serialized 124 byte log entry
0926 13:55:44.143116 (+ 726us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.143244 (+ 128us) write_op.cc:454] Released schema lock
0926 13:55:44.143289 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":532329,"num_ops":18,"prepare.queue_time_us":430568,"prepare.run_cpu_time_us":3493,"prepare.run_wall_time_us":4043,"replication_time_us":75120}]]}
I20260926 13:55:44.094872 10322 rpcz_store.cc:276] 0926 13:55:42.946549 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.946739 (+ 190us) service_pool.cc:224] Handling call
0926 13:55:44.083491 (+1136752us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.994271 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:42.994716 (+ 445us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.994745 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:42.994758 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:42.995541 (+ 783us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.995582 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.995607 (+ 25us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.038301 (+ 42694us) tablet.cc:701] Row locks acquired
0926 13:55:43.038315 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:43.059826 (+ 21511us) write_op.cc:270] Start()
0926 13:55:43.063345 (+ 3519us) write_op.cc:276] Timestamp: P: 1790430943058814 usec, L: 0
0926 13:55:43.065083 (+ 1738us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.097028 (+ 31945us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.732170 (+635142us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.072913 (+340743us) write_op.cc:301] APPLY: starting
0926 13:55:44.072992 (+ 79us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.073227 (+ 235us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.073324 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.075661 (+ 2337us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.081998 (+ 6337us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.082047 (+ 49us) write_op.cc:312] APPLY: finished
0926 13:55:44.082301 (+ 254us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.083048 (+ 747us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.083165 (+ 117us) write_op.cc:454] Released schema lock
0926 13:55:44.083214 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":340587,"num_ops":13,"prepare.queue_time_us":46017,"prepare.run_cpu_time_us":3760,"prepare.run_wall_time_us":102996,"replication_time_us":663957,"spinlock_wait_cycles":9984}]]}
I20260926 13:55:44.081380 10315 rpcz_store.cc:276] 0926 13:55:42.888488 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.890090 (+ 1602us) service_pool.cc:224] Handling call
0926 13:55:44.056464 (+1166374us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.976267 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:42.976704 (+ 437us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.976730 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:42.976764 (+ 34us) tablet.cc:662] Decoding operations
0926 13:55:42.977658 (+ 894us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.977701 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.977725 (+ 24us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:42.978665 (+ 940us) tablet.cc:701] Row locks acquired
0926 13:55:42.978680 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:42.978808 (+ 128us) write_op.cc:270] Start()
0926 13:55:42.978889 (+ 81us) write_op.cc:276] Timestamp: P: 1790430942978778 usec, L: 0
0926 13:55:42.978908 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.979414 (+ 506us) log.cc:844] Serialized 907 byte log entry
0926 13:55:43.745394 (+765980us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.045895 (+300501us) write_op.cc:301] APPLY: starting
0926 13:55:44.045962 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.046234 (+ 272us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.046320 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.055359 (+ 9039us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.055582 (+ 223us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.055627 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.055879 (+ 252us) log.cc:844] Serialized 100 byte log entry
0926 13:55:44.056046 (+ 167us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.056150 (+ 104us) write_op.cc:454] Released schema lock
0926 13:55:44.056194 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":300365,"num_ops":14,"prepare.queue_time_us":57128,"prepare.run_cpu_time_us":3334,"prepare.run_wall_time_us":3333,"replication_time_us":766397}]]}
I20260926 13:55:44.094074 10331 rpcz_store.cc:276] 0926 13:55:42.821005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.833004 (+ 11999us) service_pool.cc:224] Handling call
0926 13:55:44.090374 (+1257370us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.970799 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:42.971227 (+ 428us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.971252 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:42.971267 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:42.971900 (+ 633us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.971943 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.971975 (+ 32us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:42.972433 (+ 458us) tablet.cc:701] Row locks acquired
0926 13:55:42.972448 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:42.972603 (+ 155us) write_op.cc:270] Start()
0926 13:55:42.972716 (+ 113us) write_op.cc:276] Timestamp: P: 1790430942972562 usec, L: 0
0926 13:55:42.972731 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.973261 (+ 530us) log.cc:844] Serialized 649 byte log entry
0926 13:55:43.744960 (+771699us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.042010 (+297050us) write_op.cc:301] APPLY: starting
0926 13:55:44.042074 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.042265 (+ 191us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.042355 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.043533 (+ 1178us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.043713 (+ 180us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.043757 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:44.043962 (+ 205us) log.cc:844] Serialized 64 byte log entry
0926 13:55:44.089944 (+ 45982us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.090048 (+ 104us) write_op.cc:454] Released schema lock
0926 13:55:44.090091 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":296901,"num_ops":8,"prepare.queue_time_us":135589,"prepare.run_cpu_time_us":2664,"prepare.run_wall_time_us":2664,"replication_time_us":772117}]]}
I20260926 13:55:44.148056 10354 rpcz_store.cc:276] 0926 13:55:42.971342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.972848 (+ 1506us) service_pool.cc:224] Handling call
0926 13:55:42.985169 (+ 12321us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b2400294998. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7ea02 00007fdb0bcf9119 00007fdb02f50c10 00007fdb02f5dfc4 00007fdb0b886d55 00007fdb0b885006 00007fdb09f87084 00007fdb09f87012 00007fdb09f86f41
0926 13:55:44.091066 (+1105897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.497873 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.498333 (+ 460us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.498359 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.498375 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.499004 (+ 629us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.499045 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.499072 (+ 27us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:43.499774 (+ 702us) tablet.cc:701] Row locks acquired
0926 13:55:43.499793 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.499938 (+ 145us) write_op.cc:270] Start()
0926 13:55:43.500036 (+ 98us) write_op.cc:276] Timestamp: P: 1790430943499899 usec, L: 0
0926 13:55:43.500052 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.500575 (+ 523us) log.cc:844] Serialized 649 byte log entry
0926 13:55:43.602827 (+102252us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.087886 (+485059us) write_op.cc:301] APPLY: starting
0926 13:55:44.087950 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.088137 (+ 187us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.088221 (+ 84us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.089458 (+ 1237us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.089643 (+ 185us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.089684 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:44.089895 (+ 211us) log.cc:844] Serialized 64 byte log entry
0926 13:55:44.090666 (+ 771us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.090752 (+ 86us) write_op.cc:454] Released schema lock
0926 13:55:44.090791 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":10487552,"child_traces":[["op",{"apply.queue_time_us":484923,"num_ops":8,"prepare.queue_time_us":511747,"prepare.run_cpu_time_us":2721,"prepare.run_wall_time_us":2928,"replication_time_us":102684}]]}
W20260926 13:55:44.165009 10101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:40541, user_credentials={real_user=slave}} blocked reactor thread for 56878.7us
I20260926 13:55:44.198063 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=51, attempt_no=0}) took 1250 ms. Trace:
I20260926 13:55:44.198457 10339 rpcz_store.cc:276] 0926 13:55:42.948143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.952880 (+ 4737us) service_pool.cc:224] Handling call
0926 13:55:44.198006 (+1245126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.097421 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:43.097868 (+ 447us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.097895 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:43.097911 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.118944 (+ 21033us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.118985 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.119012 (+ 27us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:43.120025 (+ 1013us) tablet.cc:701] Row locks acquired
0926 13:55:43.120107 (+ 82us) write_op.cc:260] PREPARE: finished
0926 13:55:43.120266 (+ 159us) write_op.cc:270] Start()
0926 13:55:43.120362 (+ 96us) write_op.cc:276] Timestamp: P: 1790430943120217 usec, L: 0
0926 13:55:43.120378 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.120956 (+ 578us) log.cc:844] Serialized 993 byte log entry
0926 13:55:43.744413 (+623457us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.110303 (+365890us) write_op.cc:301] APPLY: starting
0926 13:55:44.110368 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.110630 (+ 262us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.110715 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.196985 (+ 86270us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.197164 (+ 179us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.197201 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:44.197433 (+ 232us) log.cc:844] Serialized 112 byte log entry
0926 13:55:44.197593 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.197703 (+ 110us) write_op.cc:454] Released schema lock
0926 13:55:44.197745 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":365729,"mutex_wait_us":5476,"num_ops":16,"prepare.queue_time_us":141803,"prepare.run_cpu_time_us":3717,"prepare.run_wall_time_us":50322,"replication_time_us":623923}]]}
I20260926 13:55:44.203788 10348 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=41, attempt_no=0}) took 1315 ms. Trace:
I20260926 13:55:44.204236 10348 rpcz_store.cc:276] 0926 13:55:42.888856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.888967 (+ 111us) service_pool.cc:224] Handling call
0926 13:55:44.203728 (+1314761us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.979757 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:42.980191 (+ 434us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.980219 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:42.980236 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:42.981409 (+ 1173us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.981459 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.981496 (+ 37us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:42.982478 (+ 982us) tablet.cc:701] Row locks acquired
0926 13:55:42.982498 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:42.982639 (+ 141us) write_op.cc:270] Start()
0926 13:55:42.982741 (+ 102us) write_op.cc:276] Timestamp: P: 1790430942982592 usec, L: 0
0926 13:55:42.982761 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.983330 (+ 569us) log.cc:844] Serialized 778 byte log entry
0926 13:55:43.745598 (+762268us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.105296 (+359698us) write_op.cc:301] APPLY: starting
0926 13:55:44.105364 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.105586 (+ 222us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.105670 (+ 84us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.107236 (+ 1566us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.107512 (+ 276us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.107554 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.107784 (+ 230us) log.cc:844] Serialized 82 byte log entry
0926 13:55:44.185842 (+ 78058us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.185963 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:44.186014 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:44.203598 (+ 17584us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":359555,"num_ops":11,"prepare.queue_time_us":29087,"prepare.run_cpu_time_us":3100,"prepare.run_wall_time_us":3781,"replication_time_us":762748,"spinlock_wait_cycles":36031872}]]}
I20260926 13:55:44.223584 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=23, attempt_no=0}) took 1405 ms. Trace:
I20260926 13:55:44.224058 10339 rpcz_store.cc:276] 0926 13:55:42.817913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.818949 (+ 1036us) service_pool.cc:224] Handling call
0926 13:55:44.223527 (+1404578us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.207340 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.225856 (+ 18516us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.225888 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:43.225901 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.265617 (+ 39716us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.268726 (+ 3109us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.272064 (+ 3338us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.364159 (+ 92095us) tablet.cc:701] Row locks acquired
0926 13:55:43.364174 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:43.372955 (+ 8781us) write_op.cc:270] Start()
0926 13:55:43.379825 (+ 6870us) write_op.cc:276] Timestamp: P: 1790430943371833 usec, L: 0
0926 13:55:43.381124 (+ 1299us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.416028 (+ 34904us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.777532 (+361504us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.219475 (+441943us) write_op.cc:301] APPLY: starting
0926 13:55:44.219536 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.219724 (+ 188us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.219797 (+ 73us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.221885 (+ 2088us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.222060 (+ 175us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.222096 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:44.222308 (+ 212us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.223145 (+ 837us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.223243 (+ 98us) write_op.cc:454] Released schema lock
0926 13:55:44.223285 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":441773,"num_ops":13,"prepare.queue_time_us":309392,"prepare.run_cpu_time_us":4224,"prepare.run_wall_time_us":226113,"replication_time_us":396270}]]}
I20260926 13:55:44.226657 10322 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=35, attempt_no=0}) took 1287 ms. Trace:
I20260926 13:55:44.237656 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=58, attempt_no=0}) took 1251 ms. Trace:
I20260926 13:55:44.208238 10315 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=38, attempt_no=0}) took 1343 ms. Trace:
I20260926 13:55:44.210834 10338 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=79, attempt_no=0}) took 1256 ms. Trace:
I20260926 13:55:44.232034 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=45, attempt_no=0}) took 1285 ms. Trace:
I20260926 13:55:44.237285 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=52, attempt_no=0}) took 1263 ms. Trace:
I20260926 13:55:44.238090 10356 rpcz_store.cc:276] 0926 13:55:42.986626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.001952 (+ 15326us) service_pool.cc:224] Handling call
0926 13:55:44.237602 (+1235650us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.406123 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:43.406568 (+ 445us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.406598 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:43.406611 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.407348 (+ 737us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.407387 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.407411 (+ 24us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:43.408014 (+ 603us) tablet.cc:701] Row locks acquired
0926 13:55:43.408033 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.408172 (+ 139us) write_op.cc:270] Start()
0926 13:55:43.408279 (+ 107us) write_op.cc:276] Timestamp: P: 1790430943408133 usec, L: 0
0926 13:55:43.408298 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.408844 (+ 546us) log.cc:844] Serialized 778 byte log entry
0926 13:55:43.653725 (+244881us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.234356 (+580631us) write_op.cc:301] APPLY: starting
0926 13:55:44.234428 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.234636 (+ 208us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.234726 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.236464 (+ 1738us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.236737 (+ 273us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.236807 (+ 70us) write_op.cc:312] APPLY: finished
0926 13:55:44.237034 (+ 227us) log.cc:844] Serialized 82 byte log entry
0926 13:55:44.237179 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.237281 (+ 102us) write_op.cc:454] Released schema lock
0926 13:55:44.237322 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":580470,"mutex_wait_us":59,"num_ops":11,"prepare.queue_time_us":369877,"prepare.run_cpu_time_us":2937,"prepare.run_wall_time_us":2937,"replication_time_us":245299}]]}
I20260926 13:55:44.240315 10354 rpcz_store.cc:276] 0926 13:55:42.974324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.980926 (+ 6602us) service_pool.cc:224] Handling call
0926 13:55:44.237229 (+1256303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.144797 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:43.145303 (+ 506us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.145329 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.145346 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.146182 (+ 836us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.146228 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.146257 (+ 29us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.199449 (+ 53192us) tablet.cc:701] Row locks acquired
0926 13:55:43.200915 (+ 1466us) write_op.cc:260] PREPARE: finished
0926 13:55:43.240954 (+ 40039us) write_op.cc:270] Start()
0926 13:55:43.241081 (+ 127us) write_op.cc:276] Timestamp: P: 1790430943213083 usec, L: 0
0926 13:55:43.241109 (+ 28us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.387768 (+146659us) log.cc:844] Serialized 821 byte log entry
0926 13:55:43.405804 (+ 18036us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540000ffd4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.609019 (+203215us) op_driver.cc:464] REPLICATION: finished
0926 13:55:43.653429 (+ 44410us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b60003421c8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09bdd1a1 00007fdb09d4e6bc 00007fdb09caa072 00007fdb09caa699 00007fdb09cac92a 00007fdb09cac8b8 00007fdb09cac838 00007fdb09cac7f3 00007fdb09caba0c 00007fdb0bd6fdb6 00007fdb0bd6a568
0926 13:55:44.233900 (+580471us) write_op.cc:301] APPLY: starting
0926 13:55:44.233980 (+ 80us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.234208 (+ 228us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.234226 (+ 18us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.236113 (+ 1887us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.236322 (+ 209us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.236364 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.236615 (+ 251us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.236802 (+ 187us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.236907 (+ 105us) write_op.cc:454] Released schema lock
0926 13:55:44.236960 (+ 53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":580319,"num_ops":12,"prepare.queue_time_us":162217,"prepare.run_cpu_time_us":6064,"prepare.run_wall_time_us":261167,"replication_time_us":367811,"spinlock_wait_cycles":404848640}]]}
I20260926 13:55:44.240254 10338 rpcz_store.cc:276] 0926 13:55:42.954792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.954923 (+ 131us) service_pool.cc:224] Handling call
0926 13:55:44.210771 (+1255848us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.983682 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:42.984124 (+ 442us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.984159 (+ 35us) write_op.cc:435] Acquired schema lock
0926 13:55:42.984179 (+ 20us) tablet.cc:662] Decoding operations
0926 13:55:42.984998 (+ 819us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:42.985040 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:42.985067 (+ 27us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:42.985877 (+ 810us) tablet.cc:701] Row locks acquired
0926 13:55:42.985896 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:42.986028 (+ 132us) write_op.cc:270] Start()
0926 13:55:42.986110 (+ 82us) write_op.cc:276] Timestamp: P: 1790430942985992 usec, L: 0
0926 13:55:42.986128 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:42.986663 (+ 535us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.745822 (+759159us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.112078 (+366256us) write_op.cc:301] APPLY: starting
0926 13:55:44.112143 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.159431 (+ 47288us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.159527 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.160974 (+ 1447us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.161119 (+ 145us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.161146 (+ 27us) write_op.cc:312] APPLY: finished
0926 13:55:44.161319 (+ 173us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.161495 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.161600 (+ 105us) write_op.cc:454] Released schema lock
0926 13:55:44.161643 (+ 43us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:44.210671 (+ 49028us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":366116,"num_ops":13,"prepare.queue_time_us":27327,"prepare.run_cpu_time_us":3188,"prepare.run_wall_time_us":3188,"replication_time_us":759609,"spinlock_wait_cycles":107101952}]]}
I20260926 13:55:44.237911 10322 rpcz_store.cc:276] 0926 13:55:42.941810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.941960 (+ 150us) service_pool.cc:224] Handling call
0926 13:55:44.226602 (+1284642us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.425687 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.426121 (+ 434us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.426147 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.426162 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:43.426802 (+ 640us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.426839 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.426873 (+ 34us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:43.427522 (+ 649us) tablet.cc:701] Row locks acquired
0926 13:55:43.427540 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:43.427698 (+ 158us) write_op.cc:270] Start()
0926 13:55:43.427801 (+ 103us) write_op.cc:276] Timestamp: P: 1790430943427648 usec, L: 0
0926 13:55:43.427820 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.428536 (+ 716us) log.cc:844] Serialized 649 byte log entry
0926 13:55:43.777817 (+349281us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.223702 (+445885us) write_op.cc:301] APPLY: starting
0926 13:55:44.223771 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.223949 (+ 178us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.224033 (+ 84us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.225107 (+ 1074us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.225284 (+ 177us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.225326 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.225547 (+ 221us) log.cc:844] Serialized 64 byte log entry
0926 13:55:44.226193 (+ 646us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.226281 (+ 88us) write_op.cc:454] Released schema lock
0926 13:55:44.226321 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":445737,"num_ops":8,"prepare.queue_time_us":479720,"prepare.run_cpu_time_us":3234,"prepare.run_wall_time_us":3234,"replication_time_us":349906}]]}
I20260926 13:55:44.238253 10315 rpcz_store.cc:276] 0926 13:55:42.883763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.892251 (+ 8488us) service_pool.cc:224] Handling call
0926 13:55:42.979355 (+ 87104us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:44.208182 (+1228827us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.004639 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:43.017032 (+ 12393us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.017070 (+ 38us) write_op.cc:435] Acquired schema lock
0926 13:55:43.017083 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.017788 (+ 705us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.017829 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.017860 (+ 31us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:43.018402 (+ 542us) tablet.cc:701] Row locks acquired
0926 13:55:43.018422 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:43.018569 (+ 147us) write_op.cc:270] Start()
0926 13:55:43.018666 (+ 97us) write_op.cc:276] Timestamp: P: 1790430943018529 usec, L: 0
0926 13:55:43.018681 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.019220 (+ 539us) log.cc:844] Serialized 735 byte log entry
0926 13:55:43.746223 (+727003us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.204953 (+458730us) write_op.cc:301] APPLY: starting
0926 13:55:44.205018 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.205230 (+ 212us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.205316 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.206630 (+ 1314us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.206815 (+ 185us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.206858 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:44.207088 (+ 230us) log.cc:844] Serialized 76 byte log entry
0926 13:55:44.207761 (+ 673us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.207862 (+ 101us) write_op.cc:454] Released schema lock
0926 13:55:44.207901 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":6824704,"child_traces":[["op",{"apply.queue_time_us":458585,"num_ops":10,"prepare.queue_time_us":24166,"prepare.run_cpu_time_us":3044,"prepare.run_wall_time_us":14780,"replication_time_us":727458}]]}
I20260926 13:55:44.250147 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=71, attempt_no=0}) took 1162 ms. Trace:
I20260926 13:55:44.209412 10344 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=9, attempt_no=0}) took 1260 ms. Trace:
I20260926 13:55:44.257504 10338 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=92, attempt_no=0}) took 1224 ms. Trace:
I20260926 13:55:44.259590 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=80, attempt_no=0}) took 1304 ms. Trace:
I20260926 13:55:44.257299 10344 rpcz_store.cc:276] 0926 13:55:42.948553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.957719 (+ 9166us) service_pool.cc:224] Handling call
0926 13:55:44.209236 (+1251517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.161800 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:43.162361 (+ 561us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.162388 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:43.162405 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.163144 (+ 739us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.163189 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.163222 (+ 33us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:43.163883 (+ 661us) tablet.cc:701] Row locks acquired
0926 13:55:43.163898 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:43.164042 (+ 144us) write_op.cc:270] Start()
0926 13:55:43.164154 (+ 112us) write_op.cc:276] Timestamp: P: 1790430943164003 usec, L: 0
0926 13:55:43.164170 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.164721 (+ 551us) log.cc:844] Serialized 778 byte log entry
0926 13:55:43.744970 (+580249us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.122609 (+377639us) write_op.cc:301] APPLY: starting
0926 13:55:44.122679 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.122905 (+ 226us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.123006 (+ 101us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.196673 (+ 73667us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.196962 (+ 289us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.197002 (+ 40us) write_op.cc:312] APPLY: finished
0926 13:55:44.197228 (+ 226us) log.cc:844] Serialized 82 byte log entry
0926 13:55:44.208796 (+ 11568us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.208899 (+ 103us) write_op.cc:454] Released schema lock
0926 13:55:44.208956 (+ 57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":377488,"num_ops":11,"prepare.queue_time_us":196488,"prepare.run_cpu_time_us":3057,"prepare.run_wall_time_us":3128,"replication_time_us":580703,"spinlock_wait_cycles":17024}]]}
I20260926 13:55:44.240370 10339 rpcz_store.cc:276] 0926 13:55:42.946984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.948364 (+ 1380us) service_pool.cc:224] Handling call
0926 13:55:44.231981 (+1283617us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.468226 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.468679 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.468703 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:43.468718 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:43.473340 (+ 4622us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.473378 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.473403 (+ 25us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.477554 (+ 4151us) tablet.cc:701] Row locks acquired
0926 13:55:43.477569 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:43.477711 (+ 142us) write_op.cc:270] Start()
0926 13:55:43.477805 (+ 94us) write_op.cc:276] Timestamp: P: 1790430943477674 usec, L: 0
0926 13:55:43.477824 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.478359 (+ 535us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.778029 (+299670us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.228685 (+450656us) write_op.cc:301] APPLY: starting
0926 13:55:44.228737 (+ 52us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.228962 (+ 225us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.229039 (+ 77us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.230463 (+ 1424us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.230625 (+ 162us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.230659 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:44.230861 (+ 202us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.231584 (+ 723us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.231680 (+ 96us) write_op.cc:454] Released schema lock
0926 13:55:44.231717 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":450518,"num_ops":13,"prepare.queue_time_us":518293,"prepare.run_cpu_time_us":3293,"prepare.run_wall_time_us":51487,"replication_time_us":300124}]]}
I20260926 13:55:44.254683 10354 rpcz_store.cc:276] 0926 13:55:43.087663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.091335 (+ 3672us) service_pool.cc:224] Handling call
0926 13:55:44.250089 (+1158754us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.411775 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:43.412100 (+ 325us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.412125 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:43.412135 (+ 10us) tablet.cc:662] Decoding operations
0926 13:55:43.412559 (+ 424us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.412583 (+ 24us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.412602 (+ 19us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:43.438531 (+ 25929us) tablet.cc:701] Row locks acquired
0926 13:55:43.438550 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.456919 (+ 18369us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.457036 (+ 117us) write_op.cc:270] Start()
0926 13:55:43.457225 (+ 189us) write_op.cc:276] Timestamp: P: 1790430943456984 usec, L: 0
0926 13:55:43.457244 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.457794 (+ 550us) log.cc:844] Serialized 649 byte log entry
0926 13:55:43.654177 (+196383us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.246630 (+592453us) write_op.cc:301] APPLY: starting
0926 13:55:44.246692 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.246859 (+ 167us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.246885 (+ 26us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.249143 (+ 2258us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.249312 (+ 169us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.249356 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:44.249550 (+ 194us) log.cc:844] Serialized 64 byte log entry
0926 13:55:44.249689 (+ 139us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.249779 (+ 90us) write_op.cc:454] Released schema lock
0926 13:55:44.249817 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":592312,"num_ops":8,"prepare.queue_time_us":319122,"prepare.run_cpu_time_us":3129,"prepare.run_wall_time_us":47332,"replication_time_us":196851,"spinlock_wait_cycles":40931328}]]}
I20260926 13:55:44.267602 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=19, attempt_no=0}) took 1356 ms. Trace:
I20260926 13:55:44.278491 10352 rpcz_store.cc:276] 0926 13:55:42.911162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.911341 (+ 179us) service_pool.cc:224] Handling call
0926 13:55:44.267545 (+1356204us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.094012 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:43.094513 (+ 501us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.094543 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:43.094559 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.095366 (+ 807us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.095417 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.095443 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.096241 (+ 798us) tablet.cc:701] Row locks acquired
0926 13:55:43.096258 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:43.096404 (+ 146us) write_op.cc:270] Start()
0926 13:55:43.096504 (+ 100us) write_op.cc:276] Timestamp: P: 1790430943096367 usec, L: 0
0926 13:55:43.096523 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.109015 (+ 12492us) log.cc:844] Serialized 821 byte log entry
0926 13:55:43.659520 (+550505us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.249367 (+589847us) write_op.cc:301] APPLY: starting
0926 13:55:44.249444 (+ 77us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.249667 (+ 223us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.249758 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.251280 (+ 1522us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.251496 (+ 216us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.251537 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:44.251776 (+ 239us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.267087 (+ 15311us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.267189 (+ 102us) write_op.cc:454] Released schema lock
0926 13:55:44.267238 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":586207,"mutex_wait_us":1461,"num_ops":12,"prepare.queue_time_us":156684,"prepare.run_cpu_time_us":3542,"prepare.run_wall_time_us":37645,"replication_time_us":562134}]]}
I20260926 13:55:44.285352 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=11, attempt_no=0}) took 1377 ms. Trace:
I20260926 13:55:44.299342 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=70, attempt_no=0}) took 1223 ms. Trace:
I20260926 13:55:44.259968 10331 rpcz_store.cc:276] 0926 13:55:42.955181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.955694 (+ 513us) service_pool.cc:224] Handling call
0926 13:55:44.259531 (+1303837us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:42.986985 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:42.988599 (+ 1614us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:42.988636 (+ 37us) write_op.cc:435] Acquired schema lock
0926 13:55:42.988649 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.002830 (+ 14181us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.002872 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.002900 (+ 28us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:43.003455 (+ 555us) tablet.cc:701] Row locks acquired
0926 13:55:43.003474 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.003623 (+ 149us) write_op.cc:270] Start()
0926 13:55:43.003723 (+ 100us) write_op.cc:276] Timestamp: P: 1790430943003581 usec, L: 0
0926 13:55:43.003739 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.004305 (+ 566us) log.cc:844] Serialized 735 byte log entry
0926 13:55:43.746031 (+741726us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.194838 (+448807us) write_op.cc:301] APPLY: starting
0926 13:55:44.194896 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.195114 (+ 218us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.195197 (+ 83us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.196505 (+ 1308us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.196700 (+ 195us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.196741 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:44.197009 (+ 268us) log.cc:844] Serialized 76 byte log entry
0926 13:55:44.259084 (+ 62075us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.259197 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:44.259241 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":200576,"child_traces":[["op",{"apply.queue_time_us":448677,"num_ops":10,"prepare.queue_time_us":29793,"prepare.run_cpu_time_us":3016,"prepare.run_wall_time_us":17510,"replication_time_us":742201}]]}
I20260926 13:55:44.298671 10354 rpcz_store.cc:276] 0926 13:55:42.910061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.910662 (+ 601us) service_pool.cc:224] Handling call
0926 13:55:44.285295 (+1374633us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.153403 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:43.215590 (+ 62187us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.215633 (+ 43us) write_op.cc:435] Acquired schema lock
0926 13:55:43.215646 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.238079 (+ 22433us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.238120 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.238150 (+ 30us) tablet.cc:685] Acquiring locks for 6 operations
0926 13:55:43.238629 (+ 479us) tablet.cc:701] Row locks acquired
0926 13:55:43.238648 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.388206 (+149558us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b2c0007d598. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:43.388277 (+ 71us) write_op.cc:270] Start()
0926 13:55:43.388493 (+ 216us) write_op.cc:276] Timestamp: P: 1790430943253036 usec, L: 0
0926 13:55:43.388517 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.653504 (+264987us) log.cc:844] Serialized 562 byte log entry
0926 13:55:43.654115 (+ 611us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54005c6a54. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.794384 (+140269us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.276635 (+482251us) write_op.cc:301] APPLY: starting
0926 13:55:44.276707 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.276882 (+ 175us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.276903 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.277753 (+ 850us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.277919 (+ 166us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.277972 (+ 53us) write_op.cc:312] APPLY: finished
0926 13:55:44.278163 (+ 191us) log.cc:844] Serialized 52 byte log entry
0926 13:55:44.284862 (+ 6699us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.284952 (+ 90us) write_op.cc:454] Released schema lock
0926 13:55:44.284994 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":481167,"mutex_wait_us":5731,"num_ops":6,"prepare.queue_time_us":199633,"prepare.run_cpu_time_us":65163,"prepare.run_wall_time_us":574595,"raft.queue_time_us":9390,"raft.run_cpu_time_us":5310,"raft.run_wall_time_us":77695,"replication_time_us":403536,"spinlock_wait_cycles":642085632,"thread_start_us":62745,"threads_started":1}]]}
I20260926 13:55:44.257987 10338 rpcz_store.cc:276] 0926 13:55:43.033173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.033873 (+ 700us) service_pool.cc:224] Handling call
0926 13:55:44.257448 (+1223575us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.035406 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:43.035904 (+ 498us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.035933 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:43.035950 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.036769 (+ 819us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.036811 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.036834 (+ 23us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.037658 (+ 824us) tablet.cc:701] Row locks acquired
0926 13:55:43.037672 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:43.039238 (+ 1566us) write_op.cc:270] Start()
0926 13:55:43.039335 (+ 97us) write_op.cc:276] Timestamp: P: 1790430943038528 usec, L: 0
0926 13:55:43.039358 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.040073 (+ 715us) log.cc:844] Serialized 821 byte log entry
0926 13:55:43.746424 (+706351us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.248196 (+501772us) write_op.cc:301] APPLY: starting
0926 13:55:44.248262 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.248494 (+ 232us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.248582 (+ 88us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.256354 (+ 7772us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.256563 (+ 209us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.256605 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.256866 (+ 261us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.257018 (+ 152us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.257117 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:44.257162 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":501632,"num_ops":12,"prepare.queue_time_us":182,"prepare.run_cpu_time_us":3523,"prepare.run_wall_time_us":4895,"replication_time_us":706987}]]}
I20260926 13:55:44.309572 10322 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=65, attempt_no=0}) took 1317 ms. Trace:
I20260926 13:55:44.316851 10343 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=40, attempt_no=0}) took 1370 ms. Trace:
I20260926 13:55:44.310634 10344 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=96, attempt_no=0}) took 1258 ms. Trace:
I20260926 13:55:44.312098 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=94, attempt_no=0}) took 1110 ms. Trace:
I20260926 13:55:44.320003 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=50, attempt_no=0}) took 1346 ms. Trace:
I20260926 13:55:44.314826 10322 rpcz_store.cc:276] 0926 13:55:42.992627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.994251 (+ 1624us) service_pool.cc:224] Handling call
0926 13:55:44.309512 (+1315261us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.165058 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:43.165517 (+ 459us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.165543 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.165556 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.166440 (+ 884us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.166480 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.166507 (+ 27us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:43.260643 (+ 94136us) tablet.cc:701] Row locks acquired
0926 13:55:43.260662 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.431703 (+171041us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b340000e128. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.431806 (+ 103us) write_op.cc:270] Start()
0926 13:55:43.432008 (+ 202us) write_op.cc:276] Timestamp: P: 1790430943431770 usec, L: 0
0926 13:55:43.432032 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.432575 (+ 543us) log.cc:844] Serialized 993 byte log entry
0926 13:55:43.859190 (+426615us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.280149 (+420959us) write_op.cc:301] APPLY: starting
0926 13:55:44.280219 (+ 70us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.280504 (+ 285us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.280524 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.308290 (+ 27766us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.308521 (+ 231us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.308567 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:44.308870 (+ 303us) log.cc:844] Serialized 112 byte log entry
0926 13:55:44.309073 (+ 203us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.309190 (+ 117us) write_op.cc:454] Released schema lock
0926 13:55:44.309236 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":420800,"num_ops":16,"prepare.queue_time_us":169408,"prepare.run_cpu_time_us":5783,"prepare.run_wall_time_us":267788,"replication_time_us":427047,"spinlock_wait_cycles":13488768}]]}
I20260926 13:55:44.319787 10315 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=56, attempt_no=0}) took 1429 ms. Trace:
I20260926 13:55:44.317883 10312 rpcz_store.cc:276] 0926 13:55:43.201636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.201748 (+ 112us) service_pool.cc:224] Handling call
0926 13:55:44.312039 (+1110291us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.459282 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:43.459709 (+ 427us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.459735 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.459748 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.460647 (+ 899us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.460687 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.460718 (+ 31us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:43.592857 (+132139us) tablet.cc:701] Row locks acquired
0926 13:55:43.592871 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:43.593064 (+ 193us) write_op.cc:270] Start()
0926 13:55:43.593180 (+ 116us) write_op.cc:276] Timestamp: P: 1790430943593032 usec, L: 0
0926 13:55:43.593201 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.593716 (+ 515us) log.cc:844] Serialized 993 byte log entry
0926 13:55:43.736814 (+143098us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.268548 (+531734us) write_op.cc:301] APPLY: starting
0926 13:55:44.268615 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.294236 (+ 25621us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.294324 (+ 88us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.296379 (+ 2055us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.311077 (+ 14698us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.311134 (+ 57us) write_op.cc:312] APPLY: finished
0926 13:55:44.311424 (+ 290us) log.cc:844] Serialized 112 byte log entry
0926 13:55:44.311594 (+ 170us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.311713 (+ 119us) write_op.cc:454] Released schema lock
0926 13:55:44.311760 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":526408,"num_ops":16,"prepare.queue_time_us":256091,"prepare.run_cpu_time_us":3545,"prepare.run_wall_time_us":134675,"replication_time_us":140066}]]}
I20260926 13:55:44.317764 10344 rpcz_store.cc:276] 0926 13:55:43.052026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.052948 (+ 922us) service_pool.cc:224] Handling call
0926 13:55:44.310574 (+1257626us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.436322 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:43.504410 (+ 68088us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.506259 (+ 1849us) write_op.cc:435] Acquired schema lock
0926 13:55:43.512892 (+ 6633us) tablet.cc:662] Decoding operations
0926 13:55:43.543626 (+ 30734us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.543671 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.543698 (+ 27us) tablet.cc:685] Acquiring locks for 19 operations
0926 13:55:43.544647 (+ 949us) tablet.cc:701] Row locks acquired
0926 13:55:43.544666 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.544831 (+ 165us) write_op.cc:270] Start()
0926 13:55:43.544930 (+ 99us) write_op.cc:276] Timestamp: P: 1790430943544795 usec, L: 0
0926 13:55:43.544946 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.597175 (+ 52229us) log.cc:844] Serialized 1122 byte log entry
0926 13:55:43.859655 (+262480us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.289700 (+430045us) write_op.cc:301] APPLY: starting
0926 13:55:44.289766 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.290092 (+ 326us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.290176 (+ 84us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.309361 (+ 19185us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.309612 (+ 251us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.309657 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.309967 (+ 310us) log.cc:844] Serialized 131 byte log entry
0926 13:55:44.310113 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.310256 (+ 143us) write_op.cc:454] Released schema lock
0926 13:55:44.310305 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":429901,"mutex_wait_us":197,"num_ops":19,"prepare.queue_time_us":382012,"prepare.run_cpu_time_us":3852,"prepare.run_wall_time_us":162233,"replication_time_us":314628}]]}
I20260926 13:55:44.299755 10356 rpcz_store.cc:276] 0926 13:55:43.075754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.083348 (+ 7594us) service_pool.cc:224] Handling call
0926 13:55:44.299284 (+1215936us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.409222 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:43.409651 (+ 429us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.409678 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:43.409694 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.410313 (+ 619us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.410349 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.410378 (+ 29us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:43.410838 (+ 460us) tablet.cc:701] Row locks acquired
0926 13:55:43.410853 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:43.410996 (+ 143us) write_op.cc:270] Start()
0926 13:55:43.411096 (+ 100us) write_op.cc:276] Timestamp: P: 1790430943410956 usec, L: 0
0926 13:55:43.411111 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.411557 (+ 446us) log.cc:844] Serialized 649 byte log entry
0926 13:55:43.653978 (+242421us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.246147 (+592169us) write_op.cc:301] APPLY: starting
0926 13:55:44.246206 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.246382 (+ 176us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.246489 (+ 107us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.248809 (+ 2320us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.248986 (+ 177us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.249027 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:44.249243 (+ 216us) log.cc:844] Serialized 64 byte log entry
0926 13:55:44.298860 (+ 49617us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.298966 (+ 106us) write_op.cc:454] Released schema lock
0926 13:55:44.299012 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":592029,"num_ops":8,"prepare.queue_time_us":322973,"prepare.run_cpu_time_us":2490,"prepare.run_wall_time_us":2491,"replication_time_us":242776,"spinlock_wait_cycles":12032}]]}
I20260926 13:55:44.331265 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=8, attempt_no=0}) took 1508 ms. Trace:
I20260926 13:55:44.323375 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=64, attempt_no=0}) took 1273 ms. Trace:
I20260926 13:55:44.337847 10352 rpcz_store.cc:276] 0926 13:55:42.822911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.830592 (+ 7681us) service_pool.cc:224] Handling call
0926 13:55:42.856523 (+ 25931us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b58001cef98. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7ea02 00007fdb0bcf9119 00007fdb0b812a70 00007fdb0b8db6db 00007fdb0b8db761 00007fdb0b89ab20 00007fdb0b886ca9 00007fdb0b884fa2 00007fdb09f87084
0926 13:55:44.331207 (+1474684us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.029096 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.036765 (+ 7669us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.036792 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:43.036804 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:43.039490 (+ 2686us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.039540 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.039570 (+ 30us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:43.040645 (+ 1075us) tablet.cc:701] Row locks acquired
0926 13:55:43.040664 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.040849 (+ 185us) write_op.cc:270] Start()
0926 13:55:43.040936 (+ 87us) write_op.cc:276] Timestamp: P: 1790430943040803 usec, L: 0
0926 13:55:43.040946 (+ 10us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.041389 (+ 443us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:43.180096 (+138707us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b540033fa20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb09796672 00007fdb097773da 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5
0926 13:55:43.802089 (+621993us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.303980 (+501891us) write_op.cc:301] APPLY: starting
0926 13:55:44.304045 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.304342 (+ 297us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.304362 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.329944 (+ 25582us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.330217 (+ 273us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.330262 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.330582 (+ 320us) log.cc:844] Serialized 124 byte log entry
0926 13:55:44.330773 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.330896 (+ 123us) write_op.cc:454] Released schema lock
0926 13:55:44.330947 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":5280640,"child_traces":[["op",{"apply.queue_time_us":501731,"mutex_wait_us":8254,"num_ops":18,"prepare.queue_time_us":113821,"prepare.run_cpu_time_us":13063,"prepare.run_wall_time_us":153826,"raft.queue_time_us":1470,"raft.run_cpu_time_us":3158,"raft.run_wall_time_us":88086,"replication_time_us":761020,"spinlock_wait_cycles":22867456,"thread_start_us":217873,"threads_started":2,"wal-append.queue_time_us":103654}]]}
I20260926 13:55:44.336544 10339 rpcz_store.cc:276] 0926 13:55:43.049829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.051122 (+ 1293us) service_pool.cc:224] Handling call
0926 13:55:44.323321 (+1272199us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.433018 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:43.433459 (+ 441us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.433492 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:43.433508 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.434310 (+ 802us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.434354 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.434381 (+ 27us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.435167 (+ 786us) tablet.cc:701] Row locks acquired
0926 13:55:43.435185 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:43.435323 (+ 138us) write_op.cc:270] Start()
0926 13:55:43.435410 (+ 87us) write_op.cc:276] Timestamp: P: 1790430943435284 usec, L: 0
0926 13:55:43.435426 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.435967 (+ 541us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.859449 (+423482us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.282161 (+422712us) write_op.cc:301] APPLY: starting
0926 13:55:44.282223 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.282426 (+ 203us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.282617 (+ 191us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.284125 (+ 1508us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.284285 (+ 160us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.284320 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:44.284543 (+ 223us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.322943 (+ 38400us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.323041 (+ 98us) write_op.cc:454] Released schema lock
0926 13:55:44.323082 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":105344,"child_traces":[["op",{"apply.queue_time_us":422577,"num_ops":13,"prepare.queue_time_us":380327,"prepare.run_cpu_time_us":3176,"prepare.run_wall_time_us":3175,"replication_time_us":423925}]]}
I20260926 13:55:44.317310 10343 rpcz_store.cc:276] 0926 13:55:42.946177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.948822 (+ 2645us) service_pool.cc:224] Handling call
0926 13:55:44.316794 (+1367972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.643579 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.665352 (+ 21773us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.665376 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:43.665391 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:43.734156 (+ 68765us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.736329 (+ 2173us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.738632 (+ 2303us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.808771 (+ 70139us) tablet.cc:701] Row locks acquired
0926 13:55:43.808794 (+ 23us) write_op.cc:260] PREPARE: finished
0926 13:55:43.865021 (+ 56227us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b340000e128. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.865129 (+ 108us) write_op.cc:270] Start()
0926 13:55:43.865349 (+ 220us) write_op.cc:276] Timestamp: P: 1790430943865090 usec, L: 0
0926 13:55:43.865374 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.865985 (+ 611us) log.cc:844] Serialized 821 byte log entry
0926 13:55:43.879066 (+ 13081us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.313665 (+434599us) write_op.cc:301] APPLY: starting
0926 13:55:44.313732 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.313947 (+ 215us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.313964 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.315670 (+ 1706us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.315872 (+ 202us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.315920 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:44.316162 (+ 242us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.316338 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.316441 (+ 103us) write_op.cc:454] Released schema lock
0926 13:55:44.316485 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":434428,"num_ops":12,"prepare.queue_time_us":688985,"prepare.run_cpu_time_us":8748,"prepare.run_wall_time_us":228763,"raft.queue_time_us":170,"raft.run_cpu_time_us":1491,"raft.run_wall_time_us":1491,"replication_time_us":13557,"spinlock_wait_cycles":91795712}]]}
I20260926 13:55:44.320623 10354 rpcz_store.cc:276] 0926 13:55:42.973948 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.974056 (+ 108us) service_pool.cc:224] Handling call
0926 13:55:44.319939 (+1345883us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.656296 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 523e7742341b4ca8a544a267c5395c42
0926 13:55:43.707715 (+ 51419us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.707746 (+ 31us) write_op.cc:435] Acquired schema lock
0926 13:55:43.707767 (+ 21us) tablet.cc:662] Decoding operations
0926 13:55:43.708529 (+ 762us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.708578 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.708607 (+ 29us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:43.709277 (+ 670us) tablet.cc:701] Row locks acquired
0926 13:55:43.709296 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.709452 (+ 156us) write_op.cc:270] Start()
0926 13:55:43.709558 (+ 106us) write_op.cc:276] Timestamp: P: 1790430943709414 usec, L: 0
0926 13:55:43.709578 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.818183 (+108605us) log.cc:844] Serialized 778 byte log entry
0926 13:55:43.819183 (+ 1000us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54005d7854. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.850066 (+ 30883us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.311695 (+461629us) write_op.cc:301] APPLY: starting
0926 13:55:44.311763 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.311966 (+ 203us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.311986 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.313556 (+ 1570us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.313828 (+ 272us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.313870 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.314117 (+ 247us) log.cc:844] Serialized 82 byte log entry
0926 13:55:44.318707 (+ 4590us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.318813 (+ 106us) write_op.cc:454] Released schema lock
0926 13:55:44.318856 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":461477,"num_ops":11,"prepare.queue_time_us":673888,"prepare.run_cpu_time_us":5084,"prepare.run_wall_time_us":169485,"raft.queue_time_us":4582,"raft.run_cpu_time_us":1430,"raft.run_wall_time_us":1430,"replication_time_us":140374,"spinlock_wait_cycles":248365312}]]}
I20260926 13:55:44.354956 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=91, attempt_no=0}) took 1234 ms. Trace:
I20260926 13:55:44.334940 10315 rpcz_store.cc:276] 0926 13:55:42.889970 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.893451 (+ 3481us) service_pool.cc:224] Handling call
0926 13:55:44.319729 (+1426278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.648554 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:43.704003 (+ 55449us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.705277 (+ 1274us) write_op.cc:435] Acquired schema lock
0926 13:55:43.715259 (+ 9982us) tablet.cc:662] Decoding operations
0926 13:55:43.722138 (+ 6879us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.722183 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.722209 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.722987 (+ 778us) tablet.cc:701] Row locks acquired
0926 13:55:43.723002 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:43.723153 (+ 151us) write_op.cc:270] Start()
0926 13:55:43.723248 (+ 95us) write_op.cc:276] Timestamp: P: 1790430943723120 usec, L: 0
0926 13:55:43.723269 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.723826 (+ 557us) log.cc:844] Serialized 821 byte log entry
0926 13:55:43.752333 (+ 28507us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b58003ecfd0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0abdd964 00007fdb0977771e 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5 00007fdb02db8751
0926 13:55:43.819382 (+ 67049us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.314995 (+495613us) write_op.cc:301] APPLY: starting
0926 13:55:44.315062 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.315293 (+ 231us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.315314 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.317517 (+ 2203us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.317717 (+ 200us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.317761 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:44.318009 (+ 248us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.319280 (+ 1271us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.319405 (+ 125us) write_op.cc:454] Released schema lock
0926 13:55:44.319452 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":495438,"num_ops":12,"prepare.queue_time_us":736934,"prepare.run_cpu_time_us":42478,"prepare.run_wall_time_us":145048,"raft.queue_time_us":2541,"raft.run_cpu_time_us":1974,"raft.run_wall_time_us":26250,"replication_time_us":95994,"spinlock_wait_cycles":13362560,"thread_start_us":66294,"threads_started":1}]]}
I20260926 13:55:44.361353 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=22, attempt_no=0}) took 1449 ms. Trace:
I20260926 13:55:44.365082 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=17, attempt_no=0}) took 1454 ms. Trace:
I20260926 13:55:44.370285 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=10, attempt_no=0}) took 1409 ms. Trace:
I20260926 13:55:44.370421 10322 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=90, attempt_no=0}) took 1319 ms. Trace:
I20260926 13:55:44.374042 10344 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=47, attempt_no=0}) took 1426 ms. Trace:
I20260926 13:55:44.371937 10354 rpcz_store.cc:276] 0926 13:55:43.120359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.142040 (+ 21681us) service_pool.cc:224] Handling call
0926 13:55:44.354897 (+1212857us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.528892 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.649918 (+121026us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.654819 (+ 4901us) write_op.cc:435] Acquired schema lock
0926 13:55:43.655847 (+ 1028us) tablet.cc:662] Decoding operations
0926 13:55:43.720634 (+ 64787us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.720682 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.720706 (+ 24us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:43.727402 (+ 6696us) tablet.cc:701] Row locks acquired
0926 13:55:43.727423 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:43.823987 (+ 96564us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.824092 (+ 105us) write_op.cc:270] Start()
0926 13:55:43.824267 (+ 175us) write_op.cc:276] Timestamp: P: 1790430943824048 usec, L: 0
0926 13:55:43.824285 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.824870 (+ 585us) log.cc:844] Serialized 950 byte log entry
0926 13:55:43.866701 (+ 41831us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.351411 (+484710us) write_op.cc:301] APPLY: starting
0926 13:55:44.351479 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.351735 (+ 256us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.351755 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.353737 (+ 1982us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.353956 (+ 219us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.353997 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:44.354262 (+ 265us) log.cc:844] Serialized 106 byte log entry
0926 13:55:44.354442 (+ 180us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.354555 (+ 113us) write_op.cc:454] Released schema lock
0926 13:55:44.354598 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":484534,"mutex_wait_us":3853,"num_ops":15,"prepare.queue_time_us":349502,"prepare.run_cpu_time_us":6224,"prepare.run_wall_time_us":296281,"raft.queue_time_us":12619,"raft.run_cpu_time_us":715,"raft.run_wall_time_us":1085,"replication_time_us":42295,"spinlock_wait_cycles":19518208}]]}
I20260926 13:55:44.374460 10344 rpcz_store.cc:276] 0926 13:55:42.947366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.950037 (+ 2671us) service_pool.cc:224] Handling call
0926 13:55:44.373983 (+1423946us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.871191 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.871637 (+ 446us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.871666 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:43.871685 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:43.881024 (+ 9339us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.900150 (+ 19126us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.900591 (+ 441us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.909580 (+ 8989us) tablet.cc:701] Row locks acquired
0926 13:55:43.909600 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:43.909746 (+ 146us) write_op.cc:270] Start()
0926 13:55:43.909852 (+ 106us) write_op.cc:276] Timestamp: P: 1790430943909705 usec, L: 0
0926 13:55:43.909867 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.910399 (+ 532us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.971138 (+ 60739us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.366013 (+394875us) write_op.cc:301] APPLY: starting
0926 13:55:44.366079 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.366306 (+ 227us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.366388 (+ 82us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.368046 (+ 1658us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.368254 (+ 208us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.368296 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.368554 (+ 258us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.373547 (+ 4993us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.373656 (+ 109us) write_op.cc:454] Released schema lock
0926 13:55:44.373703 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":394716,"num_ops":13,"prepare.queue_time_us":919643,"prepare.run_cpu_time_us":3471,"prepare.run_wall_time_us":39520,"raft.queue_time_us":1168,"raft.run_cpu_time_us":695,"raft.run_wall_time_us":695,"replication_time_us":61146}]]}
I20260926 13:55:44.363088 10352 rpcz_store.cc:276] 0926 13:55:42.911979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.914608 (+ 2629us) service_pool.cc:224] Handling call
0926 13:55:44.361297 (+1446689us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.341792 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.367119 (+ 25327us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.367151 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:43.367169 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:43.368116 (+ 947us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.368947 (+ 831us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.371581 (+ 2634us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:43.403960 (+ 32379us) tablet.cc:701] Row locks acquired
0926 13:55:43.403980 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:43.404127 (+ 147us) write_op.cc:270] Start()
0926 13:55:43.404247 (+ 120us) write_op.cc:276] Timestamp: P: 1790430943404093 usec, L: 0
0926 13:55:43.404262 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.426428 (+ 22166us) log.cc:844] Serialized 1036 byte log entry
0926 13:55:43.871736 (+445308us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.357499 (+485763us) write_op.cc:301] APPLY: starting
0926 13:55:44.357564 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.357847 (+ 283us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.357944 (+ 97us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.360079 (+ 2135us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.360319 (+ 240us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.360361 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.360662 (+ 301us) log.cc:844] Serialized 118 byte log entry
0926 13:55:44.360838 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.360961 (+ 123us) write_op.cc:454] Released schema lock
0926 13:55:44.361012 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":485613,"mutex_wait_us":4839,"num_ops":17,"prepare.queue_time_us":417467,"prepare.run_cpu_time_us":4302,"prepare.run_wall_time_us":86398,"replication_time_us":467364}]]}
I20260926 13:55:44.370725 10339 rpcz_store.cc:276] 0926 13:55:42.991454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.992765 (+ 1311us) service_pool.cc:224] Handling call
0926 13:55:44.370232 (+1377467us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.910836 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.911285 (+ 449us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.911311 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:43.911327 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.912110 (+ 783us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.912157 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.912182 (+ 25us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:43.912786 (+ 604us) tablet.cc:701] Row locks acquired
0926 13:55:43.912805 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.912940 (+ 135us) write_op.cc:270] Start()
0926 13:55:43.913062 (+ 122us) write_op.cc:276] Timestamp: P: 1790430943912908 usec, L: 0
0926 13:55:43.913081 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.913584 (+ 503us) log.cc:844] Serialized 735 byte log entry
0926 13:55:43.971393 (+ 57809us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.367956 (+396563us) write_op.cc:301] APPLY: starting
0926 13:55:44.368014 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.368175 (+ 161us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.368250 (+ 75us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.369370 (+ 1120us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.369531 (+ 161us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.369567 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:44.369745 (+ 178us) log.cc:844] Serialized 76 byte log entry
0926 13:55:44.369880 (+ 135us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.369967 (+ 87us) write_op.cc:454] Released schema lock
0926 13:55:44.370003 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":396432,"num_ops":10,"prepare.queue_time_us":916703,"prepare.run_cpu_time_us":2874,"prepare.run_wall_time_us":2948,"replication_time_us":58222}]]}
I20260926 13:55:44.384244 10339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=89, attempt_no=0}) took 1333 ms. Trace:
I20260926 13:55:44.387478 10339 rpcz_store.cc:276] 0926 13:55:43.050979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.051089 (+ 110us) service_pool.cc:224] Handling call
0926 13:55:44.384191 (+1333102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.941676 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.942147 (+ 471us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.942179 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:43.942197 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:43.943084 (+ 887us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.943129 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.943159 (+ 30us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:43.944021 (+ 862us) tablet.cc:701] Row locks acquired
0926 13:55:43.944041 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:43.944240 (+ 199us) write_op.cc:270] Start()
0926 13:55:43.944354 (+ 114us) write_op.cc:276] Timestamp: P: 1790430943944202 usec, L: 0
0926 13:55:43.944374 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.964579 (+ 20205us) log.cc:844] Serialized 907 byte log entry
0926 13:55:43.971835 (+ 7256us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.380993 (+409158us) write_op.cc:301] APPLY: starting
0926 13:55:44.381049 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.381255 (+ 206us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.381332 (+ 77us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.383241 (+ 1909us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.383425 (+ 184us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.383463 (+ 38us) write_op.cc:312] APPLY: finished
0926 13:55:44.383678 (+ 215us) log.cc:844] Serialized 100 byte log entry
0926 13:55:44.383803 (+ 125us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.383903 (+ 100us) write_op.cc:454] Released schema lock
0926 13:55:44.383940 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":409017,"mutex_wait_us":10031,"num_ops":14,"prepare.queue_time_us":889224,"prepare.run_cpu_time_us":3581,"prepare.run_wall_time_us":24208,"replication_time_us":27381,"spinlock_wait_cycles":31616}]]}
I20260926 13:55:44.367982 10312 rpcz_store.cc:276] 0926 13:55:42.910804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.912810 (+ 2006us) service_pool.cc:224] Handling call
0926 13:55:44.365025 (+1452215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.194058 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.219317 (+ 25259us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.219352 (+ 35us) write_op.cc:435] Acquired schema lock
0926 13:55:43.219368 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.233285 (+ 13917us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.233330 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.233354 (+ 24us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:43.234373 (+ 1019us) tablet.cc:701] Row locks acquired
0926 13:55:43.234394 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:43.335797 (+101403us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b2c0007d598. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:43.335854 (+ 57us) write_op.cc:270] Start()
0926 13:55:43.336050 (+ 196us) write_op.cc:276] Timestamp: P: 1790430943249154 usec, L: 0
0926 13:55:43.336071 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.336649 (+ 578us) log.cc:844] Serialized 993 byte log entry
0926 13:55:43.871477 (+534828us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.356307 (+484830us) write_op.cc:301] APPLY: starting
0926 13:55:44.356376 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.359783 (+ 3407us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.359807 (+ 24us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.361886 (+ 2079us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.362109 (+ 223us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.362159 (+ 50us) write_op.cc:312] APPLY: finished
0926 13:55:44.362448 (+ 289us) log.cc:844] Serialized 112 byte log entry
0926 13:55:44.362632 (+ 184us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.364703 (+ 2071us) write_op.cc:454] Released schema lock
0926 13:55:44.364773 (+ 70us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":484672,"num_ops":16,"prepare.queue_time_us":268987,"prepare.run_cpu_time_us":7257,"prepare.run_wall_time_us":148815,"replication_time_us":535293,"spinlock_wait_cycles":33607552}]]}
I20260926 13:55:44.399618 10343 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=62, attempt_no=0}) took 1407 ms. Trace:
I20260926 13:55:44.385321 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=30, attempt_no=0}) took 1451 ms. Trace:
I20260926 13:55:44.403060 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=59, attempt_no=0}) took 1390 ms. Trace:
I20260926 13:55:44.370918 10322 rpcz_store.cc:276] 0926 13:55:43.051348 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.052692 (+ 1344us) service_pool.cc:224] Handling call
0926 13:55:44.370362 (+1317670us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.598744 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6918359cdac249d28234d5119e4093df
0926 13:55:43.599181 (+ 437us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.599206 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:43.599222 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.600037 (+ 815us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.600078 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.600106 (+ 28us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:43.657907 (+ 57801us) tablet.cc:701] Row locks acquired
0926 13:55:43.657948 (+ 41us) write_op.cc:260] PREPARE: finished
0926 13:55:43.702781 (+ 44833us) write_op.cc:270] Start()
0926 13:55:43.702886 (+ 105us) write_op.cc:276] Timestamp: P: 1790430943702740 usec, L: 0
0926 13:55:43.702906 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.703447 (+ 541us) log.cc:844] Serialized 907 byte log entry
0926 13:55:43.960716 (+257269us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.356457 (+395741us) write_op.cc:301] APPLY: starting
0926 13:55:44.356845 (+ 388us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.357556 (+ 711us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.357640 (+ 84us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.359386 (+ 1746us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.359608 (+ 222us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.359649 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:44.359916 (+ 267us) log.cc:844] Serialized 100 byte log entry
0926 13:55:44.364884 (+ 4968us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.365005 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:44.365052 (+ 47us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:44.369777 (+ 4725us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b340000e128. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":395067,"mutex_wait_us":481,"num_ops":14,"prepare.queue_time_us":544510,"prepare.run_cpu_time_us":8889,"prepare.run_wall_time_us":116976,"replication_time_us":257689,"spinlock_wait_cycles":9311488}]]}
I20260926 13:55:44.414490 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=69, attempt_no=0}) took 1339 ms. Trace:
I20260926 13:55:44.407966 10343 rpcz_store.cc:276] 0926 13:55:42.992232 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.996462 (+ 4230us) service_pool.cc:224] Handling call
0926 13:55:44.399561 (+1403099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.913923 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.914366 (+ 443us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.914390 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:43.914403 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.915335 (+ 932us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.915377 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.915402 (+ 25us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:43.938953 (+ 23551us) tablet.cc:701] Row locks acquired
0926 13:55:43.938972 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.939109 (+ 137us) write_op.cc:270] Start()
0926 13:55:43.939208 (+ 99us) write_op.cc:276] Timestamp: P: 1790430943939074 usec, L: 0
0926 13:55:43.939223 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.939737 (+ 514us) log.cc:844] Serialized 1036 byte log entry
0926 13:55:43.971624 (+ 31887us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.380172 (+408548us) write_op.cc:301] APPLY: starting
0926 13:55:44.380232 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.380530 (+ 298us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.380609 (+ 79us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.382945 (+ 2336us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.383176 (+ 231us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.383216 (+ 40us) write_op.cc:312] APPLY: finished
0926 13:55:44.383509 (+ 293us) log.cc:844] Serialized 118 byte log entry
0926 13:55:44.399122 (+ 15613us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.399245 (+ 123us) write_op.cc:454] Released schema lock
0926 13:55:44.399295 (+ 50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":408409,"num_ops":17,"prepare.queue_time_us":909977,"prepare.run_cpu_time_us":3652,"prepare.run_wall_time_us":27176,"replication_time_us":32299}]]}
I20260926 13:55:44.420540 10312 rpcz_store.cc:276] 0926 13:55:43.075386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.079624 (+ 4238us) service_pool.cc:224] Handling call
0926 13:55:44.414434 (+1334810us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.609328 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.609790 (+ 462us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.609815 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:43.609831 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.610635 (+ 804us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.610673 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.610699 (+ 26us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.611540 (+ 841us) tablet.cc:701] Row locks acquired
0926 13:55:43.611557 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:43.611697 (+ 140us) write_op.cc:270] Start()
0926 13:55:43.611779 (+ 82us) write_op.cc:276] Timestamp: P: 1790430943611659 usec, L: 0
0926 13:55:43.611797 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.613755 (+ 1958us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.872683 (+258928us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.394314 (+521631us) write_op.cc:301] APPLY: starting
0926 13:55:44.394374 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.394598 (+ 224us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.394687 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.400251 (+ 5564us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.400460 (+ 209us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.400505 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.413321 (+ 12816us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.414028 (+ 707us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.414130 (+ 102us) write_op.cc:454] Released schema lock
0926 13:55:44.414176 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":521488,"num_ops":13,"prepare.queue_time_us":520345,"prepare.run_cpu_time_us":3245,"prepare.run_wall_time_us":4657,"replication_time_us":260780}]]}
I20260926 13:55:44.400959 10356 rpcz_store.cc:276] 0926 13:55:42.934860 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.934964 (+ 104us) service_pool.cc:224] Handling call
0926 13:55:44.385264 (+1450300us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.426813 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.427274 (+ 461us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.427299 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:43.427316 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.427898 (+ 582us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.427936 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.427961 (+ 25us) tablet.cc:685] Acquiring locks for 7 operations
0926 13:55:43.428405 (+ 444us) tablet.cc:701] Row locks acquired
0926 13:55:43.428426 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:43.439605 (+ 11179us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.439714 (+ 109us) write_op.cc:270] Start()
0926 13:55:43.439887 (+ 173us) write_op.cc:276] Timestamp: P: 1790430943439677 usec, L: 0
0926 13:55:43.439909 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.440459 (+ 550us) log.cc:844] Serialized 605 byte log entry
0926 13:55:43.871960 (+431501us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.366433 (+494473us) write_op.cc:301] APPLY: starting
0926 13:55:44.366496 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.366655 (+ 159us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.366676 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.370952 (+ 4276us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.371132 (+ 180us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.371177 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.371376 (+ 199us) log.cc:844] Serialized 58 byte log entry
0926 13:55:44.384786 (+ 13410us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.384872 (+ 86us) write_op.cc:454] Released schema lock
0926 13:55:44.384977 (+ 105us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":494326,"num_ops":7,"prepare.queue_time_us":489292,"prepare.run_cpu_time_us":3610,"prepare.run_wall_time_us":13862,"replication_time_us":431968,"spinlock_wait_cycles":23816064}]]}
I20260926 13:55:44.412106 10352 rpcz_store.cc:276] 0926 13:55:43.026999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.030179 (+ 3180us) service_pool.cc:224] Handling call
0926 13:55:44.403006 (+1372827us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.449773 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.450244 (+ 471us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.450269 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:43.450282 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.451163 (+ 881us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.451206 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.451235 (+ 29us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:43.452207 (+ 972us) tablet.cc:701] Row locks acquired
0926 13:55:43.452221 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:43.452364 (+ 143us) write_op.cc:270] Start()
0926 13:55:43.452490 (+ 126us) write_op.cc:276] Timestamp: P: 1790430943452320 usec, L: 0
0926 13:55:43.452506 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.608942 (+156436us) log.cc:844] Serialized 993 byte log entry
0926 13:55:43.872394 (+263452us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.379509 (+507115us) write_op.cc:301] APPLY: starting
0926 13:55:44.379590 (+ 81us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.379911 (+ 321us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.380005 (+ 94us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.400523 (+ 20518us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.400738 (+ 215us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.400802 (+ 64us) write_op.cc:312] APPLY: finished
0926 13:55:44.401940 (+ 1138us) log.cc:844] Serialized 112 byte log entry
0926 13:55:44.402581 (+ 641us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.402703 (+ 122us) write_op.cc:454] Released schema lock
0926 13:55:44.402749 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":506958,"mutex_wait_us":10144,"num_ops":16,"prepare.queue_time_us":402106,"prepare.run_cpu_time_us":3640,"prepare.run_wall_time_us":159399,"replication_time_us":419806}]]}
I20260926 13:55:44.407886 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=49, attempt_no=0}) took 1435 ms. Trace:
I20260926 13:55:44.428295 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=63, attempt_no=0}) took 1522 ms. Trace:
I20260926 13:55:44.427098 10354 rpcz_store.cc:276] 0926 13:55:42.972770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.972884 (+ 114us) service_pool.cc:224] Handling call
0926 13:55:42.976792 (+ 3908us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b2400294998. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7ea02 00007fdb0bcf9119 00007fdb02f50c10 00007fdb02f5dfc4 00007fdb0b886d55 00007fdb0b885006 00007fdb09f87084 00007fdb09f87012 00007fdb09f86f41
0926 13:55:44.407828 (+1431036us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.444872 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.445313 (+ 441us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.445337 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:43.445350 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.446391 (+ 1041us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.446436 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.446460 (+ 24us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:43.447470 (+ 1010us) tablet.cc:701] Row locks acquired
0926 13:55:43.447489 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.447636 (+ 147us) write_op.cc:270] Start()
0926 13:55:43.447729 (+ 93us) write_op.cc:276] Timestamp: P: 1790430943447594 usec, L: 0
0926 13:55:43.447745 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.448272 (+ 527us) log.cc:844] Serialized 993 byte log entry
0926 13:55:43.872193 (+423921us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.378772 (+506579us) write_op.cc:301] APPLY: starting
0926 13:55:44.378837 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.379100 (+ 263us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.379187 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.404480 (+ 25293us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.404711 (+ 231us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.404773 (+ 62us) write_op.cc:312] APPLY: finished
0926 13:55:44.405064 (+ 291us) log.cc:844] Serialized 112 byte log entry
0926 13:55:44.407392 (+ 2328us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.407513 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:44.407566 (+ 53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":3997824,"child_traces":[["op",{"apply.queue_time_us":506439,"num_ops":16,"prepare.queue_time_us":463095,"prepare.run_cpu_time_us":3513,"prepare.run_wall_time_us":4743,"replication_time_us":424362}]]}
I20260926 13:55:44.433911 10343 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=95, attempt_no=0}) took 1382 ms. Trace:
I20260926 13:55:44.440168 10338 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=82, attempt_no=0}) took 1484 ms. Trace:
I20260926 13:55:44.437925 10315 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=81, attempt_no=0}) took 1482 ms. Trace:
I20260926 13:55:44.428673 10331 rpcz_store.cc:276] 0926 13:55:42.916548 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.917926 (+ 1378us) service_pool.cc:224] Handling call
0926 13:55:44.428235 (+1510309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.836492 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:43.890360 (+ 53868us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.890389 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:43.890402 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:43.892758 (+ 2356us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.892807 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.892833 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.896786 (+ 3953us) tablet.cc:701] Row locks acquired
0926 13:55:43.896812 (+ 26us) write_op.cc:260] PREPARE: finished
0926 13:55:43.896976 (+ 164us) write_op.cc:270] Start()
0926 13:55:43.897066 (+ 90us) write_op.cc:276] Timestamp: P: 1790430943896934 usec, L: 0
0926 13:55:43.897085 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.897643 (+ 558us) log.cc:844] Serialized 821 byte log entry
0926 13:55:43.960828 (+ 63185us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b1800213100. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb02db6363 00007fdb02db8751 00007fdb02db8709 00007fdb02db8699 00007fdb02db8661 00007fdb02db795d 000000000041fb94 000000000041f9d9 00007fdb02d9981a
0926 13:55:44.035571 (+ 74743us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.391964 (+356393us) write_op.cc:301] APPLY: starting
0926 13:55:44.392035 (+ 71us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.392246 (+ 211us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.392266 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.427145 (+ 34879us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.427351 (+ 206us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.427401 (+ 50us) write_op.cc:312] APPLY: finished
0926 13:55:44.427648 (+ 247us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.427813 (+ 165us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.427919 (+ 106us) write_op.cc:454] Released schema lock
0926 13:55:44.427965 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":356239,"num_ops":12,"prepare.queue_time_us":872758,"prepare.run_cpu_time_us":3621,"prepare.run_wall_time_us":119609,"raft.queue_time_us":23429,"raft.run_cpu_time_us":967,"raft.run_wall_time_us":1839,"replication_time_us":138374,"spinlock_wait_cycles":11576192}]]}
I20260926 13:55:44.442400 10338 rpcz_store.cc:276] 0926 13:55:42.955926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.956435 (+ 509us) service_pool.cc:224] Handling call
0926 13:55:44.440115 (+1483680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.057798 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:44.058233 (+ 435us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.058259 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:44.058274 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:44.058945 (+ 671us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.058988 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.059016 (+ 28us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:44.059515 (+ 499us) tablet.cc:701] Row locks acquired
0926 13:55:44.059534 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:44.059674 (+ 140us) write_op.cc:270] Start()
0926 13:55:44.059777 (+ 103us) write_op.cc:276] Timestamp: P: 1790430944059634 usec, L: 0
0926 13:55:44.059796 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.060316 (+ 520us) log.cc:844] Serialized 692 byte log entry
0926 13:55:44.077439 (+ 17123us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.435158 (+357719us) write_op.cc:301] APPLY: starting
0926 13:55:44.435213 (+ 55us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.435375 (+ 162us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.435451 (+ 76us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.436462 (+ 1011us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.436620 (+ 158us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.436658 (+ 38us) write_op.cc:312] APPLY: finished
0926 13:55:44.436863 (+ 205us) log.cc:844] Serialized 70 byte log entry
0926 13:55:44.439755 (+ 2892us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.439833 (+ 78us) write_op.cc:454] Released schema lock
0926 13:55:44.439869 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":357588,"num_ops":9,"prepare.queue_time_us":1099915,"prepare.run_cpu_time_us":2748,"prepare.run_wall_time_us":2756,"replication_time_us":17554}]]}
I20260926 13:55:44.440055 10343 rpcz_store.cc:276] 0926 13:55:43.051681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.053882 (+ 2201us) service_pool.cc:224] Handling call
0926 13:55:44.433854 (+1379972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.976084 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e4f583082bc049b4ae9a7c2220868f51
0926 13:55:43.976567 (+ 483us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.976592 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:43.976607 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:43.977362 (+ 755us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.977400 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.977425 (+ 25us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.978193 (+ 768us) tablet.cc:701] Row locks acquired
0926 13:55:43.978209 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:43.978351 (+ 142us) write_op.cc:270] Start()
0926 13:55:43.978447 (+ 96us) write_op.cc:276] Timestamp: P: 1790430943978314 usec, L: 0
0926 13:55:43.978466 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.979007 (+ 541us) log.cc:844] Serialized 821 byte log entry
0926 13:55:44.035634 (+ 56627us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.422843 (+387209us) write_op.cc:301] APPLY: starting
0926 13:55:44.422904 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.423117 (+ 213us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.423202 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.428167 (+ 4965us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.428363 (+ 196us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.428405 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.432591 (+ 4186us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.433445 (+ 854us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.433561 (+ 116us) write_op.cc:454] Released schema lock
0926 13:55:44.433603 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":387064,"num_ops":12,"prepare.queue_time_us":920819,"prepare.run_cpu_time_us":3231,"prepare.run_wall_time_us":5250,"raft.queue_time_us":82,"raft.run_cpu_time_us":689,"raft.run_wall_time_us":689,"replication_time_us":57077}]]}
I20260926 13:55:44.440557 10315 rpcz_store.cc:276] 0926 13:55:42.955537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.955674 (+ 137us) service_pool.cc:224] Handling call
0926 13:55:44.437872 (+1482198us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.932129 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:43.994756 (+ 62627us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.994791 (+ 35us) write_op.cc:435] Acquired schema lock
0926 13:55:43.994809 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:43.999374 (+ 4565us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.999406 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.999422 (+ 16us) tablet.cc:685] Acquiring locks for 6 operations
0926 13:55:43.999718 (+ 296us) tablet.cc:701] Row locks acquired
0926 13:55:43.999727 (+ 9us) write_op.cc:260] PREPARE: finished
0926 13:55:44.045250 (+ 45523us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:44.045351 (+ 101us) write_op.cc:270] Start()
0926 13:55:44.045536 (+ 185us) write_op.cc:276] Timestamp: P: 1790430944045314 usec, L: 0
0926 13:55:44.045559 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.057399 (+ 11840us) log.cc:844] Serialized 562 byte log entry
0926 13:55:44.077193 (+ 19794us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.432468 (+355275us) write_op.cc:301] APPLY: starting
0926 13:55:44.432528 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.432660 (+ 132us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.432678 (+ 18us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.433374 (+ 696us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.433509 (+ 135us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.433543 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:44.433699 (+ 156us) log.cc:844] Serialized 52 byte log entry
0926 13:55:44.437516 (+ 3817us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.437587 (+ 71us) write_op.cc:454] Released schema lock
0926 13:55:44.437620 (+ 33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":355102,"num_ops":6,"prepare.queue_time_us":973214,"prepare.run_cpu_time_us":3211,"prepare.run_wall_time_us":126937,"replication_time_us":31513,"spinlock_wait_cycles":34196736}]]}
I20260926 13:55:44.469367 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=88, attempt_no=0}) took 1349 ms. Trace:
I20260926 13:55:44.469522 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=97, attempt_no=0}) took 1267 ms. Trace:
I20260926 13:55:44.469781 10312 rpcz_store.cc:276] 0926 13:55:43.119993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.120460 (+ 467us) service_pool.cc:224] Handling call
0926 13:55:44.469306 (+1348846us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.594101 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:43.594588 (+ 487us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.594620 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:43.594637 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.595464 (+ 827us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.595502 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.595533 (+ 31us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.596324 (+ 791us) tablet.cc:701] Row locks acquired
0926 13:55:43.596342 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:43.596482 (+ 140us) write_op.cc:270] Start()
0926 13:55:43.640579 (+ 44097us) write_op.cc:276] Timestamp: P: 1790430943596446 usec, L: 0
0926 13:55:43.641407 (+ 828us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.729722 (+ 88315us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b54000107a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:43.730278 (+ 556us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.730838 (+ 560us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b540000ffd4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:43.951087 (+220249us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.451450 (+500363us) write_op.cc:301] APPLY: starting
0926 13:55:44.451511 (+ 61us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.451742 (+ 231us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.451763 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.453490 (+ 1727us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.453688 (+ 198us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.453730 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.453992 (+ 262us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.468880 (+ 14888us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.468999 (+ 119us) write_op.cc:454] Released schema lock
0926 13:55:44.469044 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":500191,"mutex_wait_us":60409,"num_ops":13,"prepare.queue_time_us":375166,"prepare.run_cpu_time_us":13196,"prepare.run_wall_time_us":336932,"raft.queue_time_us":64037,"raft.run_cpu_time_us":1575,"raft.run_wall_time_us":7959,"replication_time_us":308931,"spinlock_wait_cycles":32694784,"thread_start_us":125871,"threads_started":1}]]}
I20260926 13:55:44.480227 10348 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=78, attempt_no=0}) took 1539 ms. Trace:
I20260926 13:55:44.472694 10356 rpcz_store.cc:276] 0926 13:55:43.202006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.204512 (+ 2506us) service_pool.cc:224] Handling call
0926 13:55:44.469455 (+1264943us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.834855 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 6155ca469bbe44b5aa53b1187d8b2275
0926 13:55:43.835328 (+ 473us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.835360 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:43.835376 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.836198 (+ 822us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.836240 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.836271 (+ 31us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:43.921223 (+ 84952us) tablet.cc:701] Row locks acquired
0926 13:55:43.921243 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:43.921389 (+ 146us) write_op.cc:270] Start()
0926 13:55:43.921518 (+ 129us) write_op.cc:276] Timestamp: P: 1790430943921353 usec, L: 0
0926 13:55:43.921539 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.922097 (+ 558us) log.cc:844] Serialized 864 byte log entry
0926 13:55:43.966198 (+ 44101us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.458841 (+492643us) write_op.cc:301] APPLY: starting
0926 13:55:44.458900 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.459126 (+ 226us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.459212 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.464282 (+ 5070us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.464499 (+ 217us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.464544 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.464815 (+ 271us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.468933 (+ 4118us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.469041 (+ 108us) write_op.cc:454] Released schema lock
0926 13:55:44.469087 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":492484,"num_ops":13,"prepare.queue_time_us":628864,"prepare.run_cpu_time_us":3694,"prepare.run_wall_time_us":93272,"raft.queue_time_us":100,"raft.run_cpu_time_us":703,"raft.run_wall_time_us":703,"replication_time_us":44551,"spinlock_wait_cycles":152960}]]}
I20260926 13:55:44.492820 10348 rpcz_store.cc:276] 0926 13:55:42.954376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.960068 (+ 5692us) service_pool.cc:224] Handling call
0926 13:55:44.480168 (+1520100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.060707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:44.093192 (+ 32485us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.093224 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:44.093242 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:44.094349 (+ 1107us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.094393 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.094421 (+ 28us) tablet.cc:685] Acquiring locks for 19 operations
0926 13:55:44.095369 (+ 948us) tablet.cc:701] Row locks acquired
0926 13:55:44.095387 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:44.095534 (+ 147us) write_op.cc:270] Start()
0926 13:55:44.095627 (+ 93us) write_op.cc:276] Timestamp: P: 1790430944095497 usec, L: 0
0926 13:55:44.095642 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.096171 (+ 529us) log.cc:844] Serialized 1122 byte log entry
0926 13:55:44.219175 (+123004us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.476004 (+256829us) write_op.cc:301] APPLY: starting
0926 13:55:44.476062 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.476423 (+ 361us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.476528 (+ 105us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.478969 (+ 2441us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.479218 (+ 249us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.479261 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:44.479564 (+ 303us) log.cc:844] Serialized 131 byte log entry
0926 13:55:44.479724 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.479855 (+ 131us) write_op.cc:454] Released schema lock
0926 13:55:44.479906 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":256675,"num_ops":19,"prepare.queue_time_us":1094036,"prepare.run_cpu_time_us":3902,"prepare.run_wall_time_us":123708,"raft.queue_time_us":63978,"raft.run_cpu_time_us":732,"raft.run_wall_time_us":732,"replication_time_us":123428}]]}
I20260926 13:55:44.493229 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=42, attempt_no=0}) took 1521 ms. Trace:
I20260926 13:55:44.498615 10312 rpcz_store.cc:276] 0926 13:55:42.972019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.972128 (+ 109us) service_pool.cc:224] Handling call
0926 13:55:44.493175 (+1521047us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.778295 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:43.778823 (+ 528us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.778855 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:43.778872 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:43.779654 (+ 782us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.779703 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.779729 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:43.780493 (+ 764us) tablet.cc:701] Row locks acquired
0926 13:55:43.780512 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:43.792029 (+ 11517us) write_op.cc:270] Start()
0926 13:55:43.794079 (+ 2050us) write_op.cc:276] Timestamp: P: 1790430943790737 usec, L: 0
0926 13:55:43.794636 (+ 557us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.868266 (+ 73630us) log.cc:844] Serialized 821 byte log entry
0926 13:55:44.012472 (+144206us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.478430 (+465958us) write_op.cc:301] APPLY: starting
0926 13:55:44.478493 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.478718 (+ 225us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.478808 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.480453 (+ 1645us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.480660 (+ 207us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.480702 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:44.480958 (+ 256us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.492795 (+ 11837us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.492890 (+ 95us) write_op.cc:454] Released schema lock
0926 13:55:44.492940 (+ 50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":465793,"num_ops":12,"prepare.queue_time_us":804767,"prepare.run_cpu_time_us":3796,"prepare.run_wall_time_us":95937,"raft.queue_time_us":1054,"raft.run_cpu_time_us":1337,"raft.run_wall_time_us":1336,"replication_time_us":217697}]]}
I20260926 13:55:44.505878 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=39, attempt_no=0}) took 1534 ms. Trace:
I20260926 13:55:44.509927 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=54, attempt_no=0}) took 1525 ms. Trace:
I20260926 13:55:44.510267 10312 rpcz_store.cc:276] 0926 13:55:42.984820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.984923 (+ 103us) service_pool.cc:224] Handling call
0926 13:55:44.509865 (+1524942us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.900499 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:43.921323 (+ 20824us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.921357 (+ 34us) write_op.cc:435] Acquired schema lock
0926 13:55:43.921373 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:43.922046 (+ 673us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.922086 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.922110 (+ 24us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:43.922676 (+ 566us) tablet.cc:701] Row locks acquired
0926 13:55:43.922694 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:43.929269 (+ 6575us) write_op.cc:270] Start()
0926 13:55:43.931519 (+ 2250us) write_op.cc:276] Timestamp: P: 1790430943922805 usec, L: 0
0926 13:55:43.932094 (+ 575us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.941421 (+ 9327us) log.cc:844] Serialized 692 byte log entry
0926 13:55:44.050375 (+108954us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.507230 (+456855us) write_op.cc:301] APPLY: starting
0926 13:55:44.507282 (+ 52us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.507430 (+ 148us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.507509 (+ 79us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.508444 (+ 935us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.508590 (+ 146us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.508627 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:44.508827 (+ 200us) log.cc:844] Serialized 70 byte log entry
0926 13:55:44.509497 (+ 670us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.509583 (+ 86us) write_op.cc:454] Released schema lock
0926 13:55:44.509617 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":456711,"num_ops":9,"prepare.queue_time_us":898679,"prepare.run_cpu_time_us":3029,"prepare.run_wall_time_us":41951,"replication_time_us":118154}]]}
I20260926 13:55:44.506238 10354 rpcz_store.cc:276] 0926 13:55:42.971688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.973497 (+ 1809us) service_pool.cc:224] Handling call
0926 13:55:42.989557 (+ 16060us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b2400294998. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7ea02 00007fdb0bcf9119 00007fdb02f50c10 00007fdb02f5dfc4 00007fdb0b886d55 00007fdb0b885006 00007fdb09f87084 00007fdb09f87012 00007fdb09f86f41
0926 13:55:44.505824 (+1516267us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.824558 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 523e7742341b4ca8a544a267c5395c42
0926 13:55:43.930854 (+106296us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.931572 (+ 718us) write_op.cc:435] Acquired schema lock
0926 13:55:43.932554 (+ 982us) tablet.cc:662] Decoding operations
0926 13:55:43.987833 (+ 55279us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.987886 (+ 53us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.987911 (+ 25us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:43.988452 (+ 541us) tablet.cc:701] Row locks acquired
0926 13:55:43.988466 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:43.988611 (+ 145us) write_op.cc:270] Start()
0926 13:55:43.988709 (+ 98us) write_op.cc:276] Timestamp: P: 1790430943988573 usec, L: 0
0926 13:55:43.988729 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.989319 (+ 590us) log.cc:844] Serialized 735 byte log entry
0926 13:55:44.048008 (+ 58689us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.502891 (+454883us) write_op.cc:301] APPLY: starting
0926 13:55:44.502964 (+ 73us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.503127 (+ 163us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.503205 (+ 78us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.504315 (+ 1110us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.504467 (+ 152us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.504502 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:44.504691 (+ 189us) log.cc:844] Serialized 76 byte log entry
0926 13:55:44.505463 (+ 772us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.505542 (+ 79us) write_op.cc:454] Released schema lock
0926 13:55:44.505579 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":8745728,"child_traces":[["op",{"apply.queue_time_us":454723,"mutex_wait_us":2814,"num_ops":10,"prepare.queue_time_us":834085,"prepare.run_cpu_time_us":3364,"prepare.run_wall_time_us":166281,"raft.queue_time_us":2624,"raft.run_cpu_time_us":1900,"raft.run_wall_time_us":17795,"replication_time_us":59142}]]}
I20260926 13:55:44.529405 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=75, attempt_no=0}) took 1444 ms. Trace:
I20260926 13:55:44.529774 10352 rpcz_store.cc:276] 0926 13:55:43.085364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.089902 (+ 4538us) service_pool.cc:224] Handling call
0926 13:55:44.529338 (+1439436us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.614125 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:43.717609 (+103484us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.718551 (+ 942us) write_op.cc:435] Acquired schema lock
0926 13:55:43.720120 (+ 1569us) tablet.cc:662] Decoding operations
0926 13:55:43.915273 (+195153us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.915313 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.915339 (+ 26us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:43.989101 (+ 73762us) tablet.cc:701] Row locks acquired
0926 13:55:43.989122 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:43.989281 (+ 159us) write_op.cc:270] Start()
0926 13:55:43.989381 (+ 100us) write_op.cc:276] Timestamp: P: 1790430943989243 usec, L: 0
0926 13:55:43.989401 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:43.989962 (+ 561us) log.cc:844] Serialized 950 byte log entry
0926 13:55:44.048097 (+ 58135us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.507092 (+458995us) write_op.cc:301] APPLY: starting
0926 13:55:44.507160 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.507421 (+ 261us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.507511 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.509392 (+ 1881us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.509646 (+ 254us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.509689 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:44.509947 (+ 258us) log.cc:844] Serialized 106 byte log entry
0926 13:55:44.528899 (+ 18952us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.529020 (+ 121us) write_op.cc:454] Released schema lock
0926 13:55:44.529074 (+ 54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":458826,"mutex_wait_us":6536,"num_ops":15,"prepare.queue_time_us":522875,"prepare.run_cpu_time_us":4687,"prepare.run_wall_time_us":378876,"raft.queue_time_us":722,"raft.run_cpu_time_us":1703,"raft.run_wall_time_us":2624,"replication_time_us":58588,"spinlock_wait_cycles":1237248}]]}
I20260926 13:55:44.551522 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=16, attempt_no=0}) took 1641 ms. Trace:
I20260926 13:55:44.551923 10356 rpcz_store.cc:276] 0926 13:55:42.910444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:42.917537 (+ 7093us) service_pool.cc:224] Handling call
0926 13:55:44.551458 (+1633921us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.007321 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 523e7742341b4ca8a544a267c5395c42
0926 13:55:44.039388 (+ 32067us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.039415 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:44.039431 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:44.040096 (+ 665us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.040137 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.040161 (+ 24us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:44.040678 (+ 517us) tablet.cc:701] Row locks acquired
0926 13:55:44.040692 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:44.119041 (+ 78349us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:44.119198 (+ 157us) write_op.cc:270] Start()
0926 13:55:44.119378 (+ 180us) write_op.cc:276] Timestamp: P: 1790430944119106 usec, L: 0
0926 13:55:44.119399 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.119974 (+ 575us) log.cc:844] Serialized 692 byte log entry
0926 13:55:44.133828 (+ 13854us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.548330 (+414502us) write_op.cc:301] APPLY: starting
0926 13:55:44.548399 (+ 69us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.548582 (+ 183us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.548614 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.549500 (+ 886us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.549604 (+ 104us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.549629 (+ 25us) write_op.cc:312] APPLY: finished
0926 13:55:44.549764 (+ 135us) log.cc:844] Serialized 70 byte log entry
0926 13:55:44.549910 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.549994 (+ 84us) write_op.cc:454] Released schema lock
0926 13:55:44.550028 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":414319,"num_ops":9,"prepare.queue_time_us":959830,"prepare.run_cpu_time_us":4131,"prepare.run_wall_time_us":120719,"raft.queue_time_us":1635,"raft.run_cpu_time_us":1385,"raft.run_wall_time_us":1385,"replication_time_us":14311,"spinlock_wait_cycles":54882688}]]}
I20260926 13:55:44.557673 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=76, attempt_no=0}) took 1472 ms. Trace:
I20260926 13:55:44.558518 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=68, attempt_no=0}) took 1483 ms. Trace:
I20260926 13:55:44.559067 10352 rpcz_store.cc:276] 0926 13:55:43.074989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.079454 (+ 4465us) service_pool.cc:224] Handling call
0926 13:55:44.558465 (+1479011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:43.941796 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:43.942215 (+ 419us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:43.942244 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:43.942258 (+ 14us) tablet.cc:662] Decoding operations
0926 13:55:43.943370 (+ 1112us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:43.943413 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:43.943439 (+ 26us) tablet.cc:685] Acquiring locks for 20 operations
0926 13:55:43.944444 (+ 1005us) tablet.cc:701] Row locks acquired
0926 13:55:43.944462 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:43.944599 (+ 137us) write_op.cc:270] Start()
0926 13:55:43.944700 (+ 101us) write_op.cc:276] Timestamp: P: 1790430943944564 usec, L: 0
0926 13:55:43.944719 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.005557 (+ 60838us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54002c4fa0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:44.006089 (+ 532us) log.cc:844] Serialized 1165 byte log entry
0926 13:55:44.153669 (+147580us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.551339 (+397670us) write_op.cc:301] APPLY: starting
0926 13:55:44.551966 (+ 627us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.552310 (+ 344us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.552333 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.556716 (+ 4383us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.556983 (+ 267us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.557028 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:44.557349 (+ 321us) log.cc:844] Serialized 138 byte log entry
0926 13:55:44.558020 (+ 671us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.558152 (+ 132us) write_op.cc:454] Released schema lock
0926 13:55:44.558202 (+ 50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":397437,"num_ops":20,"prepare.queue_time_us":860052,"prepare.run_cpu_time_us":6447,"prepare.run_wall_time_us":107654,"raft.queue_time_us":33952,"raft.run_cpu_time_us":695,"raft.run_wall_time_us":695,"replication_time_us":208860,"spinlock_wait_cycles":34160896}]]}
I20260926 13:55:44.567000 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=84, attempt_no=0}) took 1478 ms. Trace:
I20260926 13:55:44.567793 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=77, attempt_no=0}) took 1479 ms. Trace:
I20260926 13:55:44.568284 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=98, attempt_no=0}) took 1366 ms. Trace:
I20260926 13:55:44.567803 10356 rpcz_store.cc:276] 0926 13:55:43.088386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.094821 (+ 6435us) service_pool.cc:224] Handling call
0926 13:55:44.566947 (+1472126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.029709 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:44.030234 (+ 525us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.030259 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:44.030274 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:44.031062 (+ 788us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.031104 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.031136 (+ 32us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:44.032025 (+ 889us) tablet.cc:701] Row locks acquired
0926 13:55:44.032042 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:44.109218 (+ 77176us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:44.109323 (+ 105us) write_op.cc:270] Start()
0926 13:55:44.109515 (+ 192us) write_op.cc:276] Timestamp: P: 1790430944109286 usec, L: 0
0926 13:55:44.109535 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.110060 (+ 525us) log.cc:844] Serialized 821 byte log entry
0926 13:55:44.213617 (+103557us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.556823 (+343206us) write_op.cc:301] APPLY: starting
0926 13:55:44.556882 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.557189 (+ 307us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.557205 (+ 16us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.558593 (+ 1388us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.558753 (+ 160us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.558787 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:44.559040 (+ 253us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.559707 (+ 667us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.559801 (+ 94us) write_op.cc:454] Released schema lock
0926 13:55:44.559838 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":343039,"num_ops":12,"prepare.queue_time_us":932588,"prepare.run_cpu_time_us":4334,"prepare.run_wall_time_us":82979,"raft.queue_time_us":168,"raft.run_cpu_time_us":1463,"raft.run_wall_time_us":1461,"replication_time_us":103959,"spinlock_wait_cycles":67395328}]]}
I20260926 13:55:44.574048 10352 rpcz_store.cc:276] 0926 13:55:43.202368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.202494 (+ 126us) service_pool.cc:224] Handling call
0926 13:55:44.568222 (+1365728us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.112847 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1955e4b3c9e48b0b2f0e17785af7393
0926 13:55:44.113288 (+ 441us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.113324 (+ 36us) write_op.cc:435] Acquired schema lock
0926 13:55:44.113339 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:44.114120 (+ 781us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.114160 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.114189 (+ 29us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:44.114965 (+ 776us) tablet.cc:701] Row locks acquired
0926 13:55:44.114981 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:44.115127 (+ 146us) write_op.cc:270] Start()
0926 13:55:44.130329 (+ 15202us) write_op.cc:276] Timestamp: P: 1790430944115085 usec, L: 0
0926 13:55:44.130356 (+ 27us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.130867 (+ 511us) log.cc:844] Serialized 821 byte log entry
0926 13:55:44.220556 (+ 89689us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.564335 (+343779us) write_op.cc:301] APPLY: starting
0926 13:55:44.564400 (+ 65us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.564622 (+ 222us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.564709 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.566549 (+ 1840us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.566749 (+ 200us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.566792 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:44.567040 (+ 248us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.567204 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.567871 (+ 667us) write_op.cc:454] Released schema lock
0926 13:55:44.567921 (+ 50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":343630,"num_ops":12,"prepare.queue_time_us":908955,"prepare.run_cpu_time_us":3165,"prepare.run_wall_time_us":38321,"replication_time_us":90093}]]}
I20260926 13:55:44.568195 10312 rpcz_store.cc:276] 0926 13:55:43.088023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.088489 (+ 466us) service_pool.cc:224] Handling call
0926 13:55:44.567752 (+1479263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.049602 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:44.050090 (+ 488us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.050116 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:44.050132 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:44.050916 (+ 784us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.050968 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.050994 (+ 26us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:44.069486 (+ 18492us) tablet.cc:701] Row locks acquired
0926 13:55:44.069501 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:44.069646 (+ 145us) write_op.cc:270] Start()
0926 13:55:44.069766 (+ 120us) write_op.cc:276] Timestamp: P: 1790430944069615 usec, L: 0
0926 13:55:44.069786 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.107021 (+ 37235us) log.cc:844] Serialized 864 byte log entry
0926 13:55:44.153460 (+ 46439us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54002c4fa0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb09794be8 00007fdb0979482a 00007fdb09819125 00007fdb098195c9 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:44.155337 (+ 1877us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.554890 (+399553us) write_op.cc:301] APPLY: starting
0926 13:55:44.554958 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.555170 (+ 212us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.555191 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.556883 (+ 1692us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.566954 (+ 10071us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.566994 (+ 40us) write_op.cc:312] APPLY: finished
0926 13:55:44.567201 (+ 207us) log.cc:844] Serialized 94 byte log entry
0926 13:55:44.567356 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.567463 (+ 107us) write_op.cc:454] Released schema lock
0926 13:55:44.567503 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":399420,"num_ops":13,"prepare.queue_time_us":959758,"prepare.run_cpu_time_us":4935,"prepare.run_wall_time_us":106108,"raft.queue_time_us":72,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":539,"replication_time_us":85478,"spinlock_wait_cycles":24113408}]]}
I20260926 13:55:44.587177 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=93, attempt_no=0}) took 1401 ms. Trace:
I20260926 13:55:44.587502 10312 rpcz_store.cc:276] 0926 13:55:43.199135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.209325 (+ 10190us) service_pool.cc:224] Handling call
0926 13:55:44.587124 (+1377799us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.246089 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:44.246532 (+ 443us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.246557 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:44.246570 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:44.247507 (+ 937us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.248088 (+ 581us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.248119 (+ 31us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:44.249075 (+ 956us) tablet.cc:701] Row locks acquired
0926 13:55:44.249089 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:44.249227 (+ 138us) write_op.cc:270] Start()
0926 13:55:44.249312 (+ 85us) write_op.cc:276] Timestamp: P: 1790430944249196 usec, L: 0
0926 13:55:44.249331 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.249837 (+ 506us) log.cc:844] Serialized 993 byte log entry
0926 13:55:44.276304 (+ 26467us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.584074 (+307770us) write_op.cc:301] APPLY: starting
0926 13:55:44.584132 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.584345 (+ 213us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.584422 (+ 77us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.586150 (+ 1728us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.586329 (+ 179us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.586368 (+ 39us) write_op.cc:312] APPLY: finished
0926 13:55:44.586609 (+ 241us) log.cc:844] Serialized 112 byte log entry
0926 13:55:44.586756 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.586860 (+ 104us) write_op.cc:454] Released schema lock
0926 13:55:44.586899 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":307614,"num_ops":16,"prepare.queue_time_us":1028509,"prepare.run_cpu_time_us":3448,"prepare.run_wall_time_us":5579,"replication_time_us":26875}]]}
I20260926 13:55:44.558081 10354 rpcz_store.cc:276] 0926 13:55:43.085715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.085835 (+ 120us) service_pool.cc:224] Handling call
0926 13:55:44.557611 (+1471776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.124075 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 523e7742341b4ca8a544a267c5395c42
0926 13:55:44.124530 (+ 455us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.124555 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:44.124571 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:44.125261 (+ 690us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.125305 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.125330 (+ 25us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:44.125858 (+ 528us) tablet.cc:701] Row locks acquired
0926 13:55:44.125876 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:44.126014 (+ 138us) write_op.cc:270] Start()
0926 13:55:44.126103 (+ 89us) write_op.cc:276] Timestamp: P: 1790430944125977 usec, L: 0
0926 13:55:44.126130 (+ 27us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.126644 (+ 514us) log.cc:844] Serialized 692 byte log entry
0926 13:55:44.142496 (+ 15852us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.549884 (+407388us) write_op.cc:301] APPLY: starting
0926 13:55:44.549946 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.550107 (+ 161us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.550184 (+ 77us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.551185 (+ 1001us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.551366 (+ 181us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.551419 (+ 53us) write_op.cc:312] APPLY: finished
0926 13:55:44.551615 (+ 196us) log.cc:844] Serialized 70 byte log entry
0926 13:55:44.557203 (+ 5588us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.557297 (+ 94us) write_op.cc:454] Released schema lock
0926 13:55:44.557337 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":5888,"child_traces":[["op",{"apply.queue_time_us":407250,"num_ops":9,"prepare.queue_time_us":1036778,"prepare.run_cpu_time_us":2800,"prepare.run_wall_time_us":2800,"replication_time_us":16241}]]}
I20260926 13:55:44.599133 10312 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=72, attempt_no=0}) took 1523 ms. Trace:
I20260926 13:55:44.599285 10354 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=87, attempt_no=0}) took 1483 ms. Trace:
I20260926 13:55:44.602051 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=85, attempt_no=0}) took 1503 ms. Trace:
I20260926 13:55:44.599709 10354 rpcz_store.cc:276] 0926 13:55:43.118937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.142334 (+ 23397us) service_pool.cc:224] Handling call
0926 13:55:44.599229 (+1456895us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.251829 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:44.252268 (+ 439us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.252297 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:44.252313 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:44.277032 (+ 24719us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.277081 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.277107 (+ 26us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:44.277631 (+ 524us) tablet.cc:701] Row locks acquired
0926 13:55:44.277646 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:44.277792 (+ 146us) write_op.cc:270] Start()
0926 13:55:44.277885 (+ 93us) write_op.cc:276] Timestamp: P: 1790430944277757 usec, L: 0
0926 13:55:44.277904 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.278428 (+ 524us) log.cc:844] Serialized 692 byte log entry
0926 13:55:44.295668 (+ 17240us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.595255 (+299587us) write_op.cc:301] APPLY: starting
0926 13:55:44.595312 (+ 57us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.596021 (+ 709us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.596098 (+ 77us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.597218 (+ 1120us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.597381 (+ 163us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.597415 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:44.598132 (+ 717us) log.cc:844] Serialized 70 byte log entry
0926 13:55:44.598779 (+ 647us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.598863 (+ 84us) write_op.cc:454] Released schema lock
0926 13:55:44.598900 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":299445,"num_ops":9,"prepare.queue_time_us":1027324,"prepare.run_cpu_time_us":2833,"prepare.run_wall_time_us":26831,"replication_time_us":17671,"spinlock_wait_cycles":85760}]]}
I20260926 13:55:44.602394 10356 rpcz_store.cc:276] 0926 13:55:43.101132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.102418 (+ 1286us) service_pool.cc:224] Handling call
0926 13:55:44.601998 (+1499580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.237412 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 523e7742341b4ca8a544a267c5395c42
0926 13:55:44.237853 (+ 441us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.237880 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:44.237892 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:44.238646 (+ 754us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.238688 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.238717 (+ 29us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:44.239519 (+ 802us) tablet.cc:701] Row locks acquired
0926 13:55:44.239535 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:44.239671 (+ 136us) write_op.cc:270] Start()
0926 13:55:44.239779 (+ 108us) write_op.cc:276] Timestamp: P: 1790430944239638 usec, L: 0
0926 13:55:44.239799 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.240325 (+ 526us) log.cc:844] Serialized 821 byte log entry
0926 13:55:44.312870 (+ 72545us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.596346 (+283476us) write_op.cc:301] APPLY: starting
0926 13:55:44.596406 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.596598 (+ 192us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.596674 (+ 76us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.598095 (+ 1421us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.598258 (+ 163us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.598293 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:44.598484 (+ 191us) log.cc:844] Serialized 88 byte log entry
0926 13:55:44.601640 (+ 3156us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.601733 (+ 93us) write_op.cc:454] Released schema lock
0926 13:55:44.601770 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":283327,"mutex_wait_us":2958,"num_ops":12,"prepare.queue_time_us":1127976,"prepare.run_cpu_time_us":3127,"prepare.run_wall_time_us":3126,"replication_time_us":72975}]]}
I20260926 13:55:44.608115 10356 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=86, attempt_no=0}) took 1488 ms. Trace:
I20260926 13:55:44.608433 10356 rpcz_store.cc:276] 0926 13:55:43.119631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.141996 (+ 22365us) service_pool.cc:224] Handling call
0926 13:55:44.608065 (+1466069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.240670 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 523e7742341b4ca8a544a267c5395c42
0926 13:55:44.254338 (+ 13668us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.254364 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:44.254376 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:44.255201 (+ 825us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.255244 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.255271 (+ 27us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:44.256191 (+ 920us) tablet.cc:701] Row locks acquired
0926 13:55:44.256207 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:44.256352 (+ 145us) write_op.cc:270] Start()
0926 13:55:44.256445 (+ 93us) write_op.cc:276] Timestamp: P: 1790430944256314 usec, L: 0
0926 13:55:44.256465 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.269061 (+ 12596us) log.cc:844] Serialized 950 byte log entry
0926 13:55:44.313102 (+ 44041us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.605255 (+292153us) write_op.cc:301] APPLY: starting
0926 13:55:44.605308 (+ 53us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.605516 (+ 208us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.605594 (+ 78us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.607120 (+ 1526us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.607289 (+ 169us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.607324 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:44.607550 (+ 226us) log.cc:844] Serialized 106 byte log entry
0926 13:55:44.607695 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.607800 (+ 105us) write_op.cc:454] Released schema lock
0926 13:55:44.607839 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":292027,"num_ops":15,"prepare.queue_time_us":1074656,"prepare.run_cpu_time_us":3431,"prepare.run_wall_time_us":29745,"replication_time_us":56557}]]}
I20260926 13:55:44.599520 10312 rpcz_store.cc:276] 0926 13:55:43.076139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.083418 (+ 7279us) service_pool.cc:224] Handling call
0926 13:55:44.599074 (+1515656us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.127010 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 523e7742341b4ca8a544a267c5395c42
0926 13:55:44.127455 (+ 445us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.127480 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:44.127495 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:44.128288 (+ 793us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.128328 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.128354 (+ 26us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:44.191813 (+ 63459us) tablet.cc:701] Row locks acquired
0926 13:55:44.191834 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:44.236015 (+ 44181us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:44.236111 (+ 96us) write_op.cc:270] Start()
0926 13:55:44.236282 (+ 171us) write_op.cc:276] Timestamp: P: 1790430944236072 usec, L: 0
0926 13:55:44.236304 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.236876 (+ 572us) log.cc:844] Serialized 907 byte log entry
0926 13:55:44.279701 (+ 42825us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.590378 (+310677us) write_op.cc:301] APPLY: starting
0926 13:55:44.590438 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.590646 (+ 208us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.590663 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.592267 (+ 1604us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.592457 (+ 190us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.592492 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:44.592712 (+ 220us) log.cc:844] Serialized 100 byte log entry
0926 13:55:44.598659 (+ 5947us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.598773 (+ 114us) write_op.cc:454] Released schema lock
0926 13:55:44.598817 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":310534,"num_ops":14,"prepare.queue_time_us":1036695,"prepare.run_cpu_time_us":4809,"prepare.run_wall_time_us":110232,"raft.queue_time_us":1095,"raft.run_cpu_time_us":1392,"raft.run_wall_time_us":1753,"replication_time_us":43301,"spinlock_wait_cycles":94384640}]]}
I20260926 13:55:44.612855 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=60, attempt_no=0}) took 1553 ms. Trace:
I20260926 13:55:44.614324 10352 rpcz_store.cc:276] 0926 13:55:43.069298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:43.078873 (+ 9575us) service_pool.cc:224] Handling call
0926 13:55:44.612679 (+1533806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:44.155866 (+ 0us) write_op.cc:183] PREPARE: starting on tablet f1e5c84225d648068b3f09943afc68fd
0926 13:55:44.156320 (+ 454us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:44.156345 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:44.156361 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:44.157127 (+ 766us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:44.157172 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:44.157198 (+ 26us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:44.158141 (+ 943us) tablet.cc:701] Row locks acquired
0926 13:55:44.158157 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:44.233648 (+ 75491us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:44.233752 (+ 104us) write_op.cc:270] Start()
0926 13:55:44.233921 (+ 169us) write_op.cc:276] Timestamp: P: 1790430944233716 usec, L: 0
0926 13:55:44.233956 (+ 35us) op_driver.cc:348] REPLICATION: starting
0926 13:55:44.234488 (+ 532us) log.cc:844] Serialized 1036 byte log entry
0926 13:55:44.266644 (+ 32156us) op_driver.cc:464] REPLICATION: finished
0926 13:55:44.580715 (+314071us) write_op.cc:301] APPLY: starting
0926 13:55:44.580813 (+ 98us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:44.581096 (+ 283us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:44.581116 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:44.583270 (+ 2154us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:44.610308 (+ 27038us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:44.610356 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:44.610832 (+ 476us) log.cc:844] Serialized 118 byte log entry
0926 13:55:44.611028 (+ 196us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:44.612345 (+ 1317us) write_op.cc:454] Released schema lock
0926 13:55:44.612423 (+ 78us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":313914,"num_ops":17,"prepare.queue_time_us":1064224,"prepare.run_cpu_time_us":5016,"prepare.run_wall_time_us":90072,"raft.queue_time_us":1015,"raft.run_cpu_time_us":1371,"raft.run_wall_time_us":1379,"replication_time_us":32573,"spinlock_wait_cycles":172243840}]]}
W20260926 13:55:44.996850 9954 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.131:35405, user_credentials={real_user=slave}} blocked reactor thread for 67600.4us
W20260926 13:55:45.137427 10320 log.cc:927] Time spent T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216: Append to log took a long time: real 0.093s user 0.000s sys 0.000s
W20260926 13:55:45.149192 10169 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.130:41257, user_credentials={real_user=slave}} blocked reactor thread for 55095.6us
W20260926 13:55:45.364903 10360 log.cc:927] Time spent T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
W20260926 13:55:45.844342 10169 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.130:41257, user_credentials={real_user=slave}} blocked reactor thread for 52322.9us
I20260926 13:55:45.965510 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=121, attempt_no=0}) took 1140 ms. Trace:
I20260926 13:55:45.966606 10344 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=115, attempt_no=0}) took 1236 ms. Trace:
I20260926 13:55:45.968379 10352 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:60730 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=122, attempt_no=0}) took 1140 ms. Trace:
I20260926 13:55:45.969002 10352 rpcz_store.cc:276] 0926 13:55:44.828218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:44.834736 (+ 6518us) service_pool.cc:224] Handling call
0926 13:55:45.040582 (+205846us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b3400126488. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:45.096343 (+ 55761us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b58001cef98. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7ea02 00007fdb0bcf9119 00007fdb0b812a70 00007fdb0b8db6db 00007fdb0b8db761 00007fdb0b89ab20 00007fdb0b886ca9 00007fdb0b884fa2 00007fdb09f87084
0926 13:55:45.968321 (+871978us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.708532 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 9ae0b96000a041c5b2805e677eacb595
0926 13:55:45.708982 (+ 450us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.709011 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:45.709027 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:45.709873 (+ 846us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.709916 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.709941 (+ 25us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:45.710808 (+ 867us) tablet.cc:701] Row locks acquired
0926 13:55:45.710827 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:45.710968 (+ 141us) write_op.cc:270] Start()
0926 13:55:45.711058 (+ 90us) write_op.cc:276] Timestamp: P: 1790430945710931 usec, L: 0
0926 13:55:45.711076 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.781955 (+ 70879us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b54000107a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:45.782518 (+ 563us) log.cc:844] Serialized 1002 byte log entry
0926 13:55:45.881384 (+ 98866us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b58006410d0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb097875c0 00007fdb0977796c 00007fdb0977e283 00007fdb0977e209 00007fdb0977e199 00007fdb0977e161 00007fdb0977d32d 000000000041fb94 000000000041f9d9 00007fdb02db63e5 00007fdb02db8751
0926 13:55:45.905930 (+ 24546us) op_driver.cc:464] REPLICATION: finished
0926 13:55:45.912877 (+ 6947us) write_op.cc:301] APPLY: starting
0926 13:55:45.912949 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:45.913170 (+ 221us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:45.913187 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:45.915037 (+ 1850us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:45.915222 (+ 185us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:45.915257 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:45.915487 (+ 230us) log.cc:844] Serialized 112 byte log entry
0926 13:55:45.962453 (+ 46966us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:45.962576 (+ 123us) write_op.cc:454] Released schema lock
0926 13:55:45.962624 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":12999680,"child_traces":[["op",{"apply.queue_time_us":6796,"num_ops":16,"prepare.queue_time_us":579048,"prepare.run_cpu_time_us":4992,"prepare.run_wall_time_us":74288,"raft.queue_time_us":9211,"raft.run_cpu_time_us":833,"raft.run_wall_time_us":74331,"replication_time_us":181067,"spinlock_wait_cycles":77318272}]]}
I20260926 13:55:45.965960 10331 rpcz_store.cc:276] 0926 13:55:44.825394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:44.828611 (+ 3217us) service_pool.cc:224] Handling call
0926 13:55:45.965440 (+1136829us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.559528 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:45.560054 (+ 526us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.560087 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:45.560102 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:45.601165 (+ 41063us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.601207 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.601234 (+ 27us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:45.602063 (+ 829us) tablet.cc:701] Row locks acquired
0926 13:55:45.602082 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:45.697832 (+ 95750us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:45.697943 (+ 111us) write_op.cc:270] Start()
0926 13:55:45.711283 (+ 13340us) write_op.cc:276] Timestamp: P: 1790430945697904 usec, L: 0
0926 13:55:45.711309 (+ 26us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.711895 (+ 586us) log.cc:844] Serialized 916 byte log entry
0926 13:55:45.856673 (+144778us) op_driver.cc:464] REPLICATION: finished
0926 13:55:45.898175 (+ 41502us) write_op.cc:301] APPLY: starting
0926 13:55:45.898234 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:45.898465 (+ 231us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:45.898483 (+ 18us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:45.899998 (+ 1515us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:45.900163 (+ 165us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:45.940465 (+ 40302us) write_op.cc:312] APPLY: finished
0926 13:55:45.940691 (+ 226us) log.cc:844] Serialized 100 byte log entry
0926 13:55:45.946371 (+ 5680us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:45.961301 (+ 14930us) write_op.cc:454] Released schema lock
0926 13:55:45.961355 (+ 54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":41349,"num_ops":14,"prepare.queue_time_us":729488,"prepare.run_cpu_time_us":5101,"prepare.run_wall_time_us":152745,"raft.queue_time_us":4008,"raft.run_cpu_time_us":1485,"raft.run_wall_time_us":3770,"replication_time_us":145270,"spinlock_wait_cycles":29154560}]]}
I20260926 13:55:45.967549 10344 rpcz_store.cc:276] 0926 13:55:44.730031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:44.733477 (+ 3446us) service_pool.cc:224] Handling call
0926 13:55:45.083187 (+349710us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b340000e128. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:45.966538 (+883351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.595132 (+ 0us) write_op.cc:183] PREPARE: starting on tablet de68f7f38cd24ca6a790bf0fdef2e2ee
0926 13:55:45.595571 (+ 439us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.595598 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:45.595612 (+ 14us) tablet.cc:662] Decoding operations
0926 13:55:45.596342 (+ 730us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.596386 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.596412 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:45.636860 (+ 40448us) tablet.cc:701] Row locks acquired
0926 13:55:45.640104 (+ 3244us) write_op.cc:260] PREPARE: finished
0926 13:55:45.686512 (+ 46408us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b340000e128. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:45.720896 (+ 34384us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b2c0007d648. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:45.720949 (+ 53us) write_op.cc:270] Start()
0926 13:55:45.721048 (+ 99us) write_op.cc:276] Timestamp: P: 1790430945698246 usec, L: 0
0926 13:55:45.721062 (+ 14us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.741443 (+ 20381us) log.cc:844] Serialized 830 byte log entry
0926 13:55:45.754007 (+ 12564us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54004349d4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:45.876208 (+122201us) op_driver.cc:464] REPLICATION: finished
0926 13:55:45.954316 (+ 78108us) write_op.cc:301] APPLY: starting
0926 13:55:45.954374 (+ 58us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:45.954557 (+ 183us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:45.954575 (+ 18us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:45.955883 (+ 1308us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:45.956054 (+ 171us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:45.956090 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:45.956286 (+ 196us) log.cc:844] Serialized 88 byte log entry
0926 13:55:45.956432 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:45.956523 (+ 91us) write_op.cc:454] Released schema lock
0926 13:55:45.956561 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":32100096,"child_traces":[["op",{"apply.queue_time_us":77954,"mutex_wait_us":36993,"num_ops":12,"prepare.queue_time_us":499138,"prepare.run_cpu_time_us":6085,"prepare.run_wall_time_us":169274,"replication_time_us":155038,"spinlock_wait_cycles":101956224}]]}
W20260926 13:55:46.012066 9954 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.130:41257, user_credentials={real_user=slave}} blocked reactor thread for 106473us
I20260926 13:55:46.079844 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=125, attempt_no=0}) took 1234 ms. Trace:
I20260926 13:55:46.082069 10331 rpcz_store.cc:276] 0926 13:55:44.862835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:44.865707 (+ 2872us) service_pool.cc:224] Handling call
0926 13:55:46.079787 (+1214080us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.640059 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:45.666488 (+ 26429us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.666514 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:45.666526 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:45.667306 (+ 780us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.667350 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.667376 (+ 26us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:45.668155 (+ 779us) tablet.cc:701] Row locks acquired
0926 13:55:45.668174 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:45.693632 (+ 25458us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:45.693739 (+ 107us) write_op.cc:270] Start()
0926 13:55:45.693920 (+ 181us) write_op.cc:276] Timestamp: P: 1790430945693702 usec, L: 0
0926 13:55:45.693942 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.694485 (+ 543us) log.cc:844] Serialized 873 byte log entry
0926 13:55:45.951986 (+257501us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.074302 (+122316us) write_op.cc:301] APPLY: starting
0926 13:55:46.074362 (+ 60us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.076613 (+ 2251us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.076632 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.078266 (+ 1634us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.078439 (+ 173us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.078475 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:46.078674 (+ 199us) log.cc:844] Serialized 94 byte log entry
0926 13:55:46.079417 (+ 743us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.079516 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:46.079553 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":122156,"mutex_wait_us":19186,"num_ops":13,"prepare.queue_time_us":622375,"prepare.run_cpu_time_us":3994,"prepare.run_wall_time_us":81370,"replication_time_us":257946,"spinlock_wait_cycles":57260928}]]}
I20260926 13:55:46.143167 10390 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=129, attempt_no=0}) took 1236 ms. Trace:
I20260926 13:55:46.143567 10390 rpcz_store.cc:276] 0926 13:55:44.926888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:44.927397 (+ 509us) service_pool.cc:224] Handling call
0926 13:55:45.106204 (+178807us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:46.143106 (+1036902us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.848947 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:45.849368 (+ 421us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.849395 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:45.849408 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:45.850295 (+ 887us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.850341 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.850375 (+ 34us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:45.853391 (+ 3016us) tablet.cc:701] Row locks acquired
0926 13:55:45.853407 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:45.933166 (+ 79759us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:45.933264 (+ 98us) write_op.cc:270] Start()
0926 13:55:45.933446 (+ 182us) write_op.cc:276] Timestamp: P: 1790430945933225 usec, L: 0
0926 13:55:45.933470 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.933993 (+ 523us) log.cc:844] Serialized 1003 byte log entry
0926 13:55:45.984938 (+ 50945us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.114595 (+129657us) write_op.cc:301] APPLY: starting
0926 13:55:46.114667 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.114937 (+ 270us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.114956 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.142062 (+ 27106us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.142266 (+ 204us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.142304 (+ 38us) write_op.cc:312] APPLY: finished
0926 13:55:46.142516 (+ 212us) log.cc:844] Serialized 112 byte log entry
0926 13:55:46.142683 (+ 167us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.142802 (+ 119us) write_op.cc:454] Released schema lock
0926 13:55:46.142848 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":77343488,"child_traces":[["op",{"apply.queue_time_us":129485,"mutex_wait_us":52802,"num_ops":16,"prepare.queue_time_us":741655,"prepare.run_cpu_time_us":4494,"prepare.run_wall_time_us":85278,"replication_time_us":51361,"spinlock_wait_cycles":64611200}]]}
W20260926 13:55:46.199400 10103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.130:41257, user_credentials={real_user=slave}} blocked reactor thread for 110885us
I20260926 13:55:46.202903 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=153, attempt_no=0}) took 1137 ms. Trace:
I20260926 13:55:46.203341 10331 rpcz_store.cc:276] 0926 13:55:45.065237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.068154 (+ 2917us) service_pool.cc:224] Handling call
0926 13:55:46.202236 (+1134082us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.785918 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:45.832675 (+ 46757us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.832705 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:45.832720 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:45.833798 (+ 1078us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.833837 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.852717 (+ 18880us) tablet.cc:685] Acquiring locks for 19 operations
0926 13:55:45.875195 (+ 22478us) tablet.cc:701] Row locks acquired
0926 13:55:45.875212 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:45.909369 (+ 34157us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:45.909479 (+ 110us) write_op.cc:270] Start()
0926 13:55:45.909652 (+ 173us) write_op.cc:276] Timestamp: P: 1790430945909442 usec, L: 0
0926 13:55:45.909675 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.910203 (+ 528us) log.cc:844] Serialized 1132 byte log entry
0926 13:55:46.065659 (+155456us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.161440 (+ 95781us) write_op.cc:301] APPLY: starting
0926 13:55:46.161503 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.161767 (+ 264us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.161784 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.163886 (+ 2102us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.164072 (+ 186us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.164110 (+ 38us) write_op.cc:312] APPLY: finished
0926 13:55:46.164353 (+ 243us) log.cc:844] Serialized 131 byte log entry
0926 13:55:46.201844 (+ 37491us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.201961 (+ 117us) write_op.cc:454] Released schema lock
0926 13:55:46.202005 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":95612,"mutex_wait_us":58308,"num_ops":19,"prepare.queue_time_us":664840,"prepare.run_cpu_time_us":4958,"prepare.run_wall_time_us":142510,"replication_time_us":155886,"spinlock_wait_cycles":16530176}]]}
I20260926 13:55:46.226804 10391 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=137, attempt_no=0}) took 1230 ms. Trace:
I20260926 13:55:46.227291 10391 rpcz_store.cc:276] 0926 13:55:44.996405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.041517 (+ 45112us) service_pool.cc:224] Handling call
0926 13:55:46.226729 (+1185212us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.721068 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:45.721488 (+ 420us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.721520 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:45.721532 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:45.722287 (+ 755us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.722330 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.722355 (+ 25us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:45.723073 (+ 718us) tablet.cc:701] Row locks acquired
0926 13:55:45.723111 (+ 38us) write_op.cc:260] PREPARE: finished
0926 13:55:45.723247 (+ 136us) write_op.cc:270] Start()
0926 13:55:45.723331 (+ 84us) write_op.cc:276] Timestamp: P: 1790430945723212 usec, L: 0
0926 13:55:45.723346 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.724490 (+ 1144us) log.cc:844] Serialized 831 byte log entry
0926 13:55:45.952244 (+227754us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.111044 (+158800us) write_op.cc:301] APPLY: starting
0926 13:55:46.125596 (+ 14552us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.150329 (+ 24733us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.150418 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.152054 (+ 1636us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.152263 (+ 209us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.152312 (+ 49us) write_op.cc:312] APPLY: finished
0926 13:55:46.152552 (+ 240us) log.cc:844] Serialized 88 byte log entry
0926 13:55:46.171736 (+ 19184us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.210936 (+ 39200us) write_op.cc:454] Released schema lock
0926 13:55:46.214396 (+ 3460us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":154692,"mutex_wait_us":13002,"num_ops":12,"prepare.queue_time_us":664120,"prepare.run_cpu_time_us":3298,"prepare.run_wall_time_us":12424,"replication_time_us":228812}]]}
I20260926 13:55:46.268292 10322 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=161, attempt_no=0}) took 1198 ms. Trace:
I20260926 13:55:46.268791 10322 rpcz_store.cc:276] 0926 13:55:45.069838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.092702 (+ 22864us) service_pool.cc:224] Handling call
0926 13:55:46.268237 (+1175535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.797100 (+ 0us) write_op.cc:183] PREPARE: starting on tablet de68f7f38cd24ca6a790bf0fdef2e2ee
0926 13:55:45.797469 (+ 369us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.797493 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:45.797506 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:45.800846 (+ 3340us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.800886 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.800910 (+ 24us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:45.801416 (+ 506us) tablet.cc:701] Row locks acquired
0926 13:55:45.801431 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:45.856793 (+ 55362us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b2c0007d648. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:45.856842 (+ 49us) write_op.cc:270] Start()
0926 13:55:45.857007 (+ 165us) write_op.cc:276] Timestamp: P: 1790430945827842 usec, L: 0
0926 13:55:45.857028 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.978457 (+121429us) log.cc:844] Serialized 788 byte log entry
0926 13:55:45.979391 (+ 934us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54004349d4. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:46.244038 (+264647us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.265504 (+ 21466us) write_op.cc:301] APPLY: starting
0926 13:55:46.265566 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.265739 (+ 173us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.265756 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.267240 (+ 1484us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.267479 (+ 239us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.267516 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:46.267715 (+ 199us) log.cc:844] Serialized 82 byte log entry
0926 13:55:46.267881 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.267970 (+ 89us) write_op.cc:454] Released schema lock
0926 13:55:46.268006 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":21315,"mutex_wait_us":71946,"num_ops":11,"prepare.queue_time_us":701330,"prepare.run_cpu_time_us":6334,"prepare.run_wall_time_us":182426,"replication_time_us":386913,"spinlock_wait_cycles":326154368}]]}
I20260926 13:55:46.275202 10343 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=169, attempt_no=0}) took 1080 ms. Trace:
I20260926 13:55:46.275550 10343 rpcz_store.cc:276] 0926 13:55:45.198786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.201395 (+ 2609us) service_pool.cc:224] Handling call
0926 13:55:46.275149 (+1073754us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.994538 (+ 0us) write_op.cc:183] PREPARE: starting on tablet de68f7f38cd24ca6a790bf0fdef2e2ee
0926 13:55:45.994890 (+ 352us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.994915 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:45.994928 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:46.002752 (+ 7824us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:46.002801 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:46.002826 (+ 25us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:46.003581 (+ 755us) tablet.cc:701] Row locks acquired
0926 13:55:46.003596 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:46.014537 (+ 10941us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b2c0007d648. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:46.014580 (+ 43us) write_op.cc:270] Start()
0926 13:55:46.019381 (+ 4801us) write_op.cc:276] Timestamp: P: 1790430946012646 usec, L: 0
0926 13:55:46.019405 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:46.021272 (+ 1867us) log.cc:844] Serialized 1046 byte log entry
0926 13:55:46.244280 (+223008us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.271420 (+ 27140us) write_op.cc:301] APPLY: starting
0926 13:55:46.271482 (+ 62us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.271716 (+ 234us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.271733 (+ 17us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.273646 (+ 1913us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.273835 (+ 189us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.273873 (+ 38us) write_op.cc:312] APPLY: finished
0926 13:55:46.274103 (+ 230us) log.cc:844] Serialized 118 byte log entry
0926 13:55:46.274758 (+ 655us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.274868 (+ 110us) write_op.cc:454] Released schema lock
0926 13:55:46.274908 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":26643,"num_ops":17,"prepare.queue_time_us":780738,"prepare.run_cpu_time_us":7134,"prepare.run_wall_time_us":26941,"replication_time_us":224790,"spinlock_wait_cycles":10935936}]]}
I20260926 13:55:46.283131 10322 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:33890 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=170, attempt_no=0}) took 1049 ms. Trace:
I20260926 13:55:46.283545 10322 rpcz_store.cc:276] 0926 13:55:45.228629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.238061 (+ 9432us) service_pool.cc:224] Handling call
0926 13:55:46.277910 (+1039849us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:46.021596 (+ 0us) write_op.cc:183] PREPARE: starting on tablet de68f7f38cd24ca6a790bf0fdef2e2ee
0926 13:55:46.021968 (+ 372us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:46.021991 (+ 23us) write_op.cc:435] Acquired schema lock
0926 13:55:46.022004 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:46.022638 (+ 634us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:46.022675 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:46.022697 (+ 22us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:46.023313 (+ 616us) tablet.cc:701] Row locks acquired
0926 13:55:46.023328 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:46.023447 (+ 119us) write_op.cc:270] Start()
0926 13:55:46.023529 (+ 82us) write_op.cc:276] Timestamp: P: 1790430946023414 usec, L: 0
0926 13:55:46.023544 (+ 15us) op_driver.cc:348] REPLICATION: starting
0926 13:55:46.024006 (+ 462us) log.cc:844] Serialized 874 byte log entry
0926 13:55:46.244500 (+220494us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.273426 (+ 28926us) write_op.cc:301] APPLY: starting
0926 13:55:46.273482 (+ 56us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.273672 (+ 190us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.273750 (+ 78us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.275212 (+ 1462us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.275374 (+ 162us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.275410 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:46.276892 (+ 1482us) log.cc:844] Serialized 94 byte log entry
0926 13:55:46.277524 (+ 632us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.277619 (+ 95us) write_op.cc:454] Released schema lock
0926 13:55:46.277655 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":28795,"num_ops":13,"prepare.queue_time_us":765513,"prepare.run_cpu_time_us":2585,"prepare.run_wall_time_us":2584,"replication_time_us":220869}]]}
I20260926 13:55:46.288472 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=164, attempt_no=0}) took 1183 ms. Trace:
I20260926 13:55:46.288847 10331 rpcz_store.cc:276] 0926 13:55:45.105027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.118352 (+ 13325us) service_pool.cc:224] Handling call
0926 13:55:46.288421 (+1170069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.912651 (+ 0us) write_op.cc:183] PREPARE: starting on tablet c914e93a086e481b94f4bed906ebfa4a
0926 13:55:46.019371 (+106720us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:46.021909 (+ 2538us) write_op.cc:435] Acquired schema lock
0926 13:55:46.021927 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:46.022682 (+ 755us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:46.022727 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:46.022752 (+ 25us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:46.023343 (+ 591us) tablet.cc:701] Row locks acquired
0926 13:55:46.023361 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:46.023513 (+ 152us) write_op.cc:270] Start()
0926 13:55:46.023607 (+ 94us) write_op.cc:276] Timestamp: P: 1790430946023467 usec, L: 0
0926 13:55:46.023627 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:46.024209 (+ 582us) log.cc:844] Serialized 788 byte log entry
0926 13:55:46.085885 (+ 61676us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.213249 (+127364us) write_op.cc:301] APPLY: starting
0926 13:55:46.213300 (+ 51us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.213469 (+ 169us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.213543 (+ 74us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.257026 (+ 43483us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.257249 (+ 223us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.257286 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:46.257485 (+ 199us) log.cc:844] Serialized 82 byte log entry
0926 13:55:46.257632 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.257731 (+ 99us) write_op.cc:454] Released schema lock
0926 13:55:46.257780 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:46.287823 (+ 30043us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":127216,"mutex_wait_us":78186,"num_ops":11,"prepare.queue_time_us":792916,"prepare.run_cpu_time_us":3245,"prepare.run_wall_time_us":111805,"replication_time_us":62151,"spinlock_wait_cycles":67679104}]]}
I20260926 13:55:46.296960 10391 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=152, attempt_no=0}) took 1253 ms. Trace:
I20260926 13:55:46.297454 10391 rpcz_store.cc:276] 0926 13:55:45.064875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.093229 (+ 28354us) service_pool.cc:224] Handling call
0926 13:55:46.296897 (+1203668us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.934369 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:45.934797 (+ 428us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:45.934826 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:45.934839 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:45.935546 (+ 707us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:45.935584 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:45.935608 (+ 24us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:45.936596 (+ 988us) tablet.cc:701] Row locks acquired
0926 13:55:45.936613 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:45.990161 (+ 53548us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:45.990254 (+ 93us) write_op.cc:270] Start()
0926 13:55:45.990426 (+ 172us) write_op.cc:276] Timestamp: P: 1790430945990220 usec, L: 0
0926 13:55:45.990449 (+ 23us) op_driver.cc:348] REPLICATION: starting
0926 13:55:45.990967 (+ 518us) log.cc:844] Serialized 788 byte log entry
0926 13:55:46.216906 (+225939us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.284328 (+ 67422us) write_op.cc:301] APPLY: starting
0926 13:55:46.284409 (+ 81us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.284861 (+ 452us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.284880 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.286417 (+ 1537us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.286683 (+ 266us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.286725 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:46.294871 (+ 8146us) log.cc:844] Serialized 82 byte log entry
0926 13:55:46.296215 (+ 1344us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.296388 (+ 173us) write_op.cc:454] Released schema lock
0926 13:55:46.296462 (+ 74us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":67263,"mutex_wait_us":91719,"num_ops":11,"prepare.queue_time_us":826629,"prepare.run_cpu_time_us":4249,"prepare.run_wall_time_us":56835,"replication_time_us":226357,"spinlock_wait_cycles":121988992}]]}
I20260926 13:55:46.310789 10390 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=174, attempt_no=0}) took 1087 ms. Trace:
I20260926 13:55:46.324323 10331 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:46664 (ReqId={client: 02691ffeb3e549889cf58c29dc73d48d, seq_no=193, attempt_no=0}) took 1001 ms. Trace:
I20260926 13:55:46.324806 10390 rpcz_store.cc:276] 0926 13:55:45.223616 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.223769 (+ 153us) service_pool.cc:224] Handling call
0926 13:55:46.310721 (+1086952us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:45.991328 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:46.020870 (+ 29542us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:46.020907 (+ 37us) write_op.cc:435] Acquired schema lock
0926 13:55:46.020926 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:46.021705 (+ 779us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:46.021748 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:46.021792 (+ 44us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:46.022582 (+ 790us) tablet.cc:701] Row locks acquired
0926 13:55:46.022598 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:46.084292 (+ 61694us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b3400057808. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:46.084391 (+ 99us) write_op.cc:270] Start()
0926 13:55:46.084569 (+ 178us) write_op.cc:276] Timestamp: P: 1790430946084352 usec, L: 0
0926 13:55:46.084591 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:46.088943 (+ 4352us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b540009d6a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:46.089495 (+ 552us) log.cc:844] Serialized 874 byte log entry
0926 13:55:46.262025 (+172530us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.305987 (+ 43962us) write_op.cc:301] APPLY: starting
0926 13:55:46.306050 (+ 63us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.306288 (+ 238us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.306309 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.309587 (+ 3278us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.309798 (+ 211us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.309844 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:46.310121 (+ 277us) log.cc:844] Serialized 94 byte log entry
0926 13:55:46.310300 (+ 179us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.310404 (+ 104us) write_op.cc:454] Released schema lock
0926 13:55:46.310450 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":43809,"num_ops":13,"prepare.queue_time_us":766031,"prepare.run_cpu_time_us":5013,"prepare.run_wall_time_us":98389,"replication_time_us":177334,"spinlock_wait_cycles":15708800}]]}
I20260926 13:55:46.324878 10331 rpcz_store.cc:276] 0926 13:55:45.360565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:45.362548 (+ 1983us) service_pool.cc:224] Handling call
0926 13:55:46.324257 (+961709us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:46.089863 (+ 0us) write_op.cc:183] PREPARE: starting on tablet e5fe5d563d764533891c35615cf01b45
0926 13:55:46.090316 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:46.090343 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:46.090361 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:46.091284 (+ 923us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:46.091334 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:46.091360 (+ 26us) tablet.cc:685] Acquiring locks for 17 operations
0926 13:55:46.092293 (+ 933us) tablet.cc:701] Row locks acquired
0926 13:55:46.092311 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:46.092457 (+ 146us) write_op.cc:270] Start()
0926 13:55:46.092555 (+ 98us) write_op.cc:276] Timestamp: P: 1790430946092415 usec, L: 0
0926 13:55:46.092571 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:46.169250 (+ 76679us) log.cc:844] Serialized 1046 byte log entry
0926 13:55:46.263244 (+ 93994us) op_driver.cc:464] REPLICATION: finished
0926 13:55:46.315204 (+ 51960us) write_op.cc:301] APPLY: starting
0926 13:55:46.315263 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:46.315549 (+ 286us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:46.315628 (+ 79us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:46.319249 (+ 3621us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:46.319436 (+ 187us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:46.319470 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:46.319692 (+ 222us) log.cc:844] Serialized 118 byte log entry
0926 13:55:46.323641 (+ 3949us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:46.323977 (+ 336us) write_op.cc:454] Released schema lock
0926 13:55:46.324020 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":51829,"mutex_wait_us":3515,"num_ops":17,"prepare.queue_time_us":718789,"prepare.run_cpu_time_us":9987,"prepare.run_wall_time_us":139214,"raft.queue_time_us":17119,"raft.run_cpu_time_us":718,"raft.run_wall_time_us":717,"replication_time_us":170576,"spinlock_wait_cycles":186240}]]}
I20260926 13:55:46.567200 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:46.590341 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:46.591045 3582 tablet_replica.cc:333] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.591828 3582 raft_consensus.cc:2243] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.592599 3582 raft_consensus.cc:2272] T 6918359cdac249d28234d5119e4093df P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:46.595796 10027 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260926 13:55:46.596217 3582 tablet_replica.cc:333] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.596902 3582 raft_consensus.cc:2243] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.597390 3582 raft_consensus.cc:2272] T e5fe5d563d764533891c35615cf01b45 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:46.598620 10027 consensus_peers.cc:597] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 -> Peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Couldn't send request to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:46.599785 3582 tablet_replica.cc:333] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.600282 3582 raft_consensus.cc:2243] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.600808 3582 raft_consensus.cc:2272] T 9ae0b96000a041c5b2805e677eacb595 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.603108 3582 tablet_replica.cc:333] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.603585 3582 raft_consensus.cc:2243] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.604140 3582 raft_consensus.cc:2272] T 523e7742341b4ca8a544a267c5395c42 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.606256 3582 tablet_replica.cc:333] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.606698 3582 raft_consensus.cc:2243] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.607223 3582 raft_consensus.cc:2272] T 6155ca469bbe44b5aa53b1187d8b2275 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.609439 3582 tablet_replica.cc:333] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.609902 3582 raft_consensus.cc:2243] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.610615 3582 raft_consensus.cc:2272] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.612901 3582 tablet_replica.cc:333] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.613363 3582 raft_consensus.cc:2243] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.613863 3582 raft_consensus.cc:2272] T f1955e4b3c9e48b0b2f0e17785af7393 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.616016 3582 tablet_replica.cc:333] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.616463 3582 raft_consensus.cc:2243] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.617079 3582 raft_consensus.cc:2272] T f1e5c84225d648068b3f09943afc68fd P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.619434 3582 tablet_replica.cc:333] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.619897 3582 raft_consensus.cc:2243] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.620638 3582 raft_consensus.cc:2272] T e4f583082bc049b4ae9a7c2220868f51 P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.622920 3582 tablet_replica.cc:333] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6: stopping tablet replica
I20260926 13:55:46.623323 3582 raft_consensus.cc:2243] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.623827 3582 raft_consensus.cc:2272] T c914e93a086e481b94f4bed906ebfa4a P 1ab9fbd9150c4c3ba9f1b2b987535aa6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.649612 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:46.671674 3582 tablet_server.cc:179] TabletServer@127.3.127.130:0 shutting down...
W20260926 13:55:46.674525 10101 consensus_peers.cc:597] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e -> Peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Couldn't send request to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:40541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:46.692974 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:46.693670 3582 tablet_replica.cc:333] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.694360 3582 raft_consensus.cc:2243] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.695044 3582 raft_consensus.cc:2272] T e4f583082bc049b4ae9a7c2220868f51 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.697597 3582 tablet_replica.cc:333] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.698052 3582 raft_consensus.cc:2243] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.698515 3582 raft_consensus.cc:2272] T c914e93a086e481b94f4bed906ebfa4a P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.700893 3582 tablet_replica.cc:333] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.701342 3582 raft_consensus.cc:2243] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.701874 3582 raft_consensus.cc:2272] T de68f7f38cd24ca6a790bf0fdef2e2ee P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.704165 3582 tablet_replica.cc:333] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.704591 3582 raft_consensus.cc:2243] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.705080 3582 raft_consensus.cc:2272] T 6918359cdac249d28234d5119e4093df P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.707360 3582 tablet_replica.cc:333] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.707782 3582 raft_consensus.cc:2243] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.708374 3582 raft_consensus.cc:2272] T 9ae0b96000a041c5b2805e677eacb595 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.710561 3582 tablet_replica.cc:333] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.710990 3582 raft_consensus.cc:2243] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 2 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.711576 3582 raft_consensus.cc:2272] T 523e7742341b4ca8a544a267c5395c42 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.713647 3582 tablet_replica.cc:333] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.714062 3582 raft_consensus.cc:2243] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.714461 3582 raft_consensus.cc:2272] T e5fe5d563d764533891c35615cf01b45 P 1d63c29c36a149a3b182bb644a756216 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.716462 3582 tablet_replica.cc:333] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.716917 3582 raft_consensus.cc:2243] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.717535 3582 raft_consensus.cc:2272] T f1955e4b3c9e48b0b2f0e17785af7393 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.719606 3582 tablet_replica.cc:333] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.720023 3582 raft_consensus.cc:2243] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.720620 3582 raft_consensus.cc:2272] T f1e5c84225d648068b3f09943afc68fd P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.722749 3582 tablet_replica.cc:333] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216: stopping tablet replica
I20260926 13:55:46.723125 3582 raft_consensus.cc:2243] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.723691 3582 raft_consensus.cc:2272] T 6155ca469bbe44b5aa53b1187d8b2275 P 1d63c29c36a149a3b182bb644a756216 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:46.741454 10103 consensus_peers.cc:597] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e -> Peer 1d63c29c36a149a3b182bb644a756216 (127.3.127.130:41257): Couldn't send request to peer 1d63c29c36a149a3b182bb644a756216. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.130:41257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:46.754372 3582 tablet_server.cc:196] TabletServer@127.3.127.130:0 shutdown complete.
W20260926 13:55:46.764772 10101 consensus_peers.cc:597] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e -> Peer 1ab9fbd9150c4c3ba9f1b2b987535aa6 (127.3.127.129:40541): Couldn't send request to peer 1ab9fbd9150c4c3ba9f1b2b987535aa6. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:40541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:46.779965 3582 tablet_server.cc:179] TabletServer@127.3.127.131:0 shutting down...
I20260926 13:55:46.800909 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:46.801586 3582 tablet_replica.cc:333] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.802203 3582 raft_consensus.cc:2243] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.802937 3582 raft_consensus.cc:2272] T 6155ca469bbe44b5aa53b1187d8b2275 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.805433 3582 tablet_replica.cc:333] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.805913 3582 raft_consensus.cc:2243] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.806490 3582 raft_consensus.cc:2272] T de68f7f38cd24ca6a790bf0fdef2e2ee P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.808692 3582 tablet_replica.cc:333] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.809221 3582 raft_consensus.cc:2243] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.809705 3582 raft_consensus.cc:2272] T 6918359cdac249d28234d5119e4093df P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.811867 3582 tablet_replica.cc:333] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.812414 3582 raft_consensus.cc:2243] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.812978 3582 raft_consensus.cc:2272] T e4f583082bc049b4ae9a7c2220868f51 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.815208 3582 tablet_replica.cc:333] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.815659 3582 raft_consensus.cc:2243] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.816344 3582 raft_consensus.cc:2272] T c914e93a086e481b94f4bed906ebfa4a P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.818542 3582 tablet_replica.cc:333] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.819020 3582 raft_consensus.cc:2243] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.819543 3582 raft_consensus.cc:2272] T 9ae0b96000a041c5b2805e677eacb595 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.821854 3582 tablet_replica.cc:333] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.822296 3582 raft_consensus.cc:2243] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.822974 3582 raft_consensus.cc:2272] T 523e7742341b4ca8a544a267c5395c42 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.825193 3582 tablet_replica.cc:333] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.825644 3582 raft_consensus.cc:2243] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.826385 3582 raft_consensus.cc:2272] T e5fe5d563d764533891c35615cf01b45 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.828375 3582 tablet_replica.cc:333] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.828824 3582 raft_consensus.cc:2243] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.829440 3582 raft_consensus.cc:2272] T f1e5c84225d648068b3f09943afc68fd P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.831650 3582 tablet_replica.cc:333] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e: stopping tablet replica
I20260926 13:55:46.832050 3582 raft_consensus.cc:2243] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:46.832605 3582 raft_consensus.cc:2272] T f1955e4b3c9e48b0b2f0e17785af7393 P 4e0a32adc7734ac2bd3fedddfd8fa72e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.859802 3582 tablet_server.cc:196] TabletServer@127.3.127.131:0 shutdown complete.
I20260926 13:55:46.881109 3582 master.cc:562] Master@127.3.127.190:42917 shutting down...
I20260926 13:55:46.897289 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 2 LEADER]: Raft consensus shutting down.
I20260926 13:55:46.897701 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9ea95e465eea4cc4964d03e87a40a20f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:46.897964 3582 tablet_replica.cc:333] stopping tablet replica
I20260926 13:55:46.917263 3582 master.cc:584] Master@127.3.127.190:42917 shutdown complete.
[ OK ] PickServer/ReplicaSelectionTest.ReplicaSelection/1 (8330 ms)
[ RUN ] PickServer/ReplicaSelectionTest.ReplicaSelection/2
I20260926 13:55:46.952704 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:43263
I20260926 13:55:46.953789 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:46.959144 10423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:46.959213 10422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:46.959781 10425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:46.960359 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:46.961103 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:46.961272 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:46.961385 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430946961375 us; error 0 us; skew 500 ppm
I20260926 13:55:46.961787 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:46.963847 3582 webserver.cc:533] Webserver started at http://127.3.127.190:44237/ using document root <none> and password file <none>
I20260926 13:55:46.964223 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:46.964361 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:46.964555 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:46.965539 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root/instance:
uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4"
format_stamp: "Formatted at 2026-09-26 13:55:46 on dist-test-slave-fk7n"
I20260926 13:55:46.969687 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260926 13:55:46.972834 10430 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:46.973470 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:46.973709 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4"
format_stamp: "Formatted at 2026-09-26 13:55:46 on dist-test-slave-fk7n"
I20260926 13:55:46.973953 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:46.982906 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:46.983901 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:47.019380 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:43263
I20260926 13:55:47.019483 10481 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:43263 every 8 connection(s)
I20260926 13:55:47.022874 10482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.032373 10482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: Bootstrap starting.
I20260926 13:55:47.036949 10482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:47.040688 10482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: No bootstrap required, opened a new log
I20260926 13:55:47.042630 10482 raft_consensus.cc:359] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.042969 10482 raft_consensus.cc:385] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:47.043145 10482 raft_consensus.cc:740] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3594ecd5eb24a74ba9b8aea7183f0b4, State: Initialized, Role: FOLLOWER
I20260926 13:55:47.043597 10482 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.043989 10482 raft_consensus.cc:399] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:47.044165 10482 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:47.044377 10482 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:47.048328 10482 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.048774 10482 leader_election.cc:304] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3594ecd5eb24a74ba9b8aea7183f0b4; no voters:
I20260926 13:55:47.049739 10482 leader_election.cc:290] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260926 13:55:47.050078 10485 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:47.051206 10485 raft_consensus.cc:697] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 LEADER]: Becoming Leader. State: Replica: f3594ecd5eb24a74ba9b8aea7183f0b4, State: Running, Role: LEADER
I20260926 13:55:47.051815 10485 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.052378 10482 sys_catalog.cc:565] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:47.055516 10486 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER } }
I20260926 13:55:47.055691 10487 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3594ecd5eb24a74ba9b8aea7183f0b4. Latest consensus state: current_term: 1 leader_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER } }
I20260926 13:55:47.056123 10486 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:47.056370 10487 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:47.059132 10491 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:47.065817 10491 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:47.067734 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:47.075429 10491 catalog_manager.cc:1396] Generated new cluster ID: 0a0fb96deffc458384097ac02afadbae
I20260926 13:55:47.075776 10491 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:47.100476 10491 catalog_manager.cc:1419] Generated new certificate authority record
I20260926 13:55:47.101608 10491 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:47.119056 10491 catalog_manager.cc:6219] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: Generated new TSK 0
I20260926 13:55:47.119522 10491 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:47.133476 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:47.138751 10503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.139496 10504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.140836 10506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:47.141824 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:47.142647 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:47.142845 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:47.142993 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430947142978 us; error 0 us; skew 500 ppm
I20260926 13:55:47.143482 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:47.145519 3582 webserver.cc:533] Webserver started at http://127.3.127.129:40815/ using document root <none> and password file <none>
I20260926 13:55:47.145937 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:47.146102 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:47.146329 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:47.147565 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root/instance:
uuid: "f920959ad42f4f37a2c310cf272d4012"
format_stamp: "Formatted at 2026-09-26 13:55:47 on dist-test-slave-fk7n"
I20260926 13:55:47.151746 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260926 13:55:47.154860 10511 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.155565 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260926 13:55:47.155812 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "f920959ad42f4f37a2c310cf272d4012"
format_stamp: "Formatted at 2026-09-26 13:55:47 on dist-test-slave-fk7n"
I20260926 13:55:47.156078 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:47.211377 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:47.212524 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:47.213939 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:47.216040 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:47.216233 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.216445 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:47.216588 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.252899 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:41651
I20260926 13:55:47.253006 10573 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:41651 every 8 connection(s)
I20260926 13:55:47.266644 10574 heartbeater.cc:344] Connected to a master server at 127.3.127.190:43263
I20260926 13:55:47.266999 10574 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:47.267643 10574 heartbeater.cc:507] Master 127.3.127.190:43263 requested a full tablet report, sending...
I20260926 13:55:47.269496 10447 ts_manager.cc:194] Registered new tserver with Master: f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:41651)
I20260926 13:55:47.270205 3582 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.01424521s
I20260926 13:55:47.271099 10447 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49518
I20260926 13:55:47.287885 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
I20260926 13:55:47.307555 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:47.323829 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
I20260926 13:55:47.330247 3582 master.cc:562] Master@127.3.127.190:43263 shutting down...
I20260926 13:55:47.344060 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:47.344507 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:47.344949 3582 tablet_replica.cc:333] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: stopping tablet replica
I20260926 13:55:47.362342 3582 master.cc:584] Master@127.3.127.190:43263 shutdown complete.
I20260926 13:55:47.372208 3582 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.127.190:39363
I20260926 13:55:47.373397 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:47.377395 10584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.378556 10585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.379379 10587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:47.379539 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:47.380359 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:47.380520 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:47.380626 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430947380616 us; error 0 us; skew 500 ppm
I20260926 13:55:47.381093 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:47.382990 3582 webserver.cc:533] Webserver started at http://127.3.127.190:37963/ using document root <none> and password file <none>
I20260926 13:55:47.383356 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:47.383483 3582 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260926 13:55:47.386516 3582 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260926 13:55:47.388839 10592 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.389480 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:47.389731 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root
uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4"
format_stamp: "Formatted at 2026-09-26 13:55:46 on dist-test-slave-fk7n"
I20260926 13:55:47.389972 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:47.411981 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:47.412868 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:47.444541 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.190:39363
I20260926 13:55:47.444630 10643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.190:39363 every 8 connection(s)
I20260926 13:55:47.452256 10644 sys_catalog.cc:263] Verifying existing consensus state
I20260926 13:55:47.456095 10644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: Bootstrap starting.
I20260926 13:55:47.474344 10644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260926 13:55:47.475013 10644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: Bootstrap complete.
I20260926 13:55:47.476970 10644 raft_consensus.cc:359] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.477314 10644 raft_consensus.cc:740] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3594ecd5eb24a74ba9b8aea7183f0b4, State: Initialized, Role: FOLLOWER
I20260926 13:55:47.477852 10644 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.478346 10644 raft_consensus.cc:399] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260926 13:55:47.478554 10644 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260926 13:55:47.478811 10644 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 1 FOLLOWER]: Advancing to term 2
I20260926 13:55:47.482945 10644 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.483389 10644 leader_election.cc:304] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3594ecd5eb24a74ba9b8aea7183f0b4; no voters:
I20260926 13:55:47.484367 10644 leader_election.cc:290] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260926 13:55:47.484609 10647 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260926 13:55:47.485818 10647 raft_consensus.cc:697] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 2 LEADER]: Becoming Leader. State: Replica: f3594ecd5eb24a74ba9b8aea7183f0b4, State: Running, Role: LEADER
I20260926 13:55:47.486418 10647 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER }
I20260926 13:55:47.486877 10644 sys_catalog.cc:565] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260926 13:55:47.488864 10648 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER } }
I20260926 13:55:47.488891 10649 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3594ecd5eb24a74ba9b8aea7183f0b4. Latest consensus state: current_term: 2 leader_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3594ecd5eb24a74ba9b8aea7183f0b4" member_type: VOTER } }
I20260926 13:55:47.489531 10648 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:47.489594 10649 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [sys.catalog]: This master's current role is: LEADER
I20260926 13:55:47.492676 10653 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260926 13:55:47.499155 10653 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260926 13:55:47.500049 3582 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260926 13:55:47.502068 10653 catalog_manager.cc:1308] Loaded cluster ID: 0a0fb96deffc458384097ac02afadbae
I20260926 13:55:47.502275 10653 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260926 13:55:47.506238 10653 catalog_manager.cc:1553] Loading token signing keys...
I20260926 13:55:47.508790 10653 catalog_manager.cc:6230] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4: Loaded TSK: 0
I20260926 13:55:47.509423 10653 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260926 13:55:47.517056 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:47.521979 10664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.522819 10665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.524380 10667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:47.524652 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:47.525980 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:47.526149 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:47.526271 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430947526261 us; error 0 us; skew 500 ppm
I20260926 13:55:47.526678 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:47.528570 3582 webserver.cc:533] Webserver started at http://127.3.127.129:36027/ using document root <none> and password file <none>
I20260926 13:55:47.528990 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:47.529127 3582 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260926 13:55:47.532119 3582 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260926 13:55:47.534386 10672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.535014 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260926 13:55:47.535244 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root
uuid: "f920959ad42f4f37a2c310cf272d4012"
format_stamp: "Formatted at 2026-09-26 13:55:47 on dist-test-slave-fk7n"
I20260926 13:55:47.535465 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:47.550475 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:47.551302 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:47.552543 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:47.554515 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:47.554682 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.554908 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:47.555042 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.590029 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.129:45833
I20260926 13:55:47.590118 10734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.129:45833 every 8 connection(s)
I20260926 13:55:47.594211 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:47.600827 10739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.602432 10740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.605228 10742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:47.605415 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:47.606498 10735 heartbeater.cc:344] Connected to a master server at 127.3.127.190:39363
I20260926 13:55:47.606812 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260926 13:55:47.606880 10735 heartbeater.cc:461] Registering TS with master...
W20260926 13:55:47.607157 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:47.607359 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430947607342 us; error 0 us; skew 500 ppm
I20260926 13:55:47.607787 10735 heartbeater.cc:507] Master 127.3.127.190:39363 requested a full tablet report, sending...
I20260926 13:55:47.608076 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:47.609951 10609 ts_manager.cc:194] Registered new tserver with Master: f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833)
I20260926 13:55:47.610560 3582 webserver.cc:533] Webserver started at http://127.3.127.130:38327/ using document root <none> and password file <none>
I20260926 13:55:47.610997 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:47.611169 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:47.611402 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:47.611681 10609 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39706
I20260926 13:55:47.612511 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-1-root/instance:
uuid: "669aa21e7c0b483092cce23f10f25330"
format_stamp: "Formatted at 2026-09-26 13:55:47 on dist-test-slave-fk7n"
I20260926 13:55:47.617324 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260926 13:55:47.620196 10747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.620900 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:47.621199 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-1-root
uuid: "669aa21e7c0b483092cce23f10f25330"
format_stamp: "Formatted at 2026-09-26 13:55:47 on dist-test-slave-fk7n"
I20260926 13:55:47.621435 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:47.634116 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:47.635052 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:47.636302 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:47.638386 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:47.638567 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.638777 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:47.638919 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.675065 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.130:42471
I20260926 13:55:47.675165 10809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.130:42471 every 8 connection(s)
I20260926 13:55:47.679316 3582 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260926 13:55:47.685572 10813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.686638 10814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260926 13:55:47.689441 10816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260926 13:55:47.690088 3582 server_base.cc:1061] running on GCE node
I20260926 13:55:47.690389 10810 heartbeater.cc:344] Connected to a master server at 127.3.127.190:39363
I20260926 13:55:47.690809 10810 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:47.691085 3582 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260926 13:55:47.691341 3582 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260926 13:55:47.691535 3582 hybrid_clock.cc:648] HybridClock initialized: now 1790430947691517 us; error 0 us; skew 500 ppm
I20260926 13:55:47.691634 10810 heartbeater.cc:507] Master 127.3.127.190:39363 requested a full tablet report, sending...
I20260926 13:55:47.692286 3582 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260926 13:55:47.693783 10609 ts_manager.cc:194] Registered new tserver with Master: 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:47.694803 3582 webserver.cc:533] Webserver started at http://127.3.127.131:46147/ using document root <none> and password file <none>
I20260926 13:55:47.695407 3582 fs_manager.cc:362] Metadata directory not provided
I20260926 13:55:47.695510 10609 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39712
I20260926 13:55:47.695648 3582 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260926 13:55:47.696023 3582 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260926 13:55:47.697309 3582 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-2-root/instance:
uuid: "a59bee4e3229456e8b0dd0f194721c44"
format_stamp: "Formatted at 2026-09-26 13:55:47 on dist-test-slave-fk7n"
I20260926 13:55:47.701380 3582 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260926 13:55:47.704455 10821 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.705137 3582 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260926 13:55:47.705386 3582 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-2-root
uuid: "a59bee4e3229456e8b0dd0f194721c44"
format_stamp: "Formatted at 2026-09-26 13:55:47 on dist-test-slave-fk7n"
I20260926 13:55:47.705633 3582 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskO7XcGN/test-tmp/scan_token-test.0.PickServer_ReplicaSelectionTest.ReplicaSelection_2.1790430890430161-3582-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260926 13:55:47.722175 3582 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260926 13:55:47.723289 3582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260926 13:55:47.724582 3582 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260926 13:55:47.726549 3582 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260926 13:55:47.726732 3582 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.726944 3582 ts_tablet_manager.cc:616] Registered 0 tablets
I20260926 13:55:47.727093 3582 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260926 13:55:47.763008 3582 rpc_server.cc:307] RPC server started. Bound to: 127.3.127.131:41409
I20260926 13:55:47.763116 10883 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.127.131:41409 every 8 connection(s)
I20260926 13:55:47.775233 10884 heartbeater.cc:344] Connected to a master server at 127.3.127.190:39363
I20260926 13:55:47.775581 10884 heartbeater.cc:461] Registering TS with master...
I20260926 13:55:47.776235 10884 heartbeater.cc:507] Master 127.3.127.190:39363 requested a full tablet report, sending...
I20260926 13:55:47.777943 10609 ts_manager.cc:194] Registered new tserver with Master: a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:47.778059 3582 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012183952s
I20260926 13:55:47.779206 10609 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39716
I20260926 13:55:47.801437 10609 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39730:
name: "replica_selection"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 10
seed: 0
}
}
W20260926 13:55:47.803655 10609 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replica_selection in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260926 13:55:47.874693 10700 tablet_service.cc:1511] Processing CreateTablet for tablet 3926163f8af4418f926fa759704c2c76 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.876039 10700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3926163f8af4418f926fa759704c2c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.877970 10699 tablet_service.cc:1511] Processing CreateTablet for tablet fe33aee2fd874d14ab467dba7cf2cfe0 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.879163 10699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe33aee2fd874d14ab467dba7cf2cfe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.879807 10775 tablet_service.cc:1511] Processing CreateTablet for tablet 3926163f8af4418f926fa759704c2c76 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.881036 10775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3926163f8af4418f926fa759704c2c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.882539 10849 tablet_service.cc:1511] Processing CreateTablet for tablet 3926163f8af4418f926fa759704c2c76 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.883718 10849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3926163f8af4418f926fa759704c2c76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.884150 10848 tablet_service.cc:1511] Processing CreateTablet for tablet fe33aee2fd874d14ab467dba7cf2cfe0 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.885365 10848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe33aee2fd874d14ab467dba7cf2cfe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.885535 10774 tablet_service.cc:1511] Processing CreateTablet for tablet fe33aee2fd874d14ab467dba7cf2cfe0 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.886736 10774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe33aee2fd874d14ab467dba7cf2cfe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.888018 10847 tablet_service.cc:1511] Processing CreateTablet for tablet 212603e16fe2480aac71d2ac21eefb26 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.888921 10773 tablet_service.cc:1511] Processing CreateTablet for tablet 212603e16fe2480aac71d2ac21eefb26 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.890113 10773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212603e16fe2480aac71d2ac21eefb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.889967 10846 tablet_service.cc:1511] Processing CreateTablet for tablet d39e03afe6704e7bba77f0941dc30643 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.891536 10769 tablet_service.cc:1511] Processing CreateTablet for tablet 848023f09b4b43409266078bcd364325 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.891695 10845 tablet_service.cc:1511] Processing CreateTablet for tablet 1f03301b2d10417296862fd5eeaf87e1 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.892738 10769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848023f09b4b43409266078bcd364325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.884181 10770 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7a95df58a742a69e1cface7c9d6e36 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.893814 10772 tablet_service.cc:1511] Processing CreateTablet for tablet d39e03afe6704e7bba77f0941dc30643 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.895926 10771 tablet_service.cc:1511] Processing CreateTablet for tablet 1f03301b2d10417296862fd5eeaf87e1 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.896340 10697 tablet_service.cc:1511] Processing CreateTablet for tablet d39e03afe6704e7bba77f0941dc30643 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.897589 10697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39e03afe6704e7bba77f0941dc30643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.898000 10844 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7a95df58a742a69e1cface7c9d6e36 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.902493 10843 tablet_service.cc:1511] Processing CreateTablet for tablet 848023f09b4b43409266078bcd364325 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.904232 10698 tablet_service.cc:1511] Processing CreateTablet for tablet 212603e16fe2480aac71d2ac21eefb26 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.905469 10698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212603e16fe2480aac71d2ac21eefb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.908691 10694 tablet_service.cc:1511] Processing CreateTablet for tablet 848023f09b4b43409266078bcd364325 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.909956 10694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848023f09b4b43409266078bcd364325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.913096 10696 tablet_service.cc:1511] Processing CreateTablet for tablet 1f03301b2d10417296862fd5eeaf87e1 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.914391 10696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f03301b2d10417296862fd5eeaf87e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.902984 10695 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7a95df58a742a69e1cface7c9d6e36 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.921000 10768 tablet_service.cc:1511] Processing CreateTablet for tablet aa9814f431034deaa79ff47944219096 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.921896 10695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7a95df58a742a69e1cface7c9d6e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.927311 10842 tablet_service.cc:1511] Processing CreateTablet for tablet aa9814f431034deaa79ff47944219096 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.929607 10770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7a95df58a742a69e1cface7c9d6e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.930207 10768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9814f431034deaa79ff47944219096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.932255 10693 tablet_service.cc:1511] Processing CreateTablet for tablet aa9814f431034deaa79ff47944219096 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.933025 10771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f03301b2d10417296862fd5eeaf87e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.933514 10693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9814f431034deaa79ff47944219096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.933997 10772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39e03afe6704e7bba77f0941dc30643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.937844 10847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212603e16fe2480aac71d2ac21eefb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.939456 10844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7a95df58a742a69e1cface7c9d6e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.940711 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9814f431034deaa79ff47944219096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.942335 10846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39e03afe6704e7bba77f0941dc30643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.943365 10845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f03301b2d10417296862fd5eeaf87e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.944635 10843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848023f09b4b43409266078bcd364325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.975133 10692 tablet_service.cc:1511] Processing CreateTablet for tablet faffe1f667e94043a7f0e88d5675d6a7 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.976351 10692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faffe1f667e94043a7f0e88d5675d6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.985220 10775 tablet_service.cc:1511] Processing CreateTablet for tablet faffe1f667e94043a7f0e88d5675d6a7 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.986591 10900 tablet_bootstrap.cc:492] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:47.986502 10841 tablet_service.cc:1511] Processing CreateTablet for tablet faffe1f667e94043a7f0e88d5675d6a7 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 8, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.987807 10841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faffe1f667e94043a7f0e88d5675d6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.986512 10775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faffe1f667e94043a7f0e88d5675d6a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:47.990475 10691 tablet_service.cc:1511] Processing CreateTablet for tablet 484dbf4e632b48299225e39e38717061 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:47.991699 10691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484dbf4e632b48299225e39e38717061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:48.006536 10773 tablet_service.cc:1511] Processing CreateTablet for tablet 484dbf4e632b48299225e39e38717061 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:48.008282 10773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484dbf4e632b48299225e39e38717061. 1 dirs total, 0 dirs full, 0 dirs failed
W20260926 13:55:48.069615 10595 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.127.130:42471, user_credentials={real_user=slave}} blocked reactor thread for 59363.1us
I20260926 13:55:48.092763 10900 tablet_bootstrap.cc:654] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.113211 10840 tablet_service.cc:1511] Processing CreateTablet for tablet 484dbf4e632b48299225e39e38717061 (DEFAULT_TABLE table=replica_selection [id=59ef88671f0b477d8f48536b34ecf627]), partition=HASH (key) PARTITION 9, RANGE (key) PARTITION UNBOUNDED
I20260926 13:55:48.114428 10840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 484dbf4e632b48299225e39e38717061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260926 13:55:48.151630 10901 tablet_bootstrap.cc:492] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.158679 10902 tablet_bootstrap.cc:492] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.169373 10901 tablet_bootstrap.cc:654] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.170691 10902 tablet_bootstrap.cc:654] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.171155 10900 tablet_bootstrap.cc:492] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.171627 10900 ts_tablet_manager.cc:1403] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.185s user 0.020s sys 0.007s
I20260926 13:55:48.174633 10900 raft_consensus.cc:359] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.175348 10900 raft_consensus.cc:385] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.175640 10900 raft_consensus.cc:740] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.176343 10900 consensus_queue.cc:260] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.181742 10902 tablet_bootstrap.cc:492] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.182224 10902 ts_tablet_manager.cc:1403] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.000s
I20260926 13:55:48.185359 10810 heartbeater.cc:499] Master 127.3.127.190:39363 was elected leader, sending a full tablet report...
I20260926 13:55:48.185830 10900 ts_tablet_manager.cc:1434] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.014s user 0.010s sys 0.005s
I20260926 13:55:48.186774 10900 tablet_bootstrap.cc:492] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.189057 10901 tablet_bootstrap.cc:492] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.189640 10901 ts_tablet_manager.cc:1403] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.013s
I20260926 13:55:48.185022 10902 raft_consensus.cc:359] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.190032 10902 raft_consensus.cc:385] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.190344 10902 raft_consensus.cc:740] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.191025 10902 consensus_queue.cc:260] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.192373 10901 raft_consensus.cc:359] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.193048 10900 tablet_bootstrap.cc:654] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.193063 10901 raft_consensus.cc:385] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.193586 10901 raft_consensus.cc:740] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.194346 10901 consensus_queue.cc:260] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.205343 10900 tablet_bootstrap.cc:492] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.205875 10900 ts_tablet_manager.cc:1403] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.008s
I20260926 13:55:48.208642 10900 raft_consensus.cc:359] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.209344 10900 raft_consensus.cc:385] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.209623 10900 raft_consensus.cc:740] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.210320 10900 consensus_queue.cc:260] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.212445 10900 ts_tablet_manager.cc:1434] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260926 13:55:48.213394 10900 tablet_bootstrap.cc:492] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.219434 10900 tablet_bootstrap.cc:654] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.224730 10884 heartbeater.cc:499] Master 127.3.127.190:39363 was elected leader, sending a full tablet report...
I20260926 13:55:48.224850 10735 heartbeater.cc:499] Master 127.3.127.190:39363 was elected leader, sending a full tablet report...
I20260926 13:55:48.225296 10901 ts_tablet_manager.cc:1434] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.035s user 0.010s sys 0.022s
I20260926 13:55:48.226212 10901 tablet_bootstrap.cc:492] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.229187 10902 ts_tablet_manager.cc:1434] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.047s user 0.022s sys 0.017s
I20260926 13:55:48.230147 10902 tablet_bootstrap.cc:492] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.231976 10901 tablet_bootstrap.cc:654] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.236245 10902 tablet_bootstrap.cc:654] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.239151 10900 tablet_bootstrap.cc:492] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.239599 10900 ts_tablet_manager.cc:1403] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.026s user 0.014s sys 0.010s
I20260926 13:55:48.242389 10900 raft_consensus.cc:359] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.242996 10901 tablet_bootstrap.cc:492] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.243113 10900 raft_consensus.cc:385] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.243618 10900 raft_consensus.cc:740] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.243709 10901 ts_tablet_manager.cc:1403] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.006s
I20260926 13:55:48.244481 10900 consensus_queue.cc:260] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.246656 10900 ts_tablet_manager.cc:1434] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260926 13:55:48.247480 10900 tablet_bootstrap.cc:492] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.248203 10902 tablet_bootstrap.cc:492] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.248644 10902 ts_tablet_manager.cc:1403] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.012s
I20260926 13:55:48.249244 10901 raft_consensus.cc:359] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.249943 10901 raft_consensus.cc:385] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.250221 10901 raft_consensus.cc:740] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.250943 10901 consensus_queue.cc:260] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.251511 10902 raft_consensus.cc:359] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.252245 10902 raft_consensus.cc:385] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.252521 10902 raft_consensus.cc:740] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.252978 10901 ts_tablet_manager.cc:1434] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.009s user 0.004s sys 0.002s
I20260926 13:55:48.253320 10900 tablet_bootstrap.cc:654] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.253818 10901 tablet_bootstrap.cc:492] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.253412 10902 consensus_queue.cc:260] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.255753 10902 ts_tablet_manager.cc:1434] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260926 13:55:48.256664 10902 tablet_bootstrap.cc:492] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.259567 10901 tablet_bootstrap.cc:654] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.262831 10902 tablet_bootstrap.cc:654] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.265591 10907 raft_consensus.cc:493] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.266060 10907 raft_consensus.cc:515] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.270520 10901 tablet_bootstrap.cc:492] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.270946 10901 ts_tablet_manager.cc:1403] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.017s user 0.013s sys 0.001s
I20260926 13:55:48.273725 10901 raft_consensus.cc:359] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.274411 10901 raft_consensus.cc:385] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.274720 10901 raft_consensus.cc:740] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.275522 10901 consensus_queue.cc:260] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.276916 10907 leader_election.cc:290] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.279469 10901 ts_tablet_manager.cc:1434] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260926 13:55:48.280421 10901 tablet_bootstrap.cc:492] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.286450 10901 tablet_bootstrap.cc:654] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.289793 10908 raft_consensus.cc:493] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.290242 10908 raft_consensus.cc:515] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.291486 10900 tablet_bootstrap.cc:492] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.291972 10900 ts_tablet_manager.cc:1403] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.045s user 0.026s sys 0.015s
I20260926 13:55:48.292640 10908 leader_election.cc:290] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.294840 10900 raft_consensus.cc:359] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.295770 10900 raft_consensus.cc:385] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.296069 10900 raft_consensus.cc:740] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.296729 10900 consensus_queue.cc:260] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.301251 10900 ts_tablet_manager.cc:1434] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260926 13:55:48.302150 10900 tablet_bootstrap.cc:492] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.293779 10902 tablet_bootstrap.cc:492] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.304098 10902 ts_tablet_manager.cc:1403] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.003s
I20260926 13:55:48.306864 10902 raft_consensus.cc:359] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.307755 10900 tablet_bootstrap.cc:654] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.316193 10901 tablet_bootstrap.cc:492] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.316669 10901 ts_tablet_manager.cc:1403] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.005s
I20260926 13:55:48.319494 10901 raft_consensus.cc:359] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.320240 10901 raft_consensus.cc:385] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.320524 10901 raft_consensus.cc:740] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.321419 10901 consensus_queue.cc:260] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.307507 10902 raft_consensus.cc:385] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.322718 10902 raft_consensus.cc:740] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.325161 10901 ts_tablet_manager.cc:1434] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.008s user 0.002s sys 0.005s
I20260926 13:55:48.326061 10901 tablet_bootstrap.cc:492] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.327224 10902 consensus_queue.cc:260] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.330865 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484dbf4e632b48299225e39e38717061" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:48.331928 10901 tablet_bootstrap.cc:654] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
W20260926 13:55:48.332653 10675 leader_election.cc:343] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:48.340555 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
W20260926 13:55:48.342301 10824 leader_election.cc:343] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:48.344957 10901 tablet_bootstrap.cc:492] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.345453 10901 ts_tablet_manager.cc:1403] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.002s
I20260926 13:55:48.345432 10859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484dbf4e632b48299225e39e38717061" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.346167 10859 raft_consensus.cc:2468] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f920959ad42f4f37a2c310cf272d4012 in term 0.
I20260926 13:55:48.347538 10674 leader_election.cc:304] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012; no voters: 669aa21e7c0b483092cce23f10f25330
I20260926 13:55:48.348373 10907 raft_consensus.cc:2804] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:48.348299 10901 raft_consensus.cc:359] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.348798 10907 raft_consensus.cc:493] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.349079 10901 raft_consensus.cc:385] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.349303 10907 raft_consensus.cc:3060] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.349385 10901 raft_consensus.cc:740] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.350256 10901 consensus_queue.cc:260] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.354277 10901 ts_tablet_manager.cc:1434] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260926 13:55:48.355216 10901 tablet_bootstrap.cc:492] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.356948 10900 tablet_bootstrap.cc:492] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.357429 10900 ts_tablet_manager.cc:1403] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.055s user 0.031s sys 0.024s
I20260926 13:55:48.348724 10902 ts_tablet_manager.cc:1434] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.044s user 0.007s sys 0.000s
I20260926 13:55:48.360046 10900 raft_consensus.cc:359] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.360699 10900 raft_consensus.cc:385] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.360946 10901 tablet_bootstrap.cc:654] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.361073 10902 tablet_bootstrap.cc:492] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.361006 10900 raft_consensus.cc:740] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.362031 10900 consensus_queue.cc:260] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.366593 10900 ts_tablet_manager.cc:1434] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260926 13:55:48.367503 10900 tablet_bootstrap.cc:492] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.370131 10902 tablet_bootstrap.cc:654] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.373832 10900 tablet_bootstrap.cc:654] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.378151 10927 raft_consensus.cc:493] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.378585 10927 raft_consensus.cc:515] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.380224 10907 raft_consensus.cc:515] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.381259 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe33aee2fd874d14ab467dba7cf2cfe0" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
W20260926 13:55:48.382622 10675 leader_election.cc:343] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:48.382822 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:48.384722 10900 tablet_bootstrap.cc:492] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
W20260926 13:55:48.384783 10822 leader_election.cc:343] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:48.385329 10902 tablet_bootstrap.cc:492] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.385363 10900 ts_tablet_manager.cc:1403] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20260926 13:55:48.385409 10822 leader_election.cc:304] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a59bee4e3229456e8b0dd0f194721c44; no voters: 669aa21e7c0b483092cce23f10f25330, f920959ad42f4f37a2c310cf272d4012
I20260926 13:55:48.385953 10902 ts_tablet_manager.cc:1403] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.025s user 0.017s sys 0.000s
I20260926 13:55:48.386494 10908 raft_consensus.cc:2749] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:48.387447 10907 leader_election.cc:290] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 election: Requested vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.388078 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484dbf4e632b48299225e39e38717061" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:48.388208 10900 raft_consensus.cc:359] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.388942 10900 raft_consensus.cc:385] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.388708 10902 raft_consensus.cc:359] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.389267 10900 raft_consensus.cc:740] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.389551 10902 raft_consensus.cc:385] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.389460 10859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "484dbf4e632b48299225e39e38717061" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44"
I20260926 13:55:48.389803 10927 leader_election.cc:290] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.389935 10902 raft_consensus.cc:740] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.389992 10900 consensus_queue.cc:260] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.391078 10859 raft_consensus.cc:3060] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.391448 10785 raft_consensus.cc:3060] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.390908 10902 consensus_queue.cc:260] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.392359 10900 ts_tablet_manager.cc:1434] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260926 13:55:48.393280 10900 tablet_bootstrap.cc:492] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.391278 10858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe33aee2fd874d14ab467dba7cf2cfe0" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
W20260926 13:55:48.394924 10674 leader_election.cc:343] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:48.395337 10674 leader_election.cc:304] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f920959ad42f4f37a2c310cf272d4012; no voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44
I20260926 13:55:48.393750 10902 ts_tablet_manager.cc:1434] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260926 13:55:48.396556 10902 tablet_bootstrap.cc:492] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.398399 10859 raft_consensus.cc:2468] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f920959ad42f4f37a2c310cf272d4012 in term 1.
I20260926 13:55:48.399080 10900 tablet_bootstrap.cc:654] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.399685 10927 raft_consensus.cc:2749] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:48.399662 10674 leader_election.cc:304] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012; no voters:
I20260926 13:55:48.400606 10927 raft_consensus.cc:2804] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:48.401034 10927 raft_consensus.cc:697] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 1 LEADER]: Becoming Leader. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Running, Role: LEADER
I20260926 13:55:48.401801 10927 consensus_queue.cc:237] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.406270 10900 tablet_bootstrap.cc:492] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.406759 10900 ts_tablet_manager.cc:1403] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.001s
I20260926 13:55:48.407148 10785 raft_consensus.cc:2468] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f920959ad42f4f37a2c310cf272d4012 in term 1.
I20260926 13:55:48.408619 10901 tablet_bootstrap.cc:492] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.409109 10901 ts_tablet_manager.cc:1403] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.054s user 0.012s sys 0.013s
I20260926 13:55:48.409258 10900 raft_consensus.cc:359] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.409801 10900 raft_consensus.cc:385] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.410012 10900 raft_consensus.cc:740] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.410593 10900 consensus_queue.cc:260] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.411890 10901 raft_consensus.cc:359] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.412540 10900 ts_tablet_manager.cc:1434] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260926 13:55:48.412595 10901 raft_consensus.cc:385] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.407902 10902 tablet_bootstrap.cc:654] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.413085 10901 raft_consensus.cc:740] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.413635 10900 tablet_bootstrap.cc:492] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.413929 10901 consensus_queue.cc:260] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.416153 10901 ts_tablet_manager.cc:1434] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260926 13:55:48.417135 10901 tablet_bootstrap.cc:492] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.420528 10900 tablet_bootstrap.cc:654] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.420799 10902 tablet_bootstrap.cc:492] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.421227 10902 ts_tablet_manager.cc:1403] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.001s
I20260926 13:55:48.426612 10902 raft_consensus.cc:359] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.427271 10902 raft_consensus.cc:385] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.427546 10902 raft_consensus.cc:740] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.428313 10902 consensus_queue.cc:260] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.430634 10902 ts_tablet_manager.cc:1434] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260926 13:55:48.431533 10902 tablet_bootstrap.cc:492] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.432022 10901 tablet_bootstrap.cc:654] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.432868 10607 catalog_manager.cc:5838] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 reported cstate change: term changed from 0 to 1, leader changed from <none> to f920959ad42f4f37a2c310cf272d4012 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "f920959ad42f4f37a2c310cf272d4012" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:48.437081 10900 tablet_bootstrap.cc:492] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.437532 10900 ts_tablet_manager.cc:1403] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.011s
I20260926 13:55:48.437703 10902 tablet_bootstrap.cc:654] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.440100 10900 raft_consensus.cc:359] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.440775 10900 raft_consensus.cc:385] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.441082 10901 tablet_bootstrap.cc:492] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.441038 10900 raft_consensus.cc:740] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.441622 10901 ts_tablet_manager.cc:1403] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.002s
I20260926 13:55:48.441990 10900 consensus_queue.cc:260] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.444200 10900 ts_tablet_manager.cc:1434] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260926 13:55:48.445161 10900 tablet_bootstrap.cc:492] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.444334 10901 raft_consensus.cc:359] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.450034 10900 tablet_bootstrap.cc:654] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.449983 10901 raft_consensus.cc:385] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.450413 10901 raft_consensus.cc:740] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.451263 10901 consensus_queue.cc:260] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.452791 10902 tablet_bootstrap.cc:492] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.453217 10902 ts_tablet_manager.cc:1403] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.005s
I20260926 13:55:48.453316 10901 ts_tablet_manager.cc:1434] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20260926 13:55:48.454263 10901 tablet_bootstrap.cc:492] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.455837 10902 raft_consensus.cc:359] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.456511 10902 raft_consensus.cc:385] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.456812 10902 raft_consensus.cc:740] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.457688 10902 consensus_queue.cc:260] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.459769 10901 tablet_bootstrap.cc:654] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.459980 10902 ts_tablet_manager.cc:1434] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260926 13:55:48.460896 10902 tablet_bootstrap.cc:492] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.466670 10902 tablet_bootstrap.cc:654] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.472045 10901 tablet_bootstrap.cc:492] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.472500 10901 ts_tablet_manager.cc:1403] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.001s
I20260926 13:55:48.475018 10901 raft_consensus.cc:359] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.475654 10901 raft_consensus.cc:385] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.475911 10901 raft_consensus.cc:740] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.476760 10901 consensus_queue.cc:260] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.478641 10901 ts_tablet_manager.cc:1434] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260926 13:55:48.478824 10906 raft_consensus.cc:493] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.479528 10901 tablet_bootstrap.cc:492] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.479315 10906 raft_consensus.cc:515] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.481962 10906 leader_election.cc:290] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.486826 10901 tablet_bootstrap.cc:654] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.493741 10927 raft_consensus.cc:493] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.494237 10927 raft_consensus.cc:515] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.496520 10927 leader_election.cc:290] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.498329 10859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9814f431034deaa79ff47944219096" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.499365 10908 raft_consensus.cc:493] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.499861 10908 raft_consensus.cc:515] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.501793 10908 leader_election.cc:290] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.502255 10908 raft_consensus.cc:493] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.505036 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "212603e16fe2480aac71d2ac21eefb26" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:48.505681 10785 raft_consensus.cc:2468] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.506965 10824 leader_election.cc:304] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.507956 10943 raft_consensus.cc:2804] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260926 13:55:48.508140 10674 leader_election.cc:343] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:48.508347 10943 raft_consensus.cc:493] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.508718 10943 raft_consensus.cc:3060] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.510335 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "212603e16fe2480aac71d2ac21eefb26" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:48.510953 10710 raft_consensus.cc:2468] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.516096 10943 raft_consensus.cc:515] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.502631 10908 raft_consensus.cc:515] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.527033 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "212603e16fe2480aac71d2ac21eefb26" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:48.527626 10710 raft_consensus.cc:3060] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.527753 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe33aee2fd874d14ab467dba7cf2cfe0" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:48.528587 10709 raft_consensus.cc:2468] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.529942 10822 leader_election.cc:304] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012; no voters:
I20260926 13:55:48.534751 10710 raft_consensus.cc:2468] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:48.517163 10901 tablet_bootstrap.cc:492] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.536082 10901 ts_tablet_manager.cc:1403] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.057s user 0.017s sys 0.007s
I20260926 13:55:48.538935 10901 raft_consensus.cc:359] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.539556 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe33aee2fd874d14ab467dba7cf2cfe0" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:48.539709 10908 leader_election.cc:290] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.540211 10785 raft_consensus.cc:2468] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.540380 10908 raft_consensus.cc:2804] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:48.540902 10908 raft_consensus.cc:493] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.541297 10908 raft_consensus.cc:3060] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.539552 10901 raft_consensus.cc:385] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.542017 10901 raft_consensus.cc:740] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.542680 10901 consensus_queue.cc:260] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.546294 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "212603e16fe2480aac71d2ac21eefb26" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:48.546875 10785 raft_consensus.cc:3060] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.550011 10900 tablet_bootstrap.cc:492] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.550463 10900 ts_tablet_manager.cc:1403] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.105s user 0.037s sys 0.062s
I20260926 13:55:48.552335 10943 leader_election.cc:290] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Requested vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.552907 10900 raft_consensus.cc:359] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.553515 10900 raft_consensus.cc:385] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.553783 10900 raft_consensus.cc:740] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.554392 10785 raft_consensus.cc:2468] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:48.554490 10900 consensus_queue.cc:260] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.555634 10824 leader_election.cc:304] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.556483 10900 ts_tablet_manager.cc:1434] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260926 13:55:48.557346 10900 tablet_bootstrap.cc:492] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330: Bootstrap starting.
I20260926 13:55:48.562489 10900 tablet_bootstrap.cc:654] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.580530 10900 tablet_bootstrap.cc:492] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330: No bootstrap required, opened a new log
I20260926 13:55:48.581000 10900 ts_tablet_manager.cc:1403] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.001s
I20260926 13:55:48.587302 10900 raft_consensus.cc:359] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.588017 10900 raft_consensus.cc:385] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.588294 10900 raft_consensus.cc:740] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.588917 10900 consensus_queue.cc:260] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.591370 10900 ts_tablet_manager.cc:1434] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260926 13:55:48.637669 10946 raft_consensus.cc:2804] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:48.641402 10943 raft_consensus.cc:493] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.645231 10943 raft_consensus.cc:515] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.544606 10901 ts_tablet_manager.cc:1434] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.008s user 0.003s sys 0.001s
I20260926 13:55:48.646869 10901 tablet_bootstrap.cc:492] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44: Bootstrap starting.
I20260926 13:55:48.671658 10946 raft_consensus.cc:697] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Becoming Leader. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Running, Role: LEADER
I20260926 13:55:48.672629 10946 consensus_queue.cc:237] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.673484 10943 leader_election.cc:290] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.680208 10908 raft_consensus.cc:515] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.683261 10908 leader_election.cc:290] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Requested vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.687254 10902 tablet_bootstrap.cc:492] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.687845 10902 ts_tablet_manager.cc:1403] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.227s user 0.062s sys 0.087s
I20260926 13:55:48.690925 10902 raft_consensus.cc:359] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.691651 10902 raft_consensus.cc:385] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.691954 10902 raft_consensus.cc:740] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.692657 10902 consensus_queue.cc:260] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.695075 10902 ts_tablet_manager.cc:1434] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260926 13:55:48.695960 10902 tablet_bootstrap.cc:492] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.701831 10902 tablet_bootstrap.cc:654] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.703601 10901 tablet_bootstrap.cc:654] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.711417 10902 tablet_bootstrap.cc:492] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:48.711880 10902 ts_tablet_manager.cc:1403] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260926 13:55:48.713769 10901 tablet_bootstrap.cc:492] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44: No bootstrap required, opened a new log
I20260926 13:55:48.714293 10901 ts_tablet_manager.cc:1403] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44: Time spent bootstrapping tablet: real 0.068s user 0.006s sys 0.007s
I20260926 13:55:48.715270 10902 raft_consensus.cc:359] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.715909 10902 raft_consensus.cc:385] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.716166 10902 raft_consensus.cc:740] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.716722 10946 raft_consensus.cc:493] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.716809 10902 consensus_queue.cc:260] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.717342 10946 raft_consensus.cc:515] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.718763 10902 ts_tablet_manager.cc:1434] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260926 13:55:48.719463 10946 leader_election.cc:290] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833)
I20260926 13:55:48.719635 10902 tablet_bootstrap.cc:492] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:48.720156 10907 raft_consensus.cc:493] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.720516 10907 raft_consensus.cc:515] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.721910 10907 leader_election.cc:290] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.722280 10907 raft_consensus.cc:493] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.722574 10907 raft_consensus.cc:515] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.752843 10907 leader_election.cc:290] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.858525 10907 raft_consensus.cc:493] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.860029 10907 raft_consensus.cc:515] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.861474 10951 raft_consensus.cc:493] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.861996 10951 raft_consensus.cc:515] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.862545 10907 leader_election.cc:290] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.863879 10951 leader_election.cc:290] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.864351 10951 raft_consensus.cc:493] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.864837 10951 raft_consensus.cc:515] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.866581 10951 leader_election.cc:290] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409), f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833)
I20260926 13:55:48.867385 10951 raft_consensus.cc:493] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.867864 10951 raft_consensus.cc:515] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.869637 10951 leader_election.cc:290] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.870121 10951 raft_consensus.cc:493] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.870560 10951 raft_consensus.cc:515] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.872342 10951 leader_election.cc:290] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.884577 10946 raft_consensus.cc:493] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.885071 10946 raft_consensus.cc:515] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.886370 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:48.887029 10783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:48.886987 10785 raft_consensus.cc:2468] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.887629 10783 raft_consensus.cc:2468] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.888764 10784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe33aee2fd874d14ab467dba7cf2cfe0" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:48.889124 10824 leader_election.cc:304] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.889336 10784 raft_consensus.cc:3060] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.890002 10824 leader_election.cc:304] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.886970 10946 leader_election.cc:290] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.891459 10906 raft_consensus.cc:493] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.891494 10946 raft_consensus.cc:2804] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:48.892032 10946 raft_consensus.cc:493] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.892493 10946 raft_consensus.cc:3060] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.892040 10906 raft_consensus.cc:515] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.893338 10783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7a95df58a742a69e1cface7c9d6e36" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:48.893992 10906 leader_election.cc:290] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.893914 10783 raft_consensus.cc:2468] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.897153 10944 raft_consensus.cc:2804] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:48.897562 10944 raft_consensus.cc:493] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.897922 10944 raft_consensus.cc:3060] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.899304 10946 raft_consensus.cc:515] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.901286 10946 leader_election.cc:290] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Requested vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.903695 10784 raft_consensus.cc:2468] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:48.904860 10824 leader_election.cc:304] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.905215 10784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:48.905747 10824 leader_election.cc:304] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.905808 10946 raft_consensus.cc:2804] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:48.906386 10946 raft_consensus.cc:493] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.907166 10946 raft_consensus.cc:3060] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.906795 10784 raft_consensus.cc:3060] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.908178 10609 catalog_manager.cc:5838] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 reported cstate change: term changed from 0 to 1, leader changed from <none> to a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "a59bee4e3229456e8b0dd0f194721c44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:48.910188 10944 raft_consensus.cc:515] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:48.914356 10944 leader_election.cc:290] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Requested vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833)
I20260926 13:55:48.914624 10784 raft_consensus.cc:2468] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:48.914930 10944 raft_consensus.cc:2804] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:48.916388 10944 raft_consensus.cc:697] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Becoming Leader. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Running, Role: LEADER
I20260926 13:55:48.917172 10944 consensus_queue.cc:237] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.920171 10946 raft_consensus.cc:515] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.922055 10946 leader_election.cc:290] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Requested vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.926074 10856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848023f09b4b43409266078bcd364325" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.926702 10856 raft_consensus.cc:2468] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 0.
I20260926 13:55:48.927767 10855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.928475 10855 raft_consensus.cc:2393] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 669aa21e7c0b483092cce23f10f25330 in current term 1: Already voted for candidate a59bee4e3229456e8b0dd0f194721c44 in this term.
W20260926 13:55:48.930408 10822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.127.129:45833, user_credentials={real_user=slave}} blocked reactor thread for 400566us
I20260926 13:55:48.933072 10709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe33aee2fd874d14ab467dba7cf2cfe0" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:48.933595 10709 raft_consensus.cc:3060] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.936427 10858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.937016 10858 raft_consensus.cc:2468] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 0.
I20260926 13:55:48.919780 10859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "212603e16fe2480aac71d2ac21eefb26" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.940083 10943 raft_consensus.cc:493] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260926 13:55:48.940521 10943 raft_consensus.cc:515] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.941095 10749 leader_election.cc:304] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.941872 10906 raft_consensus.cc:2804] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:48.942236 10906 raft_consensus.cc:493] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.942225 10749 leader_election.cc:304] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:48.942776 10906 raft_consensus.cc:3060] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.943953 10784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:48.944504 10784 raft_consensus.cc:3060] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.945037 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7a95df58a742a69e1cface7c9d6e36" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:48.947329 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:48.947877 10710 raft_consensus.cc:2468] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.950357 10906 raft_consensus.cc:515] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.951356 10784 raft_consensus.cc:2468] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:48.952380 10906 leader_election.cc:290] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 election: Requested vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:48.953205 10783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7a95df58a742a69e1cface7c9d6e36" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:48.953747 10783 raft_consensus.cc:3060] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.956212 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:48.956815 10708 raft_consensus.cc:2468] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:48.960949 10951 raft_consensus.cc:2804] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:48.961323 10951 raft_consensus.cc:493] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:48.961619 10951 raft_consensus.cc:3060] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.966141 10859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848023f09b4b43409266078bcd364325" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44"
I20260926 13:55:48.966712 10859 raft_consensus.cc:3060] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.960553 10783 raft_consensus.cc:2468] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:48.975011 10901 raft_consensus.cc:359] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.975659 10901 raft_consensus.cc:385] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:48.975893 10901 raft_consensus.cc:740] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Initialized, Role: FOLLOWER
I20260926 13:55:48.977463 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39e03afe6704e7bba77f0941dc30643" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.982559 10902 tablet_bootstrap.cc:654] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:48.983454 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:48.983982 10708 raft_consensus.cc:3060] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.978026 10854 raft_consensus.cc:2468] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 0.
I20260926 13:55:48.979041 10901 consensus_queue.cc:260] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:48.987007 10901 ts_tablet_manager.cc:1434] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44: Time spent starting tablet: real 0.272s user 0.003s sys 0.005s
I20260926 13:55:48.942408 10943 leader_election.cc:290] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471)
I20260926 13:55:48.996515 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:48.997139 10710 raft_consensus.cc:3060] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:48.998088 10857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:48.998785 10857 raft_consensus.cc:2393] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 669aa21e7c0b483092cce23f10f25330 in current term 1: Already voted for candidate a59bee4e3229456e8b0dd0f194721c44 in this term.
W20260926 13:55:48.996443 10748 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.008s sys 0.006s
W20260926 13:55:49.000304 10748 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.517s user 0.009s sys 0.006s
I20260926 13:55:49.003652 10784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9814f431034deaa79ff47944219096" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:49.004249 10784 raft_consensus.cc:2468] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f920959ad42f4f37a2c310cf272d4012 in term 0.
I20260926 13:55:48.994372 10783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39e03afe6704e7bba77f0941dc30643" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:49.005440 10783 raft_consensus.cc:2468] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 0.
I20260926 13:55:49.005548 10785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:49.007668 10675 leader_election.cc:304] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, f920959ad42f4f37a2c310cf272d4012; no voters: a59bee4e3229456e8b0dd0f194721c44
I20260926 13:55:49.008031 10784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:49.008701 10784 raft_consensus.cc:2393] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f920959ad42f4f37a2c310cf272d4012 in current term 1: Already voted for candidate a59bee4e3229456e8b0dd0f194721c44 in this term.
I20260926 13:55:49.009158 10927 raft_consensus.cc:2804] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:49.009524 10927 raft_consensus.cc:493] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:49.009864 10927 raft_consensus.cc:3060] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.011471 10783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330" is_pre_election: true
I20260926 13:55:49.012234 10783 raft_consensus.cc:2393] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f920959ad42f4f37a2c310cf272d4012 in current term 1: Already voted for candidate a59bee4e3229456e8b0dd0f194721c44 in this term.
I20260926 13:55:49.014263 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "212603e16fe2480aac71d2ac21eefb26" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:49.015007 10707 raft_consensus.cc:2393] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 669aa21e7c0b483092cce23f10f25330 in current term 1: Already voted for candidate a59bee4e3229456e8b0dd0f194721c44 in this term.
I20260926 13:55:49.019116 10708 raft_consensus.cc:2468] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:49.021011 10706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39e03afe6704e7bba77f0941dc30643" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:49.021414 10705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:49.022678 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:49.023237 10707 raft_consensus.cc:2468] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 0.
W20260926 13:55:49.023707 10822 leader_election.cc:343] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:49.024616 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848023f09b4b43409266078bcd364325" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:49.025229 10704 raft_consensus.cc:2468] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 0.
I20260926 13:55:49.025679 10822 leader_election.cc:304] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012; no voters:
I20260926 13:55:49.026515 10908 raft_consensus.cc:2804] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:49.026993 10908 raft_consensus.cc:697] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Becoming Leader. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Running, Role: LEADER
I20260926 13:55:49.027479 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39e03afe6704e7bba77f0941dc30643" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:49.027834 10908 consensus_queue.cc:237] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.028889 10707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848023f09b4b43409266078bcd364325" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:49.030143 10707 raft_consensus.cc:3060] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
W20260926 13:55:49.031373 10822 leader_election.cc:343] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:49.027127 10704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012" is_pre_election: true
I20260926 13:55:49.032176 10704 raft_consensus.cc:2393] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 669aa21e7c0b483092cce23f10f25330 in current term 1: Already voted for candidate a59bee4e3229456e8b0dd0f194721c44 in this term.
I20260926 13:55:49.035430 10927 raft_consensus.cc:515] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.035946 10749 leader_election.cc:304] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:49.042583 10906 raft_consensus.cc:2804] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:49.042924 10906 raft_consensus.cc:493] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:49.043219 10906 raft_consensus.cc:3060] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.047348 10709 raft_consensus.cc:2468] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:49.049302 10748 leader_election.cc:304] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330; no voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012
I20260926 13:55:49.050155 10783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9814f431034deaa79ff47944219096" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:49.050913 10783 raft_consensus.cc:3060] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.051047 10927 leader_election.cc:290] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 election: Requested vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:49.052459 10707 raft_consensus.cc:2468] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 1.
I20260926 13:55:49.053314 10927 consensus_queue.cc:1048] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.055032 10857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:49.055661 10857 raft_consensus.cc:2468] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f920959ad42f4f37a2c310cf272d4012 in term 0.
I20260926 13:55:49.055712 10858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f03301b2d10417296862fd5eeaf87e1" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:49.056733 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3926163f8af4418f926fa759704c2c76" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44" is_pre_election: true
I20260926 13:55:49.057545 10854 raft_consensus.cc:2393] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f920959ad42f4f37a2c310cf272d4012 in current term 1: Already voted for candidate a59bee4e3229456e8b0dd0f194721c44 in this term.
I20260926 13:55:49.058916 10858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9814f431034deaa79ff47944219096" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44"
I20260926 13:55:49.059487 10858 raft_consensus.cc:3060] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.065611 10824 leader_election.cc:304] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:49.071488 10783 raft_consensus.cc:2468] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f920959ad42f4f37a2c310cf272d4012 in term 1.
I20260926 13:55:49.073312 10710 raft_consensus.cc:2468] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:49.050031 10906 raft_consensus.cc:515] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.037549 10951 raft_consensus.cc:515] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.075348 10785 raft_consensus.cc:2393] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f920959ad42f4f37a2c310cf272d4012 in current term 1: Already voted for candidate 669aa21e7c0b483092cce23f10f25330 in this term.
I20260926 13:55:49.075825 10951 leader_election.cc:290] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 election: Requested vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:49.078392 10858 raft_consensus.cc:2468] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f920959ad42f4f37a2c310cf272d4012 in term 1.
I20260926 13:55:49.079617 10859 raft_consensus.cc:2468] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 1.
I20260926 13:55:49.080981 10749 leader_election.cc:304] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:49.081959 10951 raft_consensus.cc:2804] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:49.085130 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39e03afe6704e7bba77f0941dc30643" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44"
I20260926 13:55:49.085680 10854 raft_consensus.cc:3060] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.075721 10906 leader_election.cc:290] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 election: Requested vote from peers f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:49.090370 10857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44"
I20260926 13:55:49.091078 10857 raft_consensus.cc:3060] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.093209 10946 raft_consensus.cc:2804] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:49.099489 10946 raft_consensus.cc:697] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Becoming Leader. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Running, Role: LEADER
I20260926 13:55:49.093554 10906 raft_consensus.cc:2749] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:49.100307 10946 consensus_queue.cc:237] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } }
I20260926 13:55:49.112650 10854 raft_consensus.cc:2468] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 1.
I20260926 13:55:49.108559 10857 raft_consensus.cc:2468] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 1.
I20260926 13:55:49.091099 10824 leader_election.cc:304] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:49.124256 10609 catalog_manager.cc:5838] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 reported cstate change: term changed from 0 to 1, leader changed from <none> to a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "a59bee4e3229456e8b0dd0f194721c44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:49.128190 10902 tablet_bootstrap.cc:492] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:49.128661 10902 ts_tablet_manager.cc:1403] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.409s user 0.034s sys 0.072s
I20260926 13:55:49.131237 10902 raft_consensus.cc:359] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.131834 10902 raft_consensus.cc:385] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:49.132097 10902 raft_consensus.cc:740] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:49.132735 10902 consensus_queue.cc:260] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.140429 10902 ts_tablet_manager.cc:1434] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260926 13:55:49.141350 10902 tablet_bootstrap.cc:492] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012: Bootstrap starting.
I20260926 13:55:49.100824 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7a95df58a742a69e1cface7c9d6e36" candidate_uuid: "a59bee4e3229456e8b0dd0f194721c44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:49.125571 10749 leader_election.cc:304] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:49.145653 10749 leader_election.cc:304] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters:
I20260926 13:55:49.125887 10824 leader_election.cc:304] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44; no voters: f920959ad42f4f37a2c310cf272d4012
I20260926 13:55:49.125599 10944 raft_consensus.cc:2804] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:49.146456 10906 raft_consensus.cc:2804] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:49.147437 10951 raft_consensus.cc:697] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 1 LEADER]: Becoming Leader. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Running, Role: LEADER
I20260926 13:55:49.149992 10944 raft_consensus.cc:697] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Becoming Leader. State: Replica: a59bee4e3229456e8b0dd0f194721c44, State: Running, Role: LEADER
I20260926 13:55:49.149967 10908 raft_consensus.cc:2764] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260926 13:55:49.151257 10944 consensus_queue.cc:237] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.151779 10674 leader_election.cc:304] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012; no voters:
I20260926 13:55:49.152796 10927 raft_consensus.cc:2804] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260926 13:55:49.153131 10927 raft_consensus.cc:493] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260926 13:55:49.153442 10927 raft_consensus.cc:3060] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.148367 10708 raft_consensus.cc:3060] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.156665 10951 consensus_queue.cc:237] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
W20260926 13:55:49.158077 10748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.127.129:45833, user_credentials={real_user=slave}} blocked reactor thread for 108901us
I20260926 13:55:49.158349 10902 tablet_bootstrap.cc:654] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012: Neither blocks nor log segments found. Creating new log.
I20260926 13:55:49.159848 10748 leader_election.cc:304] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330; no voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012
I20260926 13:55:49.161605 10927 raft_consensus.cc:515] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.161360 10956 raft_consensus.cc:2804] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader election won for term 1
I20260926 13:55:49.150326 10906 raft_consensus.cc:697] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 1 LEADER]: Becoming Leader. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Running, Role: LEADER
I20260926 13:55:49.162611 10955 raft_consensus.cc:2749] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:49.162802 10674 leader_election.cc:304] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f920959ad42f4f37a2c310cf272d4012; no voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44
I20260926 13:55:49.165208 10906 consensus_queue.cc:237] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.165819 10674 leader_election.cc:304] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f920959ad42f4f37a2c310cf272d4012; no voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44
I20260926 13:55:49.166074 10907 raft_consensus.cc:2749] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:49.163524 10708 raft_consensus.cc:2468] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a59bee4e3229456e8b0dd0f194721c44 in term 1.
I20260926 13:55:49.166719 10907 raft_consensus.cc:2749] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:49.168596 10902 tablet_bootstrap.cc:492] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012: No bootstrap required, opened a new log
I20260926 13:55:49.169016 10902 ts_tablet_manager.cc:1403] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.000s
I20260926 13:55:49.171466 10902 raft_consensus.cc:359] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.172106 10902 raft_consensus.cc:385] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260926 13:55:49.172349 10902 raft_consensus.cc:740] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Initialized, Role: FOLLOWER
I20260926 13:55:49.172932 10902 consensus_queue.cc:260] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.174834 10902 ts_tablet_manager.cc:1434] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260926 13:55:49.176725 10674 leader_election.cc:304] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012; no voters:
I20260926 13:55:49.176937 10961 consensus_queue.cc:1048] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.176808 10609 catalog_manager.cc:5838] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 reported cstate change: term changed from 0 to 1, leader changed from <none> to a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "a59bee4e3229456e8b0dd0f194721c44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:49.178179 10961 raft_consensus.cc:2804] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election won for term 1
W20260926 13:55:49.164412 10748 leader_election.cc:343] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Illegal state: must be running to vote when last-logged opid is not known
I20260926 13:55:49.179504 10748 leader_election.cc:304] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 669aa21e7c0b483092cce23f10f25330; no voters: a59bee4e3229456e8b0dd0f194721c44, f920959ad42f4f37a2c310cf272d4012
I20260926 13:55:49.178656 10956 raft_consensus.cc:697] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 1 LEADER]: Becoming Leader. State: Replica: 669aa21e7c0b483092cce23f10f25330, State: Running, Role: LEADER
I20260926 13:55:49.178632 10961 raft_consensus.cc:697] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 1 LEADER]: Becoming Leader. State: Replica: f920959ad42f4f37a2c310cf272d4012, State: Running, Role: LEADER
I20260926 13:55:49.180915 10956 consensus_queue.cc:237] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.182657 10960 raft_consensus.cc:2749] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260926 13:55:49.180953 10961 consensus_queue.cc:237] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } }
I20260926 13:55:49.179557 10609 catalog_manager.cc:5838] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 reported cstate change: term changed from 0 to 1, leader changed from <none> to a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "a59bee4e3229456e8b0dd0f194721c44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: HEALTHY } } }
I20260926 13:55:49.190188 10710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:49.191079 10710 raft_consensus.cc:2393] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 669aa21e7c0b483092cce23f10f25330 in current term 1: Already voted for candidate f920959ad42f4f37a2c310cf272d4012 in this term.
I20260926 13:55:49.190251 10608 catalog_manager.cc:5838] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 reported cstate change: term changed from 0 to 1, leader changed from <none> to 669aa21e7c0b483092cce23f10f25330 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "669aa21e7c0b483092cce23f10f25330" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:49.193236 10708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39e03afe6704e7bba77f0941dc30643" candidate_uuid: "669aa21e7c0b483092cce23f10f25330" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f920959ad42f4f37a2c310cf272d4012"
I20260926 13:55:49.193790 10708 raft_consensus.cc:3060] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [term 0 FOLLOWER]: Advancing to term 1
I20260926 13:55:49.193912 10927 leader_election.cc:290] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 election: Requested vote from peers 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471), a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131:41409)
I20260926 13:55:49.198108 10609 catalog_manager.cc:5838] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 reported cstate change: term changed from 0 to 1, leader changed from <none> to a59bee4e3229456e8b0dd0f194721c44 (127.3.127.131). New cstate: current_term: 1 leader_uuid: "a59bee4e3229456e8b0dd0f194721c44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:49.202112 10854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a59bee4e3229456e8b0dd0f194721c44"
I20260926 13:55:49.202903 10854 raft_consensus.cc:2393] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f920959ad42f4f37a2c310cf272d4012 in current term 1: Already voted for candidate 669aa21e7c0b483092cce23f10f25330 in this term.
I20260926 13:55:49.205986 10783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faffe1f667e94043a7f0e88d5675d6a7" candidate_uuid: "f920959ad42f4f37a2c310cf272d4012" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "669aa21e7c0b483092cce23f10f25330"
I20260926 13:55:49.207842 10675 leader_election.cc:304] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f920959ad42f4f37a2c310cf272d4012; no voters: 669aa21e7c0b483092cce23f10f25330, a59bee4e3229456e8b0dd0f194721c44
I20260926 13:55:49.209022 10927 raft_consensus.cc:2749] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260926 13:55:49.223349 10708 raft_consensus.cc:2468] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 669aa21e7c0b483092cce23f10f25330 in term 1.
I20260926 13:55:49.240605 10608 catalog_manager.cc:5838] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 reported cstate change: term changed from 0 to 1, leader changed from <none> to 669aa21e7c0b483092cce23f10f25330 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "669aa21e7c0b483092cce23f10f25330" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:49.241931 10608 catalog_manager.cc:5838] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 reported cstate change: term changed from 0 to 1, leader changed from <none> to 669aa21e7c0b483092cce23f10f25330 (127.3.127.130). New cstate: current_term: 1 leader_uuid: "669aa21e7c0b483092cce23f10f25330" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:49.251096 10606 catalog_manager.cc:5838] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 reported cstate change: term changed from 0 to 1, leader changed from <none> to f920959ad42f4f37a2c310cf272d4012 (127.3.127.129). New cstate: current_term: 1 leader_uuid: "f920959ad42f4f37a2c310cf272d4012" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 } health_report { overall_health: UNKNOWN } } }
I20260926 13:55:49.263013 10908 consensus_queue.cc:1048] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.265973 10908 consensus_queue.cc:1048] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.309124 10946 consensus_queue.cc:1048] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.319355 10908 consensus_queue.cc:1048] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.450497 10908 consensus_queue.cc:1048] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.522447 10944 consensus_queue.cc:1048] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.536444 10944 consensus_queue.cc:1048] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.563194 10956 consensus_queue.cc:1048] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.571105 10944 consensus_queue.cc:1048] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.574714 10951 consensus_queue.cc:1048] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260926 13:55:49.586078 10980 meta_cache.cc:1261] Time spent looking up entry by key: real 0.053s user 0.002s sys 0.000s
W20260926 13:55:49.586112 10983 meta_cache.cc:1261] Time spent looking up entry by key: real 0.055s user 0.000s sys 0.003s
W20260926 13:55:49.593695 10982 meta_cache.cc:1261] Time spent looking up entry by key: real 0.061s user 0.002s sys 0.000s
W20260926 13:55:49.585042 10979 meta_cache.cc:1261] Time spent looking up entry by key: real 0.055s user 0.000s sys 0.004s
W20260926 13:55:49.592924 10891 meta_cache.cc:1261] Time spent looking up entry by key: real 0.062s user 0.002s sys 0.000s
W20260926 13:55:49.594923 10976 meta_cache.cc:1261] Time spent looking up entry by key: real 0.053s user 0.001s sys 0.000s
I20260926 13:55:49.611930 10951 consensus_queue.cc:1048] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.644580 10944 consensus_queue.cc:1048] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.655925 10961 consensus_queue.cc:1048] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.667249 10956 consensus_queue.cc:1048] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.675885 10946 consensus_queue.cc:1048] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f920959ad42f4f37a2c310cf272d4012" member_type: VOTER last_known_addr { host: "127.3.127.129" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260926 13:55:49.689534 10927 consensus_queue.cc:1048] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [LEADER]: Connected to new peer: Peer: permanent_uuid: "669aa21e7c0b483092cce23f10f25330" member_type: VOTER last_known_addr { host: "127.3.127.130" port: 42471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260926 13:55:49.693150 10981 meta_cache.cc:1261] Time spent looking up entry by key: real 0.051s user 0.002s sys 0.000s
I20260926 13:55:49.703699 10951 consensus_queue.cc:1048] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260926 13:55:49.710541 10890 meta_cache.cc:1261] Time spent looking up entry by key: real 0.055s user 0.002s sys 0.000s
W20260926 13:55:49.715536 10979 meta_cache.cc:1261] Time spent looking up entry by key: real 0.062s user 0.000s sys 0.004s
W20260926 13:55:49.724897 10880 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7f20 after lost signal to thread 3585
W20260926 13:55:49.725407 10976 meta_cache.cc:1261] Time spent looking up entry by key: real 0.067s user 0.002s sys 0.001s
W20260926 13:55:49.725862 10880 debug-util.cc:398] Leaking SignalData structure 0x7b080005d1e0 after lost signal to thread 10643
W20260926 13:55:49.727044 10880 debug-util.cc:398] Leaking SignalData structure 0x7b0800186120 after lost signal to thread 10734
W20260926 13:55:49.728019 10880 debug-util.cc:398] Leaking SignalData structure 0x7b08000adf40 after lost signal to thread 10809
W20260926 13:55:49.729430 10880 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac060 after lost signal to thread 10883
W20260926 13:55:49.733033 10975 meta_cache.cc:1261] Time spent looking up entry by key: real 0.073s user 0.001s sys 0.003s
I20260926 13:55:49.759541 10955 consensus_queue.cc:1048] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a59bee4e3229456e8b0dd0f194721c44" member_type: VOTER last_known_addr { host: "127.3.127.131" port: 41409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260926 13:55:49.791471 10890 meta_cache.cc:1261] Time spent looking up entry by key: real 0.050s user 0.000s sys 0.001s
W20260926 13:55:50.424582 10822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:45833, user_credentials={real_user=slave}} blocked reactor thread for 133167us
W20260926 13:55:50.560261 10990 log.cc:927] Time spent T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330: Append to log took a long time: real 0.069s user 0.005s sys 0.003s
W20260926 13:55:50.561761 10967 log.cc:927] Time spent T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330: Append to log took a long time: real 0.073s user 0.001s sys 0.000s
W20260926 13:55:50.684100 11035 log.cc:927] Time spent T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
W20260926 13:55:50.795465 11036 log.cc:927] Time spent T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012: Append to log took a long time: real 0.224s user 0.004s sys 0.002s
W20260926 13:55:50.896252 10748 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:45833, user_credentials={real_user=slave}} blocked reactor thread for 414698us
I20260926 13:55:51.113015 11015 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=41, attempt_no=0}) took 1004 ms. Trace:
I20260926 13:55:51.118786 11015 rpcz_store.cc:276] 0926 13:55:50.107994 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.108106 (+ 112us) service_pool.cc:224] Handling call
0926 13:55:51.112836 (+1004730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.836551 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 848023f09b4b43409266078bcd364325
0926 13:55:50.949267 (+112716us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b540021b7a8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0c2c1c21 00007fdb0c2c088c 00007fdb09cbdf6d 00007fdb09ca92b6 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94
0926 13:55:50.949963 (+ 696us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.951117 (+ 1154us) write_op.cc:435] Acquired schema lock
0926 13:55:50.951983 (+ 866us) tablet.cc:662] Decoding operations
0926 13:55:50.964426 (+ 12443us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.964471 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.964497 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:50.965259 (+ 762us) tablet.cc:701] Row locks acquired
0926 13:55:50.965278 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.965449 (+ 171us) write_op.cc:270] Start()
0926 13:55:50.965615 (+ 166us) write_op.cc:276] Timestamp: P: 1790430950965411 usec, L: 0
0926 13:55:50.965636 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.966153 (+ 517us) log.cc:844] Serialized 821 byte log entry
0926 13:55:50.980968 (+ 14815us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.109766 (+128798us) write_op.cc:301] APPLY: starting
0926 13:55:51.109832 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.110044 (+ 212us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.110065 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.111742 (+ 1677us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.111965 (+ 223us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.112006 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:51.112236 (+ 230us) log.cc:844] Serialized 88 byte log entry
0926 13:55:51.112386 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.112500 (+ 114us) write_op.cc:454] Released schema lock
0926 13:55:51.112545 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":128640,"mutex_wait_us":41886,"num_ops":12,"prepare.queue_time_us":727043,"prepare.run_cpu_time_us":4611,"prepare.run_wall_time_us":129902,"raft.queue_time_us":2375,"raft.run_cpu_time_us":714,"raft.run_wall_time_us":713,"replication_time_us":15212,"spinlock_wait_cycles":78211328}]]}
I20260926 13:55:51.219861 11040 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=68, attempt_no=0}) took 1059 ms. Trace:
I20260926 13:55:51.252939 11040 rpcz_store.cc:276] 0926 13:55:50.159949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.170872 (+ 10923us) service_pool.cc:224] Handling call
0926 13:55:51.219553 (+1048681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.703404 (+ 0us) write_op.cc:183] PREPARE: starting on tablet d39e03afe6704e7bba77f0941dc30643
0926 13:55:50.703881 (+ 477us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.703910 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:50.703935 (+ 25us) tablet.cc:662] Decoding operations
0926 13:55:50.704693 (+ 758us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.710805 (+ 6112us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.726997 (+ 16192us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:50.737404 (+ 10407us) tablet.cc:701] Row locks acquired
0926 13:55:50.737425 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:50.737592 (+ 167us) write_op.cc:270] Start()
0926 13:55:50.737696 (+ 104us) write_op.cc:276] Timestamp: P: 1790430950737551 usec, L: 0
0926 13:55:50.737716 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.738342 (+ 626us) log.cc:844] Serialized 821 byte log entry
0926 13:55:50.918450 (+180108us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.058139 (+139689us) write_op.cc:301] APPLY: starting
0926 13:55:51.058211 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.058434 (+ 223us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.058529 (+ 95us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.060148 (+ 1619us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.060347 (+ 199us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.060388 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:51.060637 (+ 249us) log.cc:844] Serialized 88 byte log entry
0926 13:55:51.218384 (+157747us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b60005a9dc8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09bdd1a1 00007fdb09d4dfb5 00007fdb09d4ff64 00007fdb09cbe683 00007fdb09cbfad6 00007fdb09cbf53c 00007fdb09cab599 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9
0926 13:55:51.218497 (+ 113us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.218720 (+ 223us) write_op.cc:454] Released schema lock
0926 13:55:51.218830 (+ 110us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":139552,"num_ops":12,"prepare.queue_time_us":531222,"prepare.run_cpu_time_us":3416,"prepare.run_wall_time_us":35187,"replication_time_us":180639,"spinlock_wait_cycles":11737344}]]}
W20260926 13:55:51.260936 10890 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.130:42471, user_credentials={real_user=slave}} blocked reactor thread for 73414.5us
W20260926 13:55:51.293217 10889 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.131:41409, user_credentials={real_user=slave}} blocked reactor thread for 109359us
I20260926 13:55:51.318394 11011 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=82, attempt_no=0}) took 1006 ms. Trace:
I20260926 13:55:51.327626 11009 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=74, attempt_no=0}) took 1017 ms. Trace:
I20260926 13:55:51.337105 11008 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=22, attempt_no=0}) took 1348 ms. Trace:
I20260926 13:55:51.356483 11042 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=45, attempt_no=0}) took 1355 ms. Trace:
I20260926 13:55:51.367833 11042 rpcz_store.cc:276] 0926 13:55:50.000840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.000962 (+ 122us) service_pool.cc:224] Handling call
0926 13:55:51.356275 (+1355313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.828216 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:50.828656 (+ 440us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.828680 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:50.828692 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:50.844540 (+ 15848us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.844584 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.844610 (+ 26us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:50.845195 (+ 585us) tablet.cc:701] Row locks acquired
0926 13:55:50.845210 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:50.845352 (+ 142us) write_op.cc:270] Start()
0926 13:55:50.845476 (+ 124us) write_op.cc:276] Timestamp: P: 1790430950845314 usec, L: 0
0926 13:55:50.845497 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.846013 (+ 516us) log.cc:844] Serialized 692 byte log entry
0926 13:55:50.980465 (+134452us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.344273 (+363808us) write_op.cc:301] APPLY: starting
0926 13:55:51.344392 (+ 119us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.344645 (+ 253us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.344770 (+ 125us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.354992 (+ 10222us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.355178 (+ 186us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.355221 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:51.355466 (+ 245us) log.cc:844] Serialized 70 byte log entry
0926 13:55:51.355659 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.355849 (+ 190us) write_op.cc:454] Released schema lock
0926 13:55:51.355893 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":363588,"num_ops":9,"prepare.queue_time_us":825950,"prepare.run_cpu_time_us":2890,"prepare.run_wall_time_us":45176,"replication_time_us":134873}]]}
I20260926 13:55:51.328132 11009 rpcz_store.cc:276] 0926 13:55:50.310477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.312814 (+ 2337us) service_pool.cc:224] Handling call
0926 13:55:51.327409 (+1014595us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.782124 (+ 0us) write_op.cc:183] PREPARE: starting on tablet fe33aee2fd874d14ab467dba7cf2cfe0
0926 13:55:50.788708 (+ 6584us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.788738 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:50.788980 (+ 242us) tablet.cc:662] Decoding operations
0926 13:55:50.833758 (+ 44778us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.833797 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.833826 (+ 29us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:50.834587 (+ 761us) tablet.cc:701] Row locks acquired
0926 13:55:50.834607 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:50.834760 (+ 153us) write_op.cc:270] Start()
0926 13:55:50.834877 (+ 117us) write_op.cc:276] Timestamp: P: 1790430950834717 usec, L: 0
0926 13:55:50.834896 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.873814 (+ 38918us) log.cc:844] Serialized 864 byte log entry
0926 13:55:50.944014 (+ 70200us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b540066ce54. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:50.990041 (+ 46027us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.213915 (+223874us) write_op.cc:301] APPLY: starting
0926 13:55:51.214086 (+ 171us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.214489 (+ 403us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.214516 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.222924 (+ 8408us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.223309 (+ 385us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.223359 (+ 50us) write_op.cc:312] APPLY: finished
0926 13:55:51.223668 (+ 309us) log.cc:844] Serialized 94 byte log entry
0926 13:55:51.326634 (+102966us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.326891 (+ 257us) write_op.cc:454] Released schema lock
0926 13:55:51.326961 (+ 70us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":223561,"num_ops":13,"prepare.queue_time_us":466829,"prepare.run_cpu_time_us":6653,"prepare.run_wall_time_us":162647,"replication_time_us":155040,"spinlock_wait_cycles":88295680}]]}
I20260926 13:55:51.375542 11043 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=87, attempt_no=0}) took 1063 ms. Trace:
I20260926 13:55:51.376024 11043 rpcz_store.cc:276] 0926 13:55:50.312321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.314102 (+ 1781us) service_pool.cc:224] Handling call
0926 13:55:51.375306 (+1061204us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.944302 (+ 0us) write_op.cc:183] PREPARE: starting on tablet fe33aee2fd874d14ab467dba7cf2cfe0
0926 13:55:50.944771 (+ 469us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.944797 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:50.944815 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:50.945535 (+ 720us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.945578 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.945603 (+ 25us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:50.946223 (+ 620us) tablet.cc:701] Row locks acquired
0926 13:55:50.946242 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.946401 (+ 159us) write_op.cc:270] Start()
0926 13:55:50.946503 (+ 102us) write_op.cc:276] Timestamp: P: 1790430950946352 usec, L: 0
0926 13:55:50.946519 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.947051 (+ 532us) log.cc:844] Serialized 778 byte log entry
0926 13:55:50.990275 (+ 43224us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.229372 (+239097us) write_op.cc:301] APPLY: starting
0926 13:55:51.229561 (+ 189us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.229919 (+ 358us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.230062 (+ 143us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.231953 (+ 1891us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.232328 (+ 375us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.232393 (+ 65us) write_op.cc:312] APPLY: finished
0926 13:55:51.232718 (+ 325us) log.cc:844] Serialized 82 byte log entry
0926 13:55:51.347579 (+114861us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.374894 (+ 27315us) write_op.cc:454] Released schema lock
0926 13:55:51.374946 (+ 52us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":238889,"num_ops":11,"prepare.queue_time_us":628922,"prepare.run_cpu_time_us":3023,"prepare.run_wall_time_us":5668,"replication_time_us":43667}]]}
I20260926 13:55:51.318976 11011 rpcz_store.cc:276] 0926 13:55:50.311693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.315417 (+ 3724us) service_pool.cc:224] Handling call
0926 13:55:51.318157 (+1002740us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.746494 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 212603e16fe2480aac71d2ac21eefb26
0926 13:55:50.753335 (+ 6841us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.753359 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:50.753375 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.754039 (+ 664us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.754078 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.754104 (+ 26us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:50.754626 (+ 522us) tablet.cc:701] Row locks acquired
0926 13:55:50.754645 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.754799 (+ 154us) write_op.cc:270] Start()
0926 13:55:50.754911 (+ 112us) write_op.cc:276] Timestamp: P: 1790430950754756 usec, L: 0
0926 13:55:50.754940 (+ 29us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.837020 (+ 82080us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54001f3c20. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:50.837564 (+ 544us) log.cc:844] Serialized 692 byte log entry
0926 13:55:50.975586 (+138022us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.130346 (+154760us) write_op.cc:301] APPLY: starting
0926 13:55:51.130393 (+ 47us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.130582 (+ 189us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.130601 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.244600 (+113999us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.316804 (+ 72204us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.316859 (+ 55us) write_op.cc:312] APPLY: finished
0926 13:55:51.317198 (+ 339us) log.cc:844] Serialized 70 byte log entry
0926 13:55:51.317471 (+ 273us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.317633 (+ 162us) write_op.cc:454] Released schema lock
0926 13:55:51.317699 (+ 66us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":154616,"num_ops":9,"prepare.queue_time_us":379921,"prepare.run_cpu_time_us":4057,"prepare.run_wall_time_us":96692,"replication_time_us":220549,"spinlock_wait_cycles":82381568}]]}
W20260926 13:55:51.391264 10890 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.130:42471, user_credentials={real_user=slave}} blocked reactor thread for 63286.5us
I20260926 13:55:51.412977 11007 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=69, attempt_no=0}) took 1037 ms. Trace:
I20260926 13:55:51.415203 11007 rpcz_store.cc:276] 0926 13:55:50.309476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.316821 (+ 7345us) service_pool.cc:224] Handling call
0926 13:55:51.342599 (+1025778us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.841444 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1f03301b2d10417296862fd5eeaf87e1
0926 13:55:50.841868 (+ 424us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.841910 (+ 42us) write_op.cc:435] Acquired schema lock
0926 13:55:50.841926 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.842688 (+ 762us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.842734 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.842760 (+ 26us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:50.843476 (+ 716us) tablet.cc:701] Row locks acquired
0926 13:55:50.843495 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.843637 (+ 142us) write_op.cc:270] Start()
0926 13:55:50.843733 (+ 96us) write_op.cc:276] Timestamp: P: 1790430950843597 usec, L: 0
0926 13:55:50.843749 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.963503 (+119754us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b54003f55a0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb0979aa50 00007fdb09824302 00007fdb09819727 00007fdb09819564 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11
0926 13:55:50.964048 (+ 545us) log.cc:844] Serialized 821 byte log entry
0926 13:55:51.016065 (+ 52017us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.301296 (+285231us) write_op.cc:301] APPLY: starting
0926 13:55:51.301429 (+ 133us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.301778 (+ 349us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.301794 (+ 16us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.303778 (+ 1984us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.304156 (+ 378us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.304217 (+ 61us) write_op.cc:312] APPLY: finished
0926 13:55:51.304546 (+ 329us) log.cc:844] Serialized 88 byte log entry
0926 13:55:51.305312 (+ 766us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.305663 (+ 351us) write_op.cc:454] Released schema lock
0926 13:55:51.305707 (+ 44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":284999,"num_ops":12,"prepare.queue_time_us":521822,"prepare.run_cpu_time_us":4647,"prepare.run_wall_time_us":124028,"replication_time_us":172209,"spinlock_wait_cycles":88344448}]]}
I20260926 13:55:51.337553 11008 rpcz_store.cc:276] 0926 13:55:49.988333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:49.988828 (+ 495us) service_pool.cc:224] Handling call
0926 13:55:51.336879 (+1348051us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.151564 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:50.152003 (+ 439us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.152035 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:50.152046 (+ 11us) tablet.cc:662] Decoding operations
0926 13:55:50.198081 (+ 46035us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.198839 (+ 758us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.205898 (+ 7059us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:50.218319 (+ 12421us) tablet.cc:701] Row locks acquired
0926 13:55:50.218339 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:50.614481 (+396142us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b2c001aae78. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb074ecc91 00007fdb074fbc8a 00007fdb074fb913 00007fdb074fb8b1 00007fdb098590c2 00007fdb09858e9d 00007fdb09ca9453 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49
0926 13:55:50.614549 (+ 68us) write_op.cc:270] Start()
0926 13:55:50.614736 (+ 187us) write_op.cc:276] Timestamp: P: 1790430950227692 usec, L: 0
0926 13:55:50.614758 (+ 22us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.705059 (+ 90301us) log.cc:844] Serialized 778 byte log entry
0926 13:55:50.785417 (+ 80358us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54002aa654. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:50.979976 (+194559us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.297145 (+317169us) write_op.cc:301] APPLY: starting
0926 13:55:51.297253 (+ 108us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.297579 (+ 326us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.297598 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.299202 (+ 1604us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.299649 (+ 447us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.299689 (+ 40us) write_op.cc:312] APPLY: finished
0926 13:55:51.299954 (+ 265us) log.cc:844] Serialized 82 byte log entry
0926 13:55:51.300188 (+ 234us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.300366 (+ 178us) write_op.cc:454] Released schema lock
0926 13:55:51.300411 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":316892,"num_ops":11,"prepare.queue_time_us":161299,"prepare.run_cpu_time_us":8600,"prepare.run_wall_time_us":634006,"replication_time_us":365103,"spinlock_wait_cycles":162054272}]]}
I20260926 13:55:51.474547 11009 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=76, attempt_no=0}) took 1163 ms. Trace:
I20260926 13:55:51.479502 11006 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=36, attempt_no=0}) took 1485 ms. Trace:
I20260926 13:55:51.490160 10854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42142 (request call id 20) took 1047 ms. Trace:
W20260926 13:55:51.483084 10889 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.131:41409, user_credentials={real_user=slave}} blocked reactor thread for 153011us
I20260926 13:55:51.490869 11006 rpcz_store.cc:276] 0926 13:55:49.994246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:49.994383 (+ 137us) service_pool.cc:224] Handling call
0926 13:55:51.479299 (+1484916us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.788475 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:50.824857 (+ 36382us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.824889 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:50.824906 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:50.826004 (+ 1098us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.826050 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.826077 (+ 27us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:50.827033 (+ 956us) tablet.cc:701] Row locks acquired
0926 13:55:50.827049 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:50.827209 (+ 160us) write_op.cc:270] Start()
0926 13:55:50.827304 (+ 95us) write_op.cc:276] Timestamp: P: 1790430950827167 usec, L: 0
0926 13:55:50.827323 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.827847 (+ 524us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:50.980239 (+152392us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.403066 (+422827us) write_op.cc:301] APPLY: starting
0926 13:55:51.440050 (+ 36984us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.440460 (+ 410us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.440551 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.442784 (+ 2233us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.443034 (+ 250us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.443075 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:51.443379 (+ 304us) log.cc:844] Serialized 124 byte log entry
0926 13:55:51.478641 (+ 35262us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.478968 (+ 327us) write_op.cc:454] Released schema lock
0926 13:55:51.479022 (+ 54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":362663,"num_ops":18,"prepare.queue_time_us":792814,"prepare.run_cpu_time_us":3723,"prepare.run_wall_time_us":39597,"replication_time_us":152824}]]}
I20260926 13:55:51.490132 11009 rpcz_store.cc:276] 0926 13:55:50.311105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.311463 (+ 358us) service_pool.cc:224] Handling call
0926 13:55:51.474467 (+1163004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.825124 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 3926163f8af4418f926fa759704c2c76
0926 13:55:50.825566 (+ 442us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.825596 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:50.825613 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:50.826692 (+ 1079us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.826731 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.826762 (+ 31us) tablet.cc:685] Acquiring locks for 19 operations
0926 13:55:50.827750 (+ 988us) tablet.cc:701] Row locks acquired
0926 13:55:50.827770 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:50.827919 (+ 149us) write_op.cc:270] Start()
0926 13:55:50.828012 (+ 93us) write_op.cc:276] Timestamp: P: 1790430950827872 usec, L: 0
0926 13:55:50.828031 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.948819 (+120788us) log.cc:844] Serialized 1122 byte log entry
0926 13:55:51.013917 (+ 65098us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b18003164e0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb02db6492 00007fdb02db8751 00007fdb02db8709 00007fdb02db8699 00007fdb02db8661 00007fdb02db795d 000000000041fb94 000000000041f9d9 00007fdb02d9981a
0926 13:55:51.017904 (+ 3987us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b18003164e0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb09caa62d 00007fdb09cac92a 00007fdb09cac8b8 00007fdb09cac838 00007fdb09cac7f3 00007fdb09caba0c 00007fdb0bd6fdb6 00007fdb0bd6a568 00007fdb09829ad0
0926 13:55:51.017945 (+ 41us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.029018 (+ 11073us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b18003164e0. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0bce0b81 00007fdb0bced571 00007fdb02db6492 00007fdb02db8751 00007fdb02db8709 00007fdb02db8699 00007fdb02db8661 00007fdb02db795d 000000000041fb94 000000000041f9d9 00007fdb02d9981a
0926 13:55:51.376463 (+347445us) write_op.cc:301] APPLY: starting
0926 13:55:51.376634 (+ 171us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.377083 (+ 449us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.377103 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.472790 (+ 95687us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.473127 (+ 337us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.473170 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:51.473554 (+ 384us) log.cc:844] Serialized 131 byte log entry
0926 13:55:51.473759 (+ 205us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.474067 (+ 308us) write_op.cc:454] Released schema lock
0926 13:55:51.474115 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":358334,"num_ops":19,"prepare.queue_time_us":503343,"prepare.run_cpu_time_us":4146,"prepare.run_wall_time_us":127612,"raft.queue_time_us":1572,"raft.run_cpu_time_us":747,"raft.run_wall_time_us":1871,"replication_time_us":146066,"spinlock_wait_cycles":202769280}]]}
I20260926 13:55:51.547927 11038 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=99, attempt_no=0}) took 1350 ms. Trace:
I20260926 13:55:51.555291 11015 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=73, attempt_no=0}) took 1382 ms. Trace:
I20260926 13:55:51.569263 11015 rpcz_store.cc:276] 0926 13:55:50.172877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.174279 (+ 1402us) service_pool.cc:224] Handling call
0926 13:55:51.555118 (+1380839us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.789576 (+ 0us) write_op.cc:183] PREPARE: starting on tablet d39e03afe6704e7bba77f0941dc30643
0926 13:55:50.790049 (+ 473us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.790087 (+ 38us) write_op.cc:435] Acquired schema lock
0926 13:55:50.790099 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:50.912919 (+122820us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.912962 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.912987 (+ 25us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:50.913835 (+ 848us) tablet.cc:701] Row locks acquired
0926 13:55:50.913850 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:51.038417 (+124567us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b3400071db8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.038525 (+ 108us) write_op.cc:270] Start()
0926 13:55:51.038703 (+ 178us) write_op.cc:276] Timestamp: P: 1790430951038488 usec, L: 0
0926 13:55:51.038721 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.039286 (+ 565us) log.cc:844] Serialized 950 byte log entry
0926 13:55:51.272362 (+233076us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.549980 (+277618us) write_op.cc:301] APPLY: starting
0926 13:55:51.550082 (+ 102us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.550482 (+ 400us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.550503 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.552665 (+ 2162us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.553039 (+ 374us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.553087 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:51.553396 (+ 309us) log.cc:844] Serialized 106 byte log entry
0926 13:55:51.554513 (+ 1117us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.554704 (+ 191us) write_op.cc:454] Released schema lock
0926 13:55:51.554760 (+ 56us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":277401,"num_ops":15,"prepare.queue_time_us":596362,"prepare.run_cpu_time_us":4824,"prepare.run_wall_time_us":252067,"raft.queue_time_us":92,"raft.run_cpu_time_us":700,"raft.run_wall_time_us":706,"replication_time_us":233398,"spinlock_wait_cycles":48087936}]]}
I20260926 13:55:51.572531 11011 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=83, attempt_no=0}) took 1260 ms. Trace:
I20260926 13:55:51.573210 11011 rpcz_store.cc:276] 0926 13:55:50.312021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.314243 (+ 2222us) service_pool.cc:224] Handling call
0926 13:55:51.572461 (+1258218us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.822978 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 8c7a95df58a742a69e1cface7c9d6e36
0926 13:55:50.823397 (+ 419us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.823421 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:50.823437 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.824453 (+ 1016us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.824494 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.824520 (+ 26us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:50.825572 (+ 1052us) tablet.cc:701] Row locks acquired
0926 13:55:50.825591 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.825731 (+ 140us) write_op.cc:270] Start()
0926 13:55:50.825818 (+ 87us) write_op.cc:276] Timestamp: P: 1790430950825692 usec, L: 0
0926 13:55:50.825839 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.867332 (+ 41493us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:51.005905 (+138573us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54007da354. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.264601 (+258696us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.542966 (+278365us) write_op.cc:301] APPLY: starting
0926 13:55:51.543051 (+ 85us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.543476 (+ 425us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.543506 (+ 30us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.561156 (+ 17650us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.561464 (+ 308us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.561500 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:51.561746 (+ 246us) log.cc:844] Serialized 124 byte log entry
0926 13:55:51.571746 (+ 10000us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.572074 (+ 328us) write_op.cc:454] Released schema lock
0926 13:55:51.572130 (+ 56us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":14720,"child_traces":[["op",{"apply.queue_time_us":278131,"mutex_wait_us":13827,"num_ops":18,"prepare.queue_time_us":363304,"prepare.run_cpu_time_us":5275,"prepare.run_wall_time_us":183157,"raft.queue_time_us":8052,"raft.run_cpu_time_us":714,"raft.run_wall_time_us":715,"replication_time_us":438427,"spinlock_wait_cycles":94206720}]]}
I20260926 13:55:51.565500 11010 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=56, attempt_no=0}) took 1426 ms. Trace:
I20260926 13:55:51.569200 11038 rpcz_store.cc:276] 0926 13:55:50.197133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.198762 (+ 1629us) service_pool.cc:224] Handling call
0926 13:55:51.547740 (+1348978us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.777649 (+ 0us) write_op.cc:183] PREPARE: starting on tablet faffe1f667e94043a7f0e88d5675d6a7
0926 13:55:50.778078 (+ 429us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.778103 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:50.778118 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:50.778934 (+ 816us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.778972 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.779001 (+ 29us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:50.853933 (+ 74932us) tablet.cc:701] Row locks acquired
0926 13:55:50.853955 (+ 22us) write_op.cc:260] PREPARE: finished
0926 13:55:51.001592 (+147637us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b3400071db8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.001699 (+ 107us) write_op.cc:270] Start()
0926 13:55:51.001898 (+ 199us) write_op.cc:276] Timestamp: P: 1790430951001660 usec, L: 0
0926 13:55:51.001922 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.002458 (+ 536us) log.cc:844] Serialized 950 byte log entry
0926 13:55:51.198809 (+196351us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.529478 (+330669us) write_op.cc:301] APPLY: starting
0926 13:55:51.529579 (+ 101us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.529926 (+ 347us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.529947 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.532451 (+ 2504us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.536268 (+ 3817us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.536312 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:51.536587 (+ 275us) log.cc:844] Serialized 106 byte log entry
0926 13:55:51.547105 (+ 10518us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.547344 (+ 239us) write_op.cc:454] Released schema lock
0926 13:55:51.547391 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":330448,"num_ops":15,"prepare.queue_time_us":516739,"prepare.run_cpu_time_us":5077,"prepare.run_wall_time_us":225034,"replication_time_us":196594,"spinlock_wait_cycles":170127104}]]}
I20260926 13:55:51.587425 11007 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=90, attempt_no=0}) took 1238 ms. Trace:
I20260926 13:55:51.590051 11009 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=94, attempt_no=0}) took 1225 ms. Trace:
I20260926 13:55:51.587867 11007 rpcz_store.cc:276] 0926 13:55:50.355195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.357185 (+ 1990us) service_pool.cc:224] Handling call
0926 13:55:51.587335 (+1230150us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.965624 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 1f03301b2d10417296862fd5eeaf87e1
0926 13:55:50.966065 (+ 441us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.966095 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:50.966106 (+ 11us) tablet.cc:662] Decoding operations
0926 13:55:50.966672 (+ 566us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.966712 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.966736 (+ 24us) tablet.cc:685] Acquiring locks for 7 operations
0926 13:55:50.967162 (+ 426us) tablet.cc:701] Row locks acquired
0926 13:55:50.967180 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:51.061649 (+ 94469us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.061758 (+ 109us) write_op.cc:270] Start()
0926 13:55:51.061932 (+ 174us) write_op.cc:276] Timestamp: P: 1790430951061720 usec, L: 0
0926 13:55:51.061966 (+ 34us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.062481 (+ 515us) log.cc:844] Serialized 605 byte log entry
0926 13:55:51.292296 (+229815us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.578965 (+286669us) write_op.cc:301] APPLY: starting
0926 13:55:51.579046 (+ 81us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.579235 (+ 189us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.579255 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.580253 (+ 998us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.580484 (+ 231us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.580541 (+ 57us) write_op.cc:312] APPLY: finished
0926 13:55:51.582106 (+ 1565us) log.cc:844] Serialized 58 byte log entry
0926 13:55:51.582767 (+ 661us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.582911 (+ 144us) write_op.cc:454] Released schema lock
0926 13:55:51.583955 (+ 1044us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":286501,"mutex_wait_us":16764,"num_ops":7,"prepare.queue_time_us":602591,"prepare.run_cpu_time_us":6198,"prepare.run_wall_time_us":98218,"raft.queue_time_us":78,"raft.run_cpu_time_us":665,"raft.run_wall_time_us":733,"replication_time_us":230124,"spinlock_wait_cycles":45612416}]]}
I20260926 13:55:51.581493 11010 rpcz_store.cc:276] 0926 13:55:50.138787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.138884 (+ 97us) service_pool.cc:224] Handling call
0926 13:55:51.565326 (+1426442us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.008534 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 848023f09b4b43409266078bcd364325
0926 13:55:51.008990 (+ 456us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.009017 (+ 27us) write_op.cc:435] Acquired schema lock
0926 13:55:51.009029 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:51.018695 (+ 9666us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.018740 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.018766 (+ 26us) tablet.cc:685] Acquiring locks for 6 operations
0926 13:55:51.019769 (+ 1003us) tablet.cc:701] Row locks acquired
0926 13:55:51.019790 (+ 21us) write_op.cc:260] PREPARE: finished
0926 13:55:51.019938 (+ 148us) write_op.cc:270] Start()
0926 13:55:51.020050 (+ 112us) write_op.cc:276] Timestamp: P: 1790430951019905 usec, L: 0
0926 13:55:51.020069 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.020596 (+ 527us) log.cc:844] Serialized 562 byte log entry
0926 13:55:51.256309 (+235713us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.544815 (+288506us) write_op.cc:301] APPLY: starting
0926 13:55:51.544932 (+ 117us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.562610 (+ 17678us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.562716 (+ 106us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.563566 (+ 850us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.563848 (+ 282us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.563890 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:51.564090 (+ 200us) log.cc:844] Serialized 52 byte log entry
0926 13:55:51.564829 (+ 739us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.564954 (+ 125us) write_op.cc:454] Released schema lock
0926 13:55:51.564992 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":288285,"num_ops":6,"prepare.queue_time_us":867491,"prepare.run_cpu_time_us":2728,"prepare.run_wall_time_us":13373,"raft.queue_time_us":107,"raft.run_cpu_time_us":687,"raft.run_wall_time_us":686,"replication_time_us":235912}]]}
I20260926 13:55:51.594904 11015 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=88, attempt_no=0}) took 1415 ms. Trace:
I20260926 13:55:51.595321 11015 rpcz_store.cc:276] 0926 13:55:50.179156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.181177 (+ 2021us) service_pool.cc:224] Handling call
0926 13:55:51.594824 (+1413647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.041757 (+ 0us) write_op.cc:183] PREPARE: starting on tablet d39e03afe6704e7bba77f0941dc30643
0926 13:55:51.042203 (+ 446us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.042228 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:51.042244 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:51.042969 (+ 725us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.043013 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.043039 (+ 26us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:51.043684 (+ 645us) tablet.cc:701] Row locks acquired
0926 13:55:51.043700 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:51.043841 (+ 141us) write_op.cc:270] Start()
0926 13:55:51.043936 (+ 95us) write_op.cc:276] Timestamp: P: 1790430951043805 usec, L: 0
0926 13:55:51.043967 (+ 31us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.044498 (+ 531us) log.cc:844] Serialized 778 byte log entry
0926 13:55:51.387756 (+343258us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.580320 (+192564us) write_op.cc:301] APPLY: starting
0926 13:55:51.580409 (+ 89us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.583653 (+ 3244us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.584781 (+ 1128us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.592889 (+ 8108us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.593161 (+ 272us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.593203 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:51.593454 (+ 251us) log.cc:844] Serialized 82 byte log entry
0926 13:55:51.594220 (+ 766us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.594441 (+ 221us) write_op.cc:454] Released schema lock
0926 13:55:51.594484 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":192363,"mutex_wait_us":57797,"num_ops":11,"prepare.queue_time_us":859234,"prepare.run_cpu_time_us":2982,"prepare.run_wall_time_us":28081,"replication_time_us":343588}]]}
I20260926 13:55:51.598843 11007 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=55, attempt_no=0}) took 1346 ms. Trace:
I20260926 13:55:51.599283 11007 rpcz_store.cc:276] 0926 13:55:50.252009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.255168 (+ 3159us) service_pool.cc:224] Handling call
0926 13:55:50.604495 (+349327us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:51.598767 (+994272us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.091097 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 3926163f8af4418f926fa759704c2c76
0926 13:55:51.091522 (+ 425us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.091546 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:51.091561 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:51.092711 (+ 1150us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.093413 (+ 702us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.093893 (+ 480us) tablet.cc:685] Acquiring locks for 21 operations
0926 13:55:51.095299 (+ 1406us) tablet.cc:701] Row locks acquired
0926 13:55:51.095317 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:51.095455 (+ 138us) write_op.cc:270] Start()
0926 13:55:51.095562 (+ 107us) write_op.cc:276] Timestamp: P: 1790430951095413 usec, L: 0
0926 13:55:51.095583 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.096101 (+ 518us) log.cc:844] Serialized 1208 byte log entry
0926 13:55:51.297425 (+201324us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.593915 (+296490us) write_op.cc:301] APPLY: starting
0926 13:55:51.594002 (+ 87us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.594388 (+ 386us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.594449 (+ 61us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.596773 (+ 2324us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.597018 (+ 245us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.597062 (+ 44us) write_op.cc:312] APPLY: finished
0926 13:55:51.597386 (+ 324us) log.cc:844] Serialized 144 byte log entry
0926 13:55:51.598068 (+ 682us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.598366 (+ 298us) write_op.cc:454] Released schema lock
0926 13:55:51.598420 (+ 54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":50296064,"child_traces":[["op",{"apply.queue_time_us":296321,"num_ops":21,"prepare.queue_time_us":485425,"prepare.run_cpu_time_us":3819,"prepare.run_wall_time_us":5205,"replication_time_us":201687}]]}
I20260926 13:55:51.603349 11043 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=60, attempt_no=0}) took 1350 ms. Trace:
W20260926 13:55:51.600736 10889 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.131:41409, user_credentials={real_user=slave}} blocked reactor thread for 44028.9us
I20260926 13:55:51.606822 11011 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=96, attempt_no=0}) took 1241 ms. Trace:
I20260926 13:55:51.607235 11011 rpcz_store.cc:276] 0926 13:55:50.365654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.370637 (+ 4983us) service_pool.cc:224] Handling call
0926 13:55:51.606741 (+1236104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.056863 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 3926163f8af4418f926fa759704c2c76
0926 13:55:51.057306 (+ 443us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.057335 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:51.057351 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:51.058103 (+ 752us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.058149 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.058181 (+ 32us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:51.058894 (+ 713us) tablet.cc:701] Row locks acquired
0926 13:55:51.058912 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:51.081017 (+ 22105us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.084006 (+ 2989us) write_op.cc:270] Start()
0926 13:55:51.086378 (+ 2372us) write_op.cc:276] Timestamp: P: 1790430951083962 usec, L: 0
0926 13:55:51.086403 (+ 25us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.086932 (+ 529us) log.cc:844] Serialized 821 byte log entry
0926 13:55:51.278357 (+191425us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.577136 (+298779us) write_op.cc:301] APPLY: starting
0926 13:55:51.577227 (+ 91us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.577480 (+ 253us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.577499 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.578843 (+ 1344us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.579019 (+ 176us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.579054 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:51.579257 (+ 203us) log.cc:844] Serialized 88 byte log entry
0926 13:55:51.582240 (+ 2983us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.591155 (+ 8915us) write_op.cc:454] Released schema lock
0926 13:55:51.591180 (+ 25us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":298582,"num_ops":12,"prepare.queue_time_us":657354,"prepare.run_cpu_time_us":4120,"prepare.run_wall_time_us":31435,"raft.queue_time_us":233,"raft.run_cpu_time_us":1394,"raft.run_wall_time_us":1392,"replication_time_us":191737,"spinlock_wait_cycles":37587584}]]}
I20260926 13:55:51.611239 11007 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=53, attempt_no=0}) took 1359 ms. Trace:
I20260926 13:55:51.590312 11009 rpcz_store.cc:276] 0926 13:55:50.364975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.392966 (+ 27991us) service_pool.cc:224] Handling call
0926 13:55:51.586680 (+1193714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.018730 (+ 0us) write_op.cc:183] PREPARE: starting on tablet fe33aee2fd874d14ab467dba7cf2cfe0
0926 13:55:51.019177 (+ 447us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.019211 (+ 34us) write_op.cc:435] Acquired schema lock
0926 13:55:51.019223 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:51.019975 (+ 752us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.020016 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.020042 (+ 26us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:51.020809 (+ 767us) tablet.cc:701] Row locks acquired
0926 13:55:51.020827 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:51.069242 (+ 48415us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.069342 (+ 100us) write_op.cc:270] Start()
0926 13:55:51.069522 (+ 180us) write_op.cc:276] Timestamp: P: 1790430951069305 usec, L: 0
0926 13:55:51.069546 (+ 24us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.070084 (+ 538us) log.cc:844] Serialized 864 byte log entry
0926 13:55:51.277728 (+207644us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.549067 (+271339us) write_op.cc:301] APPLY: starting
0926 13:55:51.549153 (+ 86us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.549463 (+ 310us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.549487 (+ 24us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.551199 (+ 1712us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.551386 (+ 187us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.551420 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:51.551635 (+ 215us) log.cc:844] Serialized 94 byte log entry
0926 13:55:51.581890 (+ 30255us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.583874 (+ 1984us) write_op.cc:454] Released schema lock
0926 13:55:51.583914 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":271158,"mutex_wait_us":8440,"num_ops":13,"prepare.queue_time_us":558535,"prepare.run_cpu_time_us":4310,"prepare.run_wall_time_us":119510,"raft.queue_time_us":1043,"raft.run_cpu_time_us":1381,"raft.run_wall_time_us":1381,"replication_time_us":207973,"spinlock_wait_cycles":110142848}]]}
I20260926 13:55:51.611702 11007 rpcz_store.cc:276] 0926 13:55:50.251643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.255122 (+ 3479us) service_pool.cc:224] Handling call
0926 13:55:50.588372 (+333250us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:51.611165 (+1022793us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.006851 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 212603e16fe2480aac71d2ac21eefb26
0926 13:55:51.007304 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.007334 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:51.007351 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:51.008169 (+ 818us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.008217 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.008244 (+ 27us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:51.016599 (+ 8355us) tablet.cc:701] Row locks acquired
0926 13:55:51.016619 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:51.064434 (+ 47815us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6c14 00007fdb09ca93c5 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.064540 (+ 106us) write_op.cc:270] Start()
0926 13:55:51.064707 (+ 167us) write_op.cc:276] Timestamp: P: 1790430951064503 usec, L: 0
0926 13:55:51.064725 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.065347 (+ 622us) log.cc:844] Serialized 907 byte log entry
0926 13:55:51.349924 (+284577us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.607143 (+257219us) write_op.cc:301] APPLY: starting
0926 13:55:51.607230 (+ 87us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.607562 (+ 332us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.607588 (+ 26us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.609434 (+ 1846us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.609638 (+ 204us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.609681 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:51.609946 (+ 265us) log.cc:844] Serialized 100 byte log entry
0926 13:55:51.610627 (+ 681us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.610811 (+ 184us) write_op.cc:454] Released schema lock
0926 13:55:51.610857 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":15744896,"child_traces":[["op",{"apply.queue_time_us":257039,"mutex_wait_us":15047,"num_ops":14,"prepare.queue_time_us":417298,"prepare.run_cpu_time_us":4596,"prepare.run_wall_time_us":58784,"raft.queue_time_us":3493,"raft.run_cpu_time_us":659,"raft.run_wall_time_us":659,"replication_time_us":285007,"spinlock_wait_cycles":108414848}]]}
I20260926 13:55:51.599948 11010 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=93, attempt_no=0}) took 1403 ms. Trace:
I20260926 13:55:51.616638 11010 rpcz_store.cc:276] 0926 13:55:50.196795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.198961 (+ 2166us) service_pool.cc:224] Handling call
0926 13:55:50.593569 (+394608us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b3400071db8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:51.599876 (+1006307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.074645 (+ 0us) write_op.cc:183] PREPARE: starting on tablet d39e03afe6704e7bba77f0941dc30643
0926 13:55:51.075793 (+ 1148us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.076239 (+ 446us) write_op.cc:435] Acquired schema lock
0926 13:55:51.080889 (+ 4650us) tablet.cc:662] Decoding operations
0926 13:55:51.087718 (+ 6829us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.087762 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.087788 (+ 26us) tablet.cc:685] Acquiring locks for 15 operations
0926 13:55:51.088665 (+ 877us) tablet.cc:701] Row locks acquired
0926 13:55:51.088685 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:51.090086 (+ 1401us) write_op.cc:270] Start()
0926 13:55:51.090182 (+ 96us) write_op.cc:276] Timestamp: P: 1790430951090046 usec, L: 0
0926 13:55:51.090199 (+ 17us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.090732 (+ 533us) log.cc:844] Serialized 950 byte log entry
0926 13:55:51.446520 (+355788us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.596092 (+149572us) write_op.cc:301] APPLY: starting
0926 13:55:51.596173 (+ 81us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.596529 (+ 356us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.596615 (+ 86us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.598599 (+ 1984us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.598825 (+ 226us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.598866 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:51.599132 (+ 266us) log.cc:844] Serialized 106 byte log entry
0926 13:55:51.599312 (+ 180us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.599494 (+ 182us) write_op.cc:454] Released schema lock
0926 13:55:51.599543 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":27315072,"child_traces":[["op",{"apply.queue_time_us":149397,"num_ops":15,"prepare.queue_time_us":480003,"prepare.run_cpu_time_us":3533,"prepare.run_wall_time_us":16318,"replication_time_us":356162}]]}
I20260926 13:55:51.624450 11015 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=64, attempt_no=0}) took 1477 ms. Trace:
I20260926 13:55:51.624804 11015 rpcz_store.cc:276] 0926 13:55:50.147309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.147413 (+ 104us) service_pool.cc:224] Handling call
0926 13:55:51.624382 (+1476969us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.022039 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 848023f09b4b43409266078bcd364325
0926 13:55:51.022489 (+ 450us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.022523 (+ 34us) write_op.cc:435] Acquired schema lock
0926 13:55:51.022535 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:51.023351 (+ 816us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.023392 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.023417 (+ 25us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:51.024292 (+ 875us) tablet.cc:701] Row locks acquired
0926 13:55:51.024307 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:51.024458 (+ 151us) write_op.cc:270] Start()
0926 13:55:51.024549 (+ 91us) write_op.cc:276] Timestamp: P: 1790430951024407 usec, L: 0
0926 13:55:51.024567 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.038207 (+ 13640us) log.cc:844] Serialized 993 byte log entry
0926 13:55:51.425056 (+386849us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.618496 (+193440us) write_op.cc:301] APPLY: starting
0926 13:55:51.618577 (+ 81us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.618869 (+ 292us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.618945 (+ 76us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.622398 (+ 3453us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.622583 (+ 185us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.622617 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:51.622862 (+ 245us) log.cc:844] Serialized 112 byte log entry
0926 13:55:51.623917 (+ 1055us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.624101 (+ 184us) write_op.cc:454] Released schema lock
0926 13:55:51.624139 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":193279,"mutex_wait_us":38844,"num_ops":16,"prepare.queue_time_us":873366,"prepare.run_cpu_time_us":3354,"prepare.run_wall_time_us":17520,"replication_time_us":400288}]]}
I20260926 13:55:51.491410 10854 rpcz_store.cc:276] 0926 13:55:50.442052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.442875 (+ 823us) service_pool.cc:224] Handling call
0926 13:55:50.444189 (+ 1314us) raft_consensus.cc:1471] Updating replica for 9 ops
0926 13:55:50.445090 (+ 901us) raft_consensus.cc:1534] Early marking committed up to index 0
0926 13:55:50.445121 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 9 ops
0926 13:55:50.445440 (+ 319us) write_op.cc:270] Start()
0926 13:55:50.445533 (+ 93us) write_op.cc:276] Timestamp: P: 1790430950151121 usec, L: 0
0926 13:55:50.857799 (+412266us) write_op.cc:270] Start()
0926 13:55:50.857895 (+ 96us) write_op.cc:276] Timestamp: P: 1790430950155129 usec, L: 0
0926 13:55:50.860588 (+ 2693us) write_op.cc:270] Start()
0926 13:55:50.860691 (+ 103us) write_op.cc:276] Timestamp: P: 1790430950159492 usec, L: 0
0926 13:55:50.864243 (+ 3552us) write_op.cc:270] Start()
0926 13:55:50.864328 (+ 85us) write_op.cc:276] Timestamp: P: 1790430950163999 usec, L: 0
0926 13:55:50.872626 (+ 8298us) write_op.cc:270] Start()
0926 13:55:50.872707 (+ 81us) write_op.cc:276] Timestamp: P: 1790430950168848 usec, L: 0
0926 13:55:51.046116 (+173409us) write_op.cc:270] Start()
0926 13:55:51.046247 (+ 131us) write_op.cc:276] Timestamp: P: 1790430950172858 usec, L: 0
0926 13:55:51.046880 (+ 633us) write_op.cc:270] Start()
0926 13:55:51.047034 (+ 154us) write_op.cc:276] Timestamp: P: 1790430950176378 usec, L: 0
0926 13:55:51.062931 (+ 15897us) write_op.cc:270] Start()
0926 13:55:51.063019 (+ 88us) write_op.cc:276] Timestamp: P: 1790430950182338 usec, L: 0
0926 13:55:51.180328 (+117309us) write_op.cc:270] Start()
0926 13:55:51.180656 (+ 328us) write_op.cc:276] Timestamp: P: 1790430950186657 usec, L: 0
0926 13:55:51.307695 (+127039us) log.cc:844] Serialized 6786 byte log entry
0926 13:55:51.403557 (+ 95862us) raft_consensus.cc:1645] Marking committed up to 2
0926 13:55:51.403600 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0926 13:55:51.403716 (+ 116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0926 13:55:51.489519 (+ 85803us) raft_consensus.cc:1685] finished
0926 13:55:51.489537 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0926 13:55:51.489756 (+ 219us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.482503 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.499040 (+ 16537us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.499072 (+ 32us) write_op.cc:435] Acquired schema lock
0926 13:55:50.499091 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:50.585219 (+ 86128us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.627297 (+ 42078us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.628494 (+ 1197us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:50.694320 (+ 65826us) tablet.cc:701] Row locks acquired
0926 13:55:50.694342 (+ 22us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:50.858284 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.858710 (+ 426us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.858738 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:50.858754 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.859323 (+ 569us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.859388 (+ 65us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.859412 (+ 24us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:50.859880 (+ 468us) tablet.cc:701] Row locks acquired
0926 13:55:50.859895 (+ 15us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:50.861231 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.861660 (+ 429us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.861684 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:50.861700 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.862499 (+ 799us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.862557 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.862586 (+ 29us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:50.863513 (+ 927us) tablet.cc:701] Row locks acquired
0926 13:55:50.863528 (+ 15us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:50.870090 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.870524 (+ 434us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.870549 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:50.870573 (+ 24us) tablet.cc:662] Decoding operations
0926 13:55:50.871231 (+ 658us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.871289 (+ 58us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.871314 (+ 25us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:50.871853 (+ 539us) tablet.cc:701] Row locks acquired
0926 13:55:50.871891 (+ 38us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:50.892658 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.893105 (+ 447us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.893128 (+ 23us) write_op.cc:435] Acquired schema lock
0926 13:55:50.893144 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.893778 (+ 634us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.893837 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.893883 (+ 46us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:50.894444 (+ 561us) tablet.cc:701] Row locks acquired
0926 13:55:50.894462 (+ 18us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:51.047148 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:51.047585 (+ 437us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.047611 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:51.047627 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:51.048313 (+ 686us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.048374 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.048400 (+ 26us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:51.049129 (+ 729us) tablet.cc:701] Row locks acquired
0926 13:55:51.049148 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:51.068724 (+ 19576us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6a72 00007fdb09ca9bc5 00007fdb09ca9381 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94
Related trace 'op':
0926 13:55:51.081834 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:51.082271 (+ 437us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.082297 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:51.082314 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:51.082773 (+ 459us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.082830 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.082855 (+ 25us) tablet.cc:685] Acquiring locks for 6 operations
0926 13:55:51.083306 (+ 451us) tablet.cc:701] Row locks acquired
0926 13:55:51.083320 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:51.237028 (+153708us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a6a72 00007fdb09ca9bc5 00007fdb09ca9381 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94
Related trace 'op':
0926 13:55:51.237520 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:51.238044 (+ 524us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.238073 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:51.238096 (+ 23us) tablet.cc:662] Decoding operations
0926 13:55:51.238955 (+ 859us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.239012 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.239039 (+ 27us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:51.239833 (+ 794us) tablet.cc:701] Row locks acquired
0926 13:55:51.239847 (+ 14us) write_op.cc:260] PREPARE: finished
Related trace 'op':
0926 13:55:51.246259 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:51.246804 (+ 545us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.246830 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:51.246848 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:51.247869 (+ 1021us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.247954 (+ 85us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.247984 (+ 30us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:51.264776 (+ 16792us) tablet.cc:701] Row locks acquired
0926 13:55:51.264796 (+ 20us) write_op.cc:260] PREPARE: finished
Metrics: {"thread_start_us":95402,"threads_started":1,"wal-append.queue_time_us":143373,"child_traces":[["op",{"mutex_wait_us":18554,"num_ops":11,"partition_lock_wait_us":1172,"prepare.queue_time_us":30442,"prepare.run_cpu_time_us":62587,"prepare.run_wall_time_us":216889,"thread_start_us":274548,"threads_started":1}],["op",{"num_ops":8,"partition_lock_wait_us":12,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":1849,"prepare.run_wall_time_us":1848}],["op",{"num_ops":16,"partition_lock_wait_us":11,"prepare.queue_time_us":207,"prepare.run_cpu_time_us":2512,"prepare.run_wall_time_us":2511}],["op",{"mutex_wait_us":10040,"num_ops":10,"partition_lock_wait_us":14,"prepare.queue_time_us":5479,"prepare.run_cpu_time_us":2009,"prepare.run_wall_time_us":2009}],["op",{"mutex_wait_us":14350,"num_ops":10,"partition_lock_wait_us":16,"prepare.queue_time_us":17292,"prepare.run_cpu_time_us":2026,"prepare.run_wall_time_us":2026,"thread_start_us":48315,"threads_started":1}],["op",{"mutex_wait_us":11974,"num_ops":11,"partition_lock_wait_us":13,"prepare.queue_time_us":591,"prepare.run_cpu_time_us":2918,"prepare.run_wall_time_us":21716,"spinlock_wait_cycles":43686272}],["op",{"num_ops":6,"partition_lock_wait_us":14,"prepare.queue_time_us":34041,"prepare.run_cpu_time_us":2783,"prepare.run_wall_time_us":155343,"spinlock_wait_cycles":6039424}],["op",{"num_ops":9,"partition_lock_wait_us":15,"prepare.queue_time_us":174144,"prepare.run_cpu_time_us":2680,"prepare.run_wall_time_us":2680}],["op",{"num_ops":13,"partition_lock_wait_us":14,"prepare.queue_time_us":64710,"prepare.run_cpu_time_us":3191,"prepare.run_wall_time_us":18866}]]}
I20260926 13:55:51.603731 11043 rpcz_store.cc:276] 0926 13:55:50.252671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.255134 (+ 2463us) service_pool.cc:224] Handling call
0926 13:55:50.383692 (+128558us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:51.603267 (+1219575us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.088456 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 3926163f8af4418f926fa759704c2c76
0926 13:55:51.088919 (+ 463us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.088945 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:51.088972 (+ 27us) tablet.cc:662] Decoding operations
0926 13:55:51.089541 (+ 569us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.089582 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.089609 (+ 27us) tablet.cc:685] Acquiring locks for 7 operations
0926 13:55:51.090020 (+ 411us) tablet.cc:701] Row locks acquired
0926 13:55:51.090034 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:51.090165 (+ 131us) write_op.cc:270] Start()
0926 13:55:51.090249 (+ 84us) write_op.cc:276] Timestamp: P: 1790430951090129 usec, L: 0
0926 13:55:51.090267 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.090734 (+ 467us) log.cc:844] Serialized 605 byte log entry
0926 13:55:51.297079 (+206345us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.587081 (+290002us) write_op.cc:301] APPLY: starting
0926 13:55:51.600835 (+ 13754us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.601052 (+ 217us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.601139 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.602121 (+ 982us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.602313 (+ 192us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.602353 (+ 40us) write_op.cc:312] APPLY: finished
0926 13:55:51.602648 (+ 295us) log.cc:844] Serialized 58 byte log entry
0926 13:55:51.602827 (+ 179us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.602951 (+ 124us) write_op.cc:454] Released schema lock
0926 13:55:51.603002 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":51268992,"child_traces":[["op",{"apply.queue_time_us":288786,"num_ops":7,"prepare.queue_time_us":703678,"prepare.run_cpu_time_us":2512,"prepare.run_wall_time_us":2512,"replication_time_us":206580}]]}
I20260926 13:55:51.649838 11049 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=54, attempt_no=0}) took 1644 ms. Trace:
I20260926 13:55:51.655285 11010 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=72, attempt_no=0}) took 1482 ms. Trace:
I20260926 13:55:51.655661 11010 rpcz_store.cc:276] 0926 13:55:50.172513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.172970 (+ 457us) service_pool.cc:224] Handling call
0926 13:55:51.655210 (+1482240us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.039689 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 848023f09b4b43409266078bcd364325
0926 13:55:51.040121 (+ 432us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.040146 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:51.040161 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:51.040971 (+ 810us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.041010 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.041036 (+ 26us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:51.041837 (+ 801us) tablet.cc:701] Row locks acquired
0926 13:55:51.041852 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:51.042011 (+ 159us) write_op.cc:270] Start()
0926 13:55:51.042132 (+ 121us) write_op.cc:276] Timestamp: P: 1790430951041950 usec, L: 0
0926 13:55:51.042153 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.042710 (+ 557us) log.cc:844] Serialized 864 byte log entry
0926 13:55:51.464319 (+421609us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.620195 (+155876us) write_op.cc:301] APPLY: starting
0926 13:55:51.620278 (+ 83us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.620589 (+ 311us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.620678 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.622671 (+ 1993us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.622837 (+ 166us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.622872 (+ 35us) write_op.cc:312] APPLY: finished
0926 13:55:51.623061 (+ 189us) log.cc:844] Serialized 94 byte log entry
0926 13:55:51.652626 (+ 29565us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.654923 (+ 2297us) write_op.cc:454] Released schema lock
0926 13:55:51.654966 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":155702,"num_ops":13,"prepare.queue_time_us":865465,"prepare.run_cpu_time_us":3297,"prepare.run_wall_time_us":44668,"replication_time_us":421995,"spinlock_wait_cycles":12160}]]}
I20260926 13:55:51.658748 11015 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=91, attempt_no=0}) took 1462 ms. Trace:
I20260926 13:55:51.650276 11049 rpcz_store.cc:276] 0926 13:55:50.005708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.005832 (+ 124us) service_pool.cc:224] Handling call
0926 13:55:51.649635 (+1643803us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.873562 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:50.873992 (+ 430us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.874018 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:50.874034 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.900464 (+ 26430us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.904981 (+ 4517us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.905008 (+ 27us) tablet.cc:685] Acquiring locks for 21 operations
0926 13:55:50.906055 (+ 1047us) tablet.cc:701] Row locks acquired
0926 13:55:50.906075 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:50.906217 (+ 142us) write_op.cc:270] Start()
0926 13:55:50.906311 (+ 94us) write_op.cc:276] Timestamp: P: 1790430950906179 usec, L: 0
0926 13:55:50.906327 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.906832 (+ 505us) log.cc:844] Serialized 1208 byte log entry
0926 13:55:51.268302 (+361470us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.567031 (+298729us) write_op.cc:301] APPLY: starting
0926 13:55:51.567116 (+ 85us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.567589 (+ 473us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.567677 (+ 88us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.588476 (+ 20799us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.588742 (+ 266us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.588809 (+ 67us) write_op.cc:312] APPLY: finished
0926 13:55:51.589173 (+ 364us) log.cc:844] Serialized 144 byte log entry
0926 13:55:51.644866 (+ 55693us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.645072 (+ 206us) write_op.cc:454] Released schema lock
0926 13:55:51.645125 (+ 53us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:51.649527 (+ 4402us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b340011f608. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":298541,"mutex_wait_us":74612,"num_ops":21,"prepare.queue_time_us":866418,"prepare.run_cpu_time_us":3817,"prepare.run_wall_time_us":48902,"replication_time_us":361749,"spinlock_wait_cycles":7053056}]]}
I20260926 13:55:51.659125 11015 rpcz_store.cc:276] 0926 13:55:50.196441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.198659 (+ 2218us) service_pool.cc:224] Handling call
0926 13:55:50.592257 (+393598us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b3400071db8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a623c 00007fdb079ebe51 00007fdb079ef14f 00007fdb079f04a1 00007fdb079f0459 00007fdb079f03e9 00007fdb079f03b1 00007fdb079ef6ad 000000000041fb94 000000000041f9d9
0926 13:55:51.658682 (+1066425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.097479 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 848023f09b4b43409266078bcd364325
0926 13:55:51.097922 (+ 443us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.097948 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:51.097966 (+ 18us) tablet.cc:662] Decoding operations
0926 13:55:51.098725 (+ 759us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.098762 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.098791 (+ 29us) tablet.cc:685] Acquiring locks for 12 operations
0926 13:55:51.099573 (+ 782us) tablet.cc:701] Row locks acquired
0926 13:55:51.099591 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:51.099728 (+ 137us) write_op.cc:270] Start()
0926 13:55:51.099821 (+ 93us) write_op.cc:276] Timestamp: P: 1790430951099689 usec, L: 0
0926 13:55:51.099839 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.100354 (+ 515us) log.cc:844] Serialized 821 byte log entry
0926 13:55:51.464903 (+364549us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.655967 (+191064us) write_op.cc:301] APPLY: starting
0926 13:55:51.656061 (+ 94us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.656294 (+ 233us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.656369 (+ 75us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.657640 (+ 1271us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.657802 (+ 162us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.657847 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:51.658069 (+ 222us) log.cc:844] Serialized 88 byte log entry
0926 13:55:51.658226 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.658366 (+ 140us) write_op.cc:454] Released schema lock
0926 13:55:51.658405 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":36154752,"child_traces":[["op",{"apply.queue_time_us":190888,"num_ops":12,"prepare.queue_time_us":504101,"prepare.run_cpu_time_us":3094,"prepare.run_wall_time_us":3093,"replication_time_us":364939}]]}
I20260926 13:55:51.672096 11038 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=84, attempt_no=0}) took 1495 ms. Trace:
I20260926 13:55:51.672482 11038 rpcz_store.cc:276] 0926 13:55:50.177088 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.179834 (+ 2746us) service_pool.cc:224] Handling call
0926 13:55:51.672025 (+1492191us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.093588 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 848023f09b4b43409266078bcd364325
0926 13:55:51.094931 (+ 1343us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.094959 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:51.094975 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:51.095654 (+ 679us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.095700 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.095727 (+ 27us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:51.096278 (+ 551us) tablet.cc:701] Row locks acquired
0926 13:55:51.096293 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:51.096441 (+ 148us) write_op.cc:270] Start()
0926 13:55:51.096545 (+ 104us) write_op.cc:276] Timestamp: P: 1790430951096398 usec, L: 0
0926 13:55:51.096564 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.097121 (+ 557us) log.cc:844] Serialized 735 byte log entry
0926 13:55:51.464605 (+367484us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.669126 (+204521us) write_op.cc:301] APPLY: starting
0926 13:55:51.669213 (+ 87us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.669438 (+ 225us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.669527 (+ 89us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.670855 (+ 1328us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.671048 (+ 193us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.671089 (+ 41us) write_op.cc:312] APPLY: finished
0926 13:55:51.671307 (+ 218us) log.cc:844] Serialized 76 byte log entry
0926 13:55:51.671487 (+ 180us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.671667 (+ 180us) write_op.cc:454] Released schema lock
0926 13:55:51.671709 (+ 42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":191017,"num_ops":10,"prepare.queue_time_us":904806,"prepare.run_cpu_time_us":2871,"prepare.run_wall_time_us":4270,"replication_time_us":367936}]]}
I20260926 13:55:51.703181 11049 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=28, attempt_no=0}) took 1711 ms. Trace:
I20260926 13:55:51.707828 11008 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=38, attempt_no=0}) took 1711 ms. Trace:
I20260926 13:55:51.713617 11042 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=18, attempt_no=0}) took 1726 ms. Trace:
I20260926 13:55:51.708231 11008 rpcz_store.cc:276] 0926 13:55:49.996806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:49.996939 (+ 133us) service_pool.cc:224] Handling call
0926 13:55:51.707754 (+1710815us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.157089 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.157507 (+ 418us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.157532 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:50.157548 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.158390 (+ 842us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.158431 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.158459 (+ 28us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:50.159378 (+ 919us) tablet.cc:701] Row locks acquired
0926 13:55:50.159395 (+ 17us) write_op.cc:260] PREPARE: finished
0926 13:55:50.159528 (+ 133us) write_op.cc:270] Start()
0926 13:55:50.159634 (+ 106us) write_op.cc:276] Timestamp: P: 1790430950159492 usec, L: 0
0926 13:55:50.159653 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.160140 (+ 487us) log.cc:844] Serialized 993 byte log entry
0926 13:55:51.419078 (+1258938us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.695512 (+276434us) write_op.cc:301] APPLY: starting
0926 13:55:51.695593 (+ 81us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.695866 (+ 273us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.695945 (+ 79us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.697655 (+ 1710us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.697936 (+ 281us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.697972 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:51.698190 (+ 218us) log.cc:844] Serialized 112 byte log entry
0926 13:55:51.707118 (+ 8928us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.707413 (+ 295us) write_op.cc:454] Released schema lock
0926 13:55:51.707454 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":276281,"num_ops":16,"prepare.queue_time_us":158850,"prepare.run_cpu_time_us":3273,"prepare.run_wall_time_us":4827,"replication_time_us":1259321,"thread_start_us":7972,"threads_started":1,"wal-append.queue_time_us":7215}]]}
I20260926 13:55:51.715796 11042 rpcz_store.cc:276] 0926 13:55:49.987730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:49.987844 (+ 114us) service_pool.cc:224] Handling call
0926 13:55:51.713545 (+1725701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.147768 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.148202 (+ 434us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.148230 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:50.148247 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:50.148994 (+ 747us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.149042 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.149067 (+ 25us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:50.149702 (+ 635us) tablet.cc:701] Row locks acquired
0926 13:55:50.149721 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.151157 (+ 1436us) write_op.cc:270] Start()
0926 13:55:50.151248 (+ 91us) write_op.cc:276] Timestamp: P: 1790430950151121 usec, L: 0
0926 13:55:50.151266 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.151797 (+ 531us) log.cc:844] Serialized 778 byte log entry
0926 13:55:51.418461 (+1266664us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.687172 (+268711us) write_op.cc:301] APPLY: starting
0926 13:55:51.687257 (+ 85us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.687526 (+ 269us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.687622 (+ 96us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.703132 (+ 15510us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.703425 (+ 293us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.703473 (+ 48us) write_op.cc:312] APPLY: finished
0926 13:55:51.712857 (+ 9384us) log.cc:844] Serialized 82 byte log entry
0926 13:55:51.713050 (+ 193us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.713201 (+ 151us) write_op.cc:454] Released schema lock
0926 13:55:51.713244 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":268540,"num_ops":11,"prepare.queue_time_us":158471,"prepare.run_cpu_time_us":3006,"prepare.run_wall_time_us":5459,"replication_time_us":1267026}]]}
I20260926 13:55:51.703593 11049 rpcz_store.cc:276] 0926 13:55:49.991854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:49.992030 (+ 176us) service_pool.cc:224] Handling call
0926 13:55:51.703108 (+1711078us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.153388 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.153841 (+ 453us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.153866 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:50.153882 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.154487 (+ 605us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.154524 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.154553 (+ 29us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:50.155011 (+ 458us) tablet.cc:701] Row locks acquired
0926 13:55:50.155029 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:50.155168 (+ 139us) write_op.cc:270] Start()
0926 13:55:50.155253 (+ 85us) write_op.cc:276] Timestamp: P: 1790430950155129 usec, L: 0
0926 13:55:50.155269 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.155779 (+ 510us) log.cc:844] Serialized 649 byte log entry
0926 13:55:51.418768 (+1262989us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.695274 (+276506us) write_op.cc:301] APPLY: starting
0926 13:55:51.695373 (+ 99us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.700808 (+ 5435us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.700908 (+ 100us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.701953 (+ 1045us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.702121 (+ 168us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.702163 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:51.702368 (+ 205us) log.cc:844] Serialized 64 byte log entry
0926 13:55:51.702515 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.702726 (+ 211us) write_op.cc:454] Released schema lock
0926 13:55:51.702769 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":276344,"num_ops":8,"prepare.queue_time_us":160015,"prepare.run_cpu_time_us":2611,"prepare.run_wall_time_us":3566,"replication_time_us":1263385}]]}
I20260926 13:55:51.742782 11042 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=58, attempt_no=0}) took 1733 ms. Trace:
I20260926 13:55:51.744515 11008 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=86, attempt_no=0}) took 1693 ms. Trace:
I20260926 13:55:51.745538 11049 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=66, attempt_no=0}) took 1709 ms. Trace:
I20260926 13:55:51.745990 11049 rpcz_store.cc:276] 0926 13:55:50.035900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.036006 (+ 106us) service_pool.cc:224] Handling call
0926 13:55:51.745458 (+1709452us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.170766 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.171201 (+ 435us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.171226 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:50.171238 (+ 12us) tablet.cc:662] Decoding operations
0926 13:55:50.171959 (+ 721us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.171998 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.172026 (+ 28us) tablet.cc:685] Acquiring locks for 11 operations
0926 13:55:50.172720 (+ 694us) tablet.cc:701] Row locks acquired
0926 13:55:50.172739 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.172894 (+ 155us) write_op.cc:270] Start()
0926 13:55:50.172989 (+ 95us) write_op.cc:276] Timestamp: P: 1790430950172858 usec, L: 0
0926 13:55:50.173008 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.173497 (+ 489us) log.cc:844] Serialized 778 byte log entry
0926 13:55:51.419950 (+1246453us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.739934 (+319984us) write_op.cc:301] APPLY: starting
0926 13:55:51.740011 (+ 77us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.740251 (+ 240us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.740363 (+ 112us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.744113 (+ 3750us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.744397 (+ 284us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.744444 (+ 47us) write_op.cc:312] APPLY: finished
0926 13:55:51.744710 (+ 266us) log.cc:844] Serialized 82 byte log entry
0926 13:55:51.744952 (+ 242us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.745118 (+ 166us) write_op.cc:454] Released schema lock
0926 13:55:51.745161 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":319832,"mutex_wait_us":1858,"num_ops":11,"prepare.queue_time_us":133383,"prepare.run_cpu_time_us":2924,"prepare.run_wall_time_us":3924,"replication_time_us":1246799,"spinlock_wait_cycles":1280}]]}
I20260926 13:55:51.744927 11008 rpcz_store.cc:276] 0926 13:55:50.051184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.051328 (+ 144us) service_pool.cc:224] Handling call
0926 13:55:51.744448 (+1693120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.174827 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.175263 (+ 436us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.175287 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:50.175303 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.175780 (+ 477us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.175820 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.175845 (+ 25us) tablet.cc:685] Acquiring locks for 6 operations
0926 13:55:50.176265 (+ 420us) tablet.cc:701] Row locks acquired
0926 13:55:50.176279 (+ 14us) write_op.cc:260] PREPARE: finished
0926 13:55:50.176418 (+ 139us) write_op.cc:270] Start()
0926 13:55:50.176508 (+ 90us) write_op.cc:276] Timestamp: P: 1790430950176378 usec, L: 0
0926 13:55:50.176527 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.177057 (+ 530us) log.cc:844] Serialized 562 byte log entry
0926 13:55:51.420239 (+1243182us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.741031 (+320792us) write_op.cc:301] APPLY: starting
0926 13:55:51.741103 (+ 72us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.741267 (+ 164us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.741561 (+ 294us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.743486 (+ 1925us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.743627 (+ 141us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.743663 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:51.743833 (+ 170us) log.cc:844] Serialized 52 byte log entry
0926 13:55:51.743994 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.744124 (+ 130us) write_op.cc:454] Released schema lock
0926 13:55:51.744161 (+ 37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":320646,"num_ops":6,"prepare.queue_time_us":122087,"prepare.run_cpu_time_us":2447,"prepare.run_wall_time_us":3396,"replication_time_us":1243600}]]}
I20260926 13:55:51.743147 11042 rpcz_store.cc:276] 0926 13:55:50.009488 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.009629 (+ 141us) service_pool.cc:224] Handling call
0926 13:55:51.742707 (+1733078us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.166969 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.167405 (+ 436us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.167431 (+ 26us) write_op.cc:435] Acquired schema lock
0926 13:55:50.167444 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:50.168129 (+ 685us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.168168 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.168197 (+ 29us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:50.168718 (+ 521us) tablet.cc:701] Row locks acquired
0926 13:55:50.168738 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:50.168885 (+ 147us) write_op.cc:270] Start()
0926 13:55:50.168968 (+ 83us) write_op.cc:276] Timestamp: P: 1790430950168848 usec, L: 0
0926 13:55:50.168986 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.169463 (+ 477us) log.cc:844] Serialized 735 byte log entry
0926 13:55:51.419661 (+1250198us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.726675 (+307014us) write_op.cc:301] APPLY: starting
0926 13:55:51.726784 (+ 109us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.727078 (+ 294us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.727177 (+ 99us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.741620 (+ 14443us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.741808 (+ 188us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.741863 (+ 55us) write_op.cc:312] APPLY: finished
0926 13:55:51.742086 (+ 223us) log.cc:844] Serialized 76 byte log entry
0926 13:55:51.742264 (+ 178us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.742401 (+ 137us) write_op.cc:454] Released schema lock
0926 13:55:51.742439 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":306854,"num_ops":10,"prepare.queue_time_us":156031,"prepare.run_cpu_time_us":2703,"prepare.run_wall_time_us":3660,"replication_time_us":1250560}]]}
I20260926 13:55:51.762704 11008 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=78, attempt_no=0}) took 1716 ms. Trace:
I20260926 13:55:51.752916 11006 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=48, attempt_no=0}) took 1749 ms. Trace:
I20260926 13:55:51.763211 11006 rpcz_store.cc:276] 0926 13:55:50.003229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.003356 (+ 127us) service_pool.cc:224] Handling call
0926 13:55:51.752819 (+1749463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.162052 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.162477 (+ 425us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.162507 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:50.162523 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.163247 (+ 724us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.163291 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.163317 (+ 26us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:50.163881 (+ 564us) tablet.cc:701] Row locks acquired
0926 13:55:50.163896 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:50.164039 (+ 143us) write_op.cc:270] Start()
0926 13:55:50.164129 (+ 90us) write_op.cc:276] Timestamp: P: 1790430950163999 usec, L: 0
0926 13:55:50.164149 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.164660 (+ 511us) log.cc:844] Serialized 735 byte log entry
0926 13:55:51.419401 (+1254741us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.700055 (+280654us) write_op.cc:301] APPLY: starting
0926 13:55:51.700137 (+ 82us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.700400 (+ 263us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.700487 (+ 87us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.736459 (+ 35972us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.736651 (+ 192us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.736697 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:51.736943 (+ 246us) log.cc:844] Serialized 76 byte log entry
0926 13:55:51.752336 (+ 15393us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.752466 (+ 130us) write_op.cc:454] Released schema lock
0926 13:55:51.752515 (+ 49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":280497,"num_ops":10,"prepare.queue_time_us":157370,"prepare.run_cpu_time_us":2833,"prepare.run_wall_time_us":4792,"replication_time_us":1255093}]]}
I20260926 13:55:51.763139 11008 rpcz_store.cc:276] 0926 13:55:50.046416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.056598 (+ 10182us) service_pool.cc:224] Handling call
0926 13:55:51.762637 (+1706039us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.180445 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.180895 (+ 450us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.180919 (+ 24us) write_op.cc:435] Acquired schema lock
0926 13:55:50.180935 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:50.181656 (+ 721us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.181693 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.181724 (+ 31us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:50.182224 (+ 500us) tablet.cc:701] Row locks acquired
0926 13:55:50.182242 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:50.182376 (+ 134us) write_op.cc:270] Start()
0926 13:55:50.182453 (+ 77us) write_op.cc:276] Timestamp: P: 1790430950182338 usec, L: 0
0926 13:55:50.182472 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.182965 (+ 493us) log.cc:844] Serialized 692 byte log entry
0926 13:55:51.420570 (+1237605us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.757736 (+337166us) write_op.cc:301] APPLY: starting
0926 13:55:51.757803 (+ 67us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.758009 (+ 206us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.759129 (+ 1120us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.760108 (+ 979us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.760273 (+ 165us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.760309 (+ 36us) write_op.cc:312] APPLY: finished
0926 13:55:51.760514 (+ 205us) log.cc:844] Serialized 70 byte log entry
0926 13:55:51.760678 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.762342 (+ 1664us) write_op.cc:454] Released schema lock
0926 13:55:51.762378 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":337033,"num_ops":9,"prepare.queue_time_us":122464,"prepare.run_cpu_time_us":2676,"prepare.run_wall_time_us":3881,"replication_time_us":1237951}]]}
I20260926 13:55:51.775089 11008 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=81, attempt_no=0}) took 1727 ms. Trace:
I20260926 13:55:51.775405 11008 rpcz_store.cc:276] 0926 13:55:50.048038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.048137 (+ 99us) service_pool.cc:224] Handling call
0926 13:55:51.775019 (+1726882us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.077901 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:51.078351 (+ 450us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.078380 (+ 29us) write_op.cc:435] Acquired schema lock
0926 13:55:51.078395 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:51.079423 (+ 1028us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.079467 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.079495 (+ 28us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:51.080423 (+ 928us) tablet.cc:701] Row locks acquired
0926 13:55:51.080441 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:51.080589 (+ 148us) write_op.cc:270] Start()
0926 13:55:51.080680 (+ 91us) write_op.cc:276] Timestamp: P: 1790430951080548 usec, L: 0
0926 13:55:51.080700 (+ 20us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.222889 (+142189us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:51.428848 (+205959us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.771328 (+342480us) write_op.cc:301] APPLY: starting
0926 13:55:51.771406 (+ 78us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.771730 (+ 324us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.771825 (+ 95us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.773894 (+ 2069us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.774085 (+ 191us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.774123 (+ 38us) write_op.cc:312] APPLY: finished
0926 13:55:51.774374 (+ 251us) log.cc:844] Serialized 124 byte log entry
0926 13:55:51.774548 (+ 174us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.774738 (+ 190us) write_op.cc:454] Released schema lock
0926 13:55:51.774777 (+ 39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":342341,"num_ops":18,"prepare.queue_time_us":1028403,"prepare.run_cpu_time_us":4202,"prepare.run_wall_time_us":145448,"replication_time_us":348000}]]}
I20260926 13:55:51.782176 11006 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=61, attempt_no=0}) took 1770 ms. Trace:
I20260926 13:55:51.797091 11042 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=77, attempt_no=0}) took 1757 ms. Trace:
I20260926 13:55:51.797482 11042 rpcz_store.cc:276] 0926 13:55:50.039299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.039393 (+ 94us) service_pool.cc:224] Handling call
0926 13:55:51.796158 (+1756765us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.930199 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:50.930651 (+ 452us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.930679 (+ 28us) write_op.cc:435] Acquired schema lock
0926 13:55:50.930692 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:50.931290 (+ 598us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.931327 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.931354 (+ 27us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:50.981653 (+ 50299us) tablet.cc:701] Row locks acquired
0926 13:55:50.981673 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:50.981820 (+ 147us) write_op.cc:270] Start()
0926 13:55:50.981919 (+ 99us) write_op.cc:276] Timestamp: P: 1790430950981785 usec, L: 0
0926 13:55:50.981940 (+ 21us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.982472 (+ 532us) log.cc:844] Serialized 649 byte log entry
0926 13:55:51.428113 (+445641us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.763692 (+335579us) write_op.cc:301] APPLY: starting
0926 13:55:51.763779 (+ 87us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.764002 (+ 223us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.764093 (+ 91us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.765453 (+ 1360us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.765660 (+ 207us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.765706 (+ 46us) write_op.cc:312] APPLY: finished
0926 13:55:51.765911 (+ 205us) log.cc:844] Serialized 64 byte log entry
0926 13:55:51.793816 (+ 27905us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.793916 (+ 100us) write_op.cc:454] Released schema lock
0926 13:55:51.793967 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":335375,"num_ops":8,"prepare.queue_time_us":888803,"prepare.run_cpu_time_us":2862,"prepare.run_wall_time_us":52507,"replication_time_us":445949}]]}
I20260926 13:55:51.786067 11006 rpcz_store.cc:276] 0926 13:55:50.012098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.012554 (+ 456us) service_pool.cc:224] Handling call
0926 13:55:51.782101 (+1769547us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.997435 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:50.997907 (+ 472us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.997950 (+ 43us) write_op.cc:435] Acquired schema lock
0926 13:55:50.997969 (+ 19us) tablet.cc:662] Decoding operations
0926 13:55:50.999059 (+ 1090us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.999097 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.999127 (+ 30us) tablet.cc:685] Acquiring locks for 18 operations
0926 13:55:51.000010 (+ 883us) tablet.cc:701] Row locks acquired
0926 13:55:51.000025 (+ 15us) write_op.cc:260] PREPARE: finished
0926 13:55:51.000171 (+ 146us) write_op.cc:270] Start()
0926 13:55:51.000282 (+ 111us) write_op.cc:276] Timestamp: P: 1790430951000128 usec, L: 0
0926 13:55:51.000300 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.077495 (+ 77195us) log.cc:844] Serialized 1079 byte log entry
0926 13:55:51.428523 (+351028us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.766701 (+338178us) write_op.cc:301] APPLY: starting
0926 13:55:51.766792 (+ 91us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.767199 (+ 407us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.767292 (+ 93us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.780812 (+ 13520us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.781039 (+ 227us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.781084 (+ 45us) write_op.cc:312] APPLY: finished
0926 13:55:51.781393 (+ 309us) log.cc:844] Serialized 124 byte log entry
0926 13:55:51.781565 (+ 172us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.781767 (+ 202us) write_op.cc:454] Released schema lock
0926 13:55:51.781815 (+ 48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":338012,"num_ops":18,"prepare.queue_time_us":952013,"prepare.run_cpu_time_us":3778,"prepare.run_wall_time_us":80333,"replication_time_us":428039}]]}
I20260926 13:55:51.805962 11049 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=98, attempt_no=0}) took 1746 ms. Trace:
I20260926 13:55:51.806360 11049 rpcz_store.cc:276] 0926 13:55:50.059475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.064239 (+ 4764us) service_pool.cc:224] Handling call
0926 13:55:51.805886 (+1741647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:50.184463 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 484dbf4e632b48299225e39e38717061
0926 13:55:50.184928 (+ 465us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:50.184953 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:50.184966 (+ 13us) tablet.cc:662] Decoding operations
0926 13:55:50.185734 (+ 768us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:50.185776 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:50.185805 (+ 29us) tablet.cc:685] Acquiring locks for 13 operations
0926 13:55:50.186532 (+ 727us) tablet.cc:701] Row locks acquired
0926 13:55:50.186551 (+ 19us) write_op.cc:260] PREPARE: finished
0926 13:55:50.186691 (+ 140us) write_op.cc:270] Start()
0926 13:55:50.186775 (+ 84us) write_op.cc:276] Timestamp: P: 1790430950186657 usec, L: 0
0926 13:55:50.186789 (+ 14us) op_driver.cc:348] REPLICATION: starting
0926 13:55:50.187290 (+ 501us) log.cc:844] Serialized 864 byte log entry
0926 13:55:51.425410 (+1238120us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.763015 (+337605us) write_op.cc:301] APPLY: starting
0926 13:55:51.763090 (+ 75us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.776827 (+ 13737us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.776932 (+ 105us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.778669 (+ 1737us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.778921 (+ 252us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.778974 (+ 53us) write_op.cc:312] APPLY: finished
0926 13:55:51.804970 (+ 25996us) log.cc:844] Serialized 94 byte log entry
0926 13:55:51.805193 (+ 223us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.805487 (+ 294us) write_op.cc:454] Released schema lock
0926 13:55:51.805534 (+ 47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":336997,"num_ops":13,"prepare.queue_time_us":118933,"prepare.run_cpu_time_us":3037,"prepare.run_wall_time_us":4034,"replication_time_us":1238423}]]}
I20260926 13:55:51.835352 11008 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:47926 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=97, attempt_no=0}) took 1780 ms. Trace:
I20260926 13:55:51.835723 11008 rpcz_store.cc:276] 0926 13:55:50.054716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:50.054850 (+ 134us) service_pool.cc:224] Handling call
0926 13:55:51.835278 (+1780428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:51.227152 (+ 0us) write_op.cc:183] PREPARE: starting on tablet aa9814f431034deaa79ff47944219096
0926 13:55:51.227779 (+ 627us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:51.227823 (+ 44us) write_op.cc:435] Acquired schema lock
0926 13:55:51.227843 (+ 20us) tablet.cc:662] Decoding operations
0926 13:55:51.229070 (+ 1227us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:51.229135 (+ 65us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:51.229169 (+ 34us) tablet.cc:685] Acquiring locks for 16 operations
0926 13:55:51.321694 (+ 92525us) tablet.cc:701] Row locks acquired
0926 13:55:51.321717 (+ 23us) write_op.cc:260] PREPARE: finished
0926 13:55:51.321911 (+ 194us) write_op.cc:270] Start()
0926 13:55:51.322014 (+ 103us) write_op.cc:276] Timestamp: P: 1790430951321868 usec, L: 0
0926 13:55:51.322032 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:51.357866 (+ 35834us) log.cc:844] Serialized 993 byte log entry
0926 13:55:51.416594 (+ 58728us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54002aa654. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb09786aa1 00007fdb098195e8 00007fdb09ca9791 00007fdb09ca8f68 00007fdb09cadc01 00007fdb09cadbb9 00007fdb09cadb49 00007fdb09cadb11 00007fdb09cacd3d 000000000041fb94 000000000041f9d9
0926 13:55:51.536366 (+119772us) op_driver.cc:464] REPLICATION: finished
0926 13:55:51.831545 (+295179us) write_op.cc:301] APPLY: starting
0926 13:55:51.831609 (+ 64us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:51.831884 (+ 275us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:51.831904 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:51.834076 (+ 2172us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:51.834265 (+ 189us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:51.834302 (+ 37us) write_op.cc:312] APPLY: finished
0926 13:55:51.834545 (+ 243us) log.cc:844] Serialized 112 byte log entry
0926 13:55:51.834713 (+ 168us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:51.834840 (+ 127us) write_op.cc:454] Released schema lock
0926 13:55:51.834883 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":295014,"num_ops":16,"prepare.queue_time_us":1170857,"prepare.run_cpu_time_us":7251,"prepare.run_wall_time_us":189697,"replication_time_us":214204,"spinlock_wait_cycles":48948608}]]}
W20260926 13:55:52.040462 10978 meta_cache.cc:1261] Time spent looking up entry by key: real 0.054s user 0.000s sys 0.000s
W20260926 13:55:52.066553 10822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:45833, user_credentials={real_user=slave}} blocked reactor thread for 65285.3us
W20260926 13:55:52.249837 10822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.127.129:45833, user_credentials={real_user=slave}} blocked reactor thread for 124910us
W20260926 13:55:52.413002 10890 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.3.127.130:42471, user_credentials={real_user=slave}} blocked reactor thread for 43535.7us
W20260926 13:55:52.809791 10975 meta_cache.cc:1261] Time spent looking up entry by key: real 0.076s user 0.000s sys 0.000s
W20260926 13:55:52.852337 10978 meta_cache.cc:1261] Time spent looking up entry by key: real 0.051s user 0.000s sys 0.000s
I20260926 13:55:53.391296 11007 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:42160 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=150, attempt_no=0}) took 1094 ms. Trace:
I20260926 13:55:53.392021 11007 rpcz_store.cc:276] 0926 13:55:52.297249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:52.297383 (+ 134us) service_pool.cc:224] Handling call
0926 13:55:53.391238 (+1093855us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:52.342388 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 212603e16fe2480aac71d2ac21eefb26
0926 13:55:52.342858 (+ 470us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:52.342888 (+ 30us) write_op.cc:435] Acquired schema lock
0926 13:55:52.342903 (+ 15us) tablet.cc:662] Decoding operations
0926 13:55:52.343618 (+ 715us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:52.343661 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:52.343685 (+ 24us) tablet.cc:685] Acquiring locks for 10 operations
0926 13:55:52.344259 (+ 574us) tablet.cc:701] Row locks acquired
0926 13:55:52.344279 (+ 20us) write_op.cc:260] PREPARE: finished
0926 13:55:52.344416 (+ 137us) write_op.cc:270] Start()
0926 13:55:52.344507 (+ 91us) write_op.cc:276] Timestamp: P: 1790430952344382 usec, L: 0
0926 13:55:52.344525 (+ 18us) op_driver.cc:348] REPLICATION: starting
0926 13:55:52.345363 (+ 838us) log.cc:844] Serialized 745 byte log entry
0926 13:55:53.010049 (+664686us) op_driver.cc:464] REPLICATION: finished
0926 13:55:53.181966 (+171917us) write_op.cc:301] APPLY: starting
0926 13:55:53.182025 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:53.182199 (+ 174us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:53.182278 (+ 79us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:53.183398 (+ 1120us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:53.183554 (+ 156us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:53.183588 (+ 34us) write_op.cc:312] APPLY: finished
0926 13:55:53.183789 (+ 201us) log.cc:844] Serialized 76 byte log entry
0926 13:55:53.183938 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:53.184030 (+ 92us) write_op.cc:454] Released schema lock
0926 13:55:53.184070 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:53.391148 (+207078us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b34001bd688. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":171775,"num_ops":10,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2986,"prepare.run_wall_time_us":3218,"replication_time_us":665429,"spinlock_wait_cycles":186266368}]]}
I20260926 13:55:53.483911 11071 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=128, attempt_no=0}) took 1288 ms. Trace:
I20260926 13:55:53.484323 11071 rpcz_store.cc:276] 0926 13:55:52.195561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:52.218283 (+ 22722us) service_pool.cc:224] Handling call
0926 13:55:53.483746 (+1265463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:52.520775 (+ 0us) write_op.cc:183] PREPARE: starting on tablet faffe1f667e94043a7f0e88d5675d6a7
0926 13:55:52.521196 (+ 421us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:52.521227 (+ 31us) write_op.cc:435] Acquired schema lock
0926 13:55:52.521243 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:52.521911 (+ 668us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:52.521955 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:52.521981 (+ 26us) tablet.cc:685] Acquiring locks for 8 operations
0926 13:55:52.522494 (+ 513us) tablet.cc:701] Row locks acquired
0926 13:55:52.522512 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:52.522670 (+ 158us) write_op.cc:270] Start()
0926 13:55:52.522764 (+ 94us) write_op.cc:276] Timestamp: P: 1790430952522630 usec, L: 0
0926 13:55:52.522780 (+ 16us) op_driver.cc:348] REPLICATION: starting
0926 13:55:52.523353 (+ 573us) log.cc:844] Serialized 659 byte log entry
0926 13:55:53.064520 (+541167us) op_driver.cc:464] REPLICATION: finished
0926 13:55:53.114940 (+ 50420us) write_op.cc:301] APPLY: starting
0926 13:55:53.115006 (+ 66us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:53.115207 (+ 201us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:53.115297 (+ 90us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:53.116400 (+ 1103us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:53.116573 (+ 173us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:53.116615 (+ 42us) write_op.cc:312] APPLY: finished
0926 13:55:53.172865 (+ 56250us) log.cc:844] Serialized 64 byte log entry
0926 13:55:53.173074 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:53.173237 (+ 163us) write_op.cc:454] Released schema lock
0926 13:55:53.173283 (+ 46us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:53.483642 (+310359us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b3400071db8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":50264,"num_ops":8,"prepare.queue_time_us":178874,"prepare.run_cpu_time_us":2826,"prepare.run_wall_time_us":2826,"replication_time_us":541618,"spinlock_wait_cycles":208629504}]]}
I20260926 13:55:53.569201 11070 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=154, attempt_no=0}) took 1220 ms. Trace:
I20260926 13:55:53.571092 11015 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Write from 127.0.0.1:51550 (ReqId={client: 7e053617cfae4fb2b3292effb563a854, seq_no=162, attempt_no=0}) took 1148 ms. Trace:
I20260926 13:55:53.569603 11070 rpcz_store.cc:276] 0926 13:55:52.348667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:52.355197 (+ 6530us) service_pool.cc:224] Handling call
0926 13:55:53.569045 (+1213848us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:52.531845 (+ 0us) write_op.cc:183] PREPARE: starting on tablet faffe1f667e94043a7f0e88d5675d6a7
0926 13:55:52.532275 (+ 430us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:52.532308 (+ 33us) write_op.cc:435] Acquired schema lock
0926 13:55:52.532325 (+ 17us) tablet.cc:662] Decoding operations
0926 13:55:52.533009 (+ 684us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:52.533050 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:52.533075 (+ 25us) tablet.cc:685] Acquiring locks for 9 operations
0926 13:55:52.533589 (+ 514us) tablet.cc:701] Row locks acquired
0926 13:55:52.533605 (+ 16us) write_op.cc:260] PREPARE: finished
0926 13:55:52.533748 (+ 143us) write_op.cc:270] Start()
0926 13:55:52.533853 (+ 105us) write_op.cc:276] Timestamp: P: 1790430952533710 usec, L: 0
0926 13:55:52.533872 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:52.534407 (+ 535us) log.cc:844] Serialized 702 byte log entry
0926 13:55:53.065014 (+530607us) op_driver.cc:464] REPLICATION: finished
0926 13:55:53.139412 (+ 74398us) write_op.cc:301] APPLY: starting
0926 13:55:53.139480 (+ 68us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:53.139664 (+ 184us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:53.139749 (+ 85us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:53.162887 (+ 23138us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:53.163078 (+ 191us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:53.163121 (+ 43us) write_op.cc:312] APPLY: finished
0926 13:55:53.163349 (+ 228us) log.cc:844] Serialized 70 byte log entry
0926 13:55:53.173710 (+ 10361us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:53.173806 (+ 96us) write_op.cc:454] Released schema lock
0926 13:55:53.173857 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:53.568942 (+395085us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b3400071db8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"child_traces":[["op",{"apply.queue_time_us":74259,"num_ops":9,"prepare.queue_time_us":175215,"prepare.run_cpu_time_us":2802,"prepare.run_wall_time_us":2801,"replication_time_us":531056,"spinlock_wait_cycles":105235200}]]}
I20260926 13:55:53.571475 11015 rpcz_store.cc:276] 0926 13:55:52.422875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0926 13:55:52.423575 (+ 700us) service_pool.cc:224] Handling call
0926 13:55:52.443008 (+ 19433us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b24003e39a8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb02c3a8a1 00007fdb02d7eb51 00007fdb02d7ea02 00007fdb0bcf9119 00007fdb02f50c10 00007fdb02f5dfc4 00007fdb0b886d55 00007fdb0b885006 00007fdb09f87084 00007fdb09f87012 00007fdb09f86f41
0926 13:55:53.571032 (+1128024us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0926 13:55:52.534794 (+ 0us) write_op.cc:183] PREPARE: starting on tablet faffe1f667e94043a7f0e88d5675d6a7
0926 13:55:52.535246 (+ 452us) write_op.cc:432] Acquiring schema lock in shared mode
0926 13:55:52.535271 (+ 25us) write_op.cc:435] Acquired schema lock
0926 13:55:52.535287 (+ 16us) tablet.cc:662] Decoding operations
0926 13:55:52.536123 (+ 836us) write_op.cc:620] Acquiring the partition lock for write op
0926 13:55:52.536161 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0926 13:55:52.536187 (+ 26us) tablet.cc:685] Acquiring locks for 14 operations
0926 13:55:52.580975 (+ 44788us) tablet.cc:701] Row locks acquired
0926 13:55:52.580993 (+ 18us) write_op.cc:260] PREPARE: finished
0926 13:55:52.581132 (+ 139us) write_op.cc:270] Start()
0926 13:55:52.581225 (+ 93us) write_op.cc:276] Timestamp: P: 1790430952581095 usec, L: 0
0926 13:55:52.581244 (+ 19us) op_driver.cc:348] REPLICATION: starting
0926 13:55:52.581790 (+ 546us) log.cc:844] Serialized 917 byte log entry
0926 13:55:53.065228 (+483438us) op_driver.cc:464] REPLICATION: finished
0926 13:55:53.166509 (+101281us) write_op.cc:301] APPLY: starting
0926 13:55:53.166568 (+ 59us) tablet.cc:1394] starting BulkCheckPresence
0926 13:55:53.166791 (+ 223us) tablet.cc:1397] finished BulkCheckPresence
0926 13:55:53.166870 (+ 79us) tablet.cc:1399] starting ApplyRowOperation cycle
0926 13:55:53.198150 (+ 31280us) tablet.cc:1410] finished ApplyRowOperation cycle
0926 13:55:53.198339 (+ 189us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0926 13:55:53.198377 (+ 38us) write_op.cc:312] APPLY: finished
0926 13:55:53.198597 (+ 220us) log.cc:844] Serialized 100 byte log entry
0926 13:55:53.199408 (+ 811us) write_op.cc:489] Releasing partition, row and schema locks
0926 13:55:53.199512 (+ 104us) write_op.cc:454] Released schema lock
0926 13:55:53.199550 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0926 13:55:53.570936 (+371386us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b3400071db8. stack: 00007fdb02d84323 00007fdb02d84220 00007fdb02705574 00007fdb0c4b36c4 00007fdb0c4b3659 00007fdb0795fe81 00007fdb079a7a5e 00007fdb079bb5ae 00007fdb0b8ad471 00007fdb09cab5bd 00007fdb09caad63 00007fdb09caef71 00007fdb09caef29 00007fdb09caeeb9 00007fdb09caee81 00007fdb09cae0ad
Metrics: {"spinlock_wait_cycles":39001856,"child_traces":[["op",{"apply.queue_time_us":101146,"mutex_wait_us":8,"num_ops":14,"prepare.queue_time_us":86935,"prepare.run_cpu_time_us":3425,"prepare.run_wall_time_us":47224,"replication_time_us":483887,"spinlock_wait_cycles":150526848}]]}
I20260926 13:55:53.995937 3582 tablet_server.cc:179] TabletServer@127.3.127.129:0 shutting down...
W20260926 13:55:54.034080 10748 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260926 13:55:54.042450 10748 consensus_peers.cc:597] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 -> Peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Couldn't send request to peer f920959ad42f4f37a2c310cf272d4012. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:54.047956 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:54.048694 3582 tablet_replica.cc:333] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.049551 3582 raft_consensus.cc:2243] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.050204 3582 raft_consensus.cc:2272] T 8c7a95df58a742a69e1cface7c9d6e36 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.053331 3582 tablet_replica.cc:333] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.053823 3582 raft_consensus.cc:2243] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.054349 3582 raft_consensus.cc:2272] T 1f03301b2d10417296862fd5eeaf87e1 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.056630 3582 tablet_replica.cc:333] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.057139 3582 raft_consensus.cc:2243] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.057690 3582 raft_consensus.cc:2272] T 848023f09b4b43409266078bcd364325 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.060364 3582 tablet_replica.cc:333] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.060846 3582 raft_consensus.cc:2243] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.061271 3582 raft_consensus.cc:2272] T 212603e16fe2480aac71d2ac21eefb26 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.063906 3582 tablet_replica.cc:333] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.064376 3582 raft_consensus.cc:2243] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.064839 3582 raft_consensus.cc:2272] T faffe1f667e94043a7f0e88d5675d6a7 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.067135 3582 tablet_replica.cc:333] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.067613 3582 raft_consensus.cc:2243] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.068008 3582 raft_consensus.cc:2272] T 3926163f8af4418f926fa759704c2c76 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.070479 3582 tablet_replica.cc:333] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.070942 3582 raft_consensus.cc:2243] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.071667 3582 raft_consensus.cc:2272] T aa9814f431034deaa79ff47944219096 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.074234 3582 tablet_replica.cc:333] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.074728 3582 raft_consensus.cc:2243] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.075138 3582 raft_consensus.cc:2272] T d39e03afe6704e7bba77f0941dc30643 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.077551 3582 tablet_replica.cc:333] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.077987 3582 raft_consensus.cc:2243] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.078719 3582 raft_consensus.cc:2272] T 484dbf4e632b48299225e39e38717061 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.081702 3582 tablet_replica.cc:333] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012: stopping tablet replica
I20260926 13:55:54.082118 3582 raft_consensus.cc:2243] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.082532 3582 raft_consensus.cc:2272] T fe33aee2fd874d14ab467dba7cf2cfe0 P f920959ad42f4f37a2c310cf272d4012 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.108639 3582 tablet_server.cc:196] TabletServer@127.3.127.129:0 shutdown complete.
W20260926 13:55:54.120054 10822 consensus_peers.cc:597] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 -> Peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Couldn't send request to peer f920959ad42f4f37a2c310cf272d4012. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:45833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:54.140471 3582 tablet_server.cc:179] TabletServer@127.3.127.130:0 shutting down...
W20260926 13:55:54.153239 10822 consensus_peers.cc:597] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 -> Peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Couldn't send request to peer f920959ad42f4f37a2c310cf272d4012. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:45833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260926 13:55:54.160964 10824 consensus_peers.cc:597] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 -> Peer 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471): Couldn't send request to peer 669aa21e7c0b483092cce23f10f25330. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260926 13:55:54.161475 10824 consensus_peers.cc:597] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 -> Peer 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471): Couldn't send request to peer 669aa21e7c0b483092cce23f10f25330. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:54.187729 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:54.188454 3582 tablet_replica.cc:333] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.189239 3582 raft_consensus.cc:2243] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.189935 3582 raft_consensus.cc:2272] T aa9814f431034deaa79ff47944219096 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.193174 3582 tablet_replica.cc:333] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.193740 3582 raft_consensus.cc:2243] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.194207 3582 raft_consensus.cc:2272] T fe33aee2fd874d14ab467dba7cf2cfe0 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.196925 3582 tablet_replica.cc:333] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.197407 3582 raft_consensus.cc:2243] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.198125 3582 raft_consensus.cc:2272] T d39e03afe6704e7bba77f0941dc30643 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.200417 3582 tablet_replica.cc:333] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.201088 3582 raft_consensus.cc:2243] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.201673 3582 raft_consensus.cc:2272] T 484dbf4e632b48299225e39e38717061 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.204241 3582 tablet_replica.cc:333] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.204713 3582 raft_consensus.cc:2243] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.205371 3582 raft_consensus.cc:2272] T 1f03301b2d10417296862fd5eeaf87e1 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.208393 3582 tablet_replica.cc:333] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.208902 3582 raft_consensus.cc:2243] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.209329 3582 raft_consensus.cc:2272] T 212603e16fe2480aac71d2ac21eefb26 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.212139 3582 tablet_replica.cc:333] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.212634 3582 raft_consensus.cc:2243] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.213362 3582 raft_consensus.cc:2272] T faffe1f667e94043a7f0e88d5675d6a7 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.216358 3582 tablet_replica.cc:333] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.217075 3582 raft_consensus.cc:2243] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.217638 3582 raft_consensus.cc:2272] T 3926163f8af4418f926fa759704c2c76 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:54.219485 10748 consensus_peers.cc:597] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 -> Peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Couldn't send request to peer f920959ad42f4f37a2c310cf272d4012. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:45833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:54.222075 3582 tablet_replica.cc:333] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.222739 3582 raft_consensus.cc:2243] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.223332 3582 raft_consensus.cc:2272] T 8c7a95df58a742a69e1cface7c9d6e36 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.226325 3582 tablet_replica.cc:333] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330: stopping tablet replica
I20260926 13:55:54.226925 3582 raft_consensus.cc:2243] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.227769 3582 raft_consensus.cc:2272] T 848023f09b4b43409266078bcd364325 P 669aa21e7c0b483092cce23f10f25330 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:54.249994 10822 consensus_peers.cc:597] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 -> Peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Couldn't send request to peer f920959ad42f4f37a2c310cf272d4012. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:45833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260926 13:55:54.250573 10822 consensus_peers.cc:597] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 -> Peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Couldn't send request to peer f920959ad42f4f37a2c310cf272d4012. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:45833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:54.258567 3582 tablet_server.cc:196] TabletServer@127.3.127.130:0 shutdown complete.
W20260926 13:55:54.277050 10822 consensus_peers.cc:597] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 -> Peer f920959ad42f4f37a2c310cf272d4012 (127.3.127.129:45833): Couldn't send request to peer f920959ad42f4f37a2c310cf272d4012. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.129:45833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260926 13:55:54.289616 10824 consensus_peers.cc:597] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 -> Peer 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471): Couldn't send request to peer 669aa21e7c0b483092cce23f10f25330. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.130:42471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:54.293216 3582 tablet_server.cc:179] TabletServer@127.3.127.131:0 shutting down...
W20260926 13:55:54.311553 10824 consensus_peers.cc:597] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 -> Peer 669aa21e7c0b483092cce23f10f25330 (127.3.127.130:42471): Couldn't send request to peer 669aa21e7c0b483092cce23f10f25330. Status: Network error: Client connection negotiation failed: client connection to 127.3.127.130:42471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260926 13:55:54.322854 3582 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260926 13:55:54.323659 3582 tablet_replica.cc:333] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.324430 3582 raft_consensus.cc:2243] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.325291 3582 raft_consensus.cc:2272] T aa9814f431034deaa79ff47944219096 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.328516 3582 tablet_replica.cc:333] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.329191 3582 raft_consensus.cc:2243] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.329792 3582 raft_consensus.cc:2272] T 848023f09b4b43409266078bcd364325 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.333133 3582 tablet_replica.cc:333] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.333787 3582 raft_consensus.cc:2243] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.334664 3582 raft_consensus.cc:2272] T 212603e16fe2480aac71d2ac21eefb26 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.337548 3582 tablet_replica.cc:333] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.338187 3582 raft_consensus.cc:2243] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.339042 3582 raft_consensus.cc:2272] T fe33aee2fd874d14ab467dba7cf2cfe0 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.341971 3582 tablet_replica.cc:333] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.342625 3582 raft_consensus.cc:2243] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.343461 3582 raft_consensus.cc:2272] T 8c7a95df58a742a69e1cface7c9d6e36 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.346401 3582 tablet_replica.cc:333] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.347051 3582 raft_consensus.cc:2243] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.347551 3582 raft_consensus.cc:2272] T d39e03afe6704e7bba77f0941dc30643 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.350452 3582 tablet_replica.cc:333] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.351084 3582 raft_consensus.cc:2243] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.351845 3582 raft_consensus.cc:2272] T 484dbf4e632b48299225e39e38717061 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.354596 3582 tablet_replica.cc:333] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.355187 3582 raft_consensus.cc:2243] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.356010 3582 raft_consensus.cc:2272] T 1f03301b2d10417296862fd5eeaf87e1 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.358798 3582 tablet_replica.cc:333] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.359385 3582 raft_consensus.cc:2243] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260926 13:55:54.359922 3582 raft_consensus.cc:2272] T faffe1f667e94043a7f0e88d5675d6a7 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:54.362839 3582 tablet_replica.cc:333] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44: stopping tablet replica
I20260926 13:55:54.363404 3582 raft_consensus.cc:2243] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 1 LEADER]: Raft consensus shutting down.
I20260926 13:55:54.364225 3582 raft_consensus.cc:2272] T 3926163f8af4418f926fa759704c2c76 P a59bee4e3229456e8b0dd0f194721c44 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260926 13:55:55.396013 3582 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10880)
W20260926 13:55:56.396392 3582 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10880)
I20260926 13:55:56.625962 3582 tablet_server.cc:196] TabletServer@127.3.127.131:0 shutdown complete.
I20260926 13:55:56.647375 3582 master.cc:562] Master@127.3.127.190:39363 shutting down...
I20260926 13:55:56.664842 3582 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 2 LEADER]: Raft consensus shutting down.
I20260926 13:55:56.665336 3582 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f3594ecd5eb24a74ba9b8aea7183f0b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260926 13:55:56.665642 3582 tablet_replica.cc:333] stopping tablet replica
I20260926 13:55:56.684556 3582 master.cc:584] Master@127.3.127.190:39363 shutdown complete.
[ OK ] PickServer/ReplicaSelectionTest.ReplicaSelection/2 (9768 ms)
[----------] 3 tests from PickServer/ReplicaSelectionTest (30030 ms total)
[----------] Global test environment tear-down
[==========] 26 tests from 5 test suites ran. (66133 ms total)
[ PASSED ] 25 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] ScanTokenStaleRaftMembershipTest.TabletLeaderChange
1 FAILED TEST
I20260926 13:55:56.737406 3582 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~2 seconds ago
I20260926 13:55:56.737623 3582 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:4845: suppressed but not reported on 1 messages since previous log ~30 seconds ago
I20260926 13:55:56.737828 3582 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2433: suppressed but not reported on 59 messages since previous log ~16 seconds ago