[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from UpdateScanDeltaCompactionTest
[ RUN ] UpdateScanDeltaCompactionTest.TestAll
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 07:58:41.483873 7409 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.60.126:33175
I20240502 07:58:41.484786 7409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 07:58:41.485392 7409 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 07:58:41.492415 7414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 07:58:41.493249 7417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 07:58:41.493921 7415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 07:58:41.494880 7409 server_base.cc:1034] running on GCE node
I20240502 07:58:41.495558 7409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 07:58:41.495707 7409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 07:58:41.495788 7409 hybrid_clock.cc:648] HybridClock initialized: now 1714636721495785 us; error 0 us; skew 500 ppm
I20240502 07:58:41.502338 7409 webserver.cc:460] Webserver started at http://127.7.60.126:46493/ using document root <none> and password file <none>
I20240502 07:58:41.502943 7409 fs_manager.cc:359] Metadata directory not provided
I20240502 07:58:41.503019 7409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 07:58:41.503255 7409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 07:58:41.505123 7409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/master-0-root/instance:
uuid: "d7a62cc44b7444719979ddb0ec47a408"
format_stamp: "Formatted at 2024-05-02 07:58:41 on dist-test-slave-9d60"
I20240502 07:58:41.508920 7409 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20240502 07:58:41.511188 7422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 07:58:41.512351 7409 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 07:58:41.512476 7409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/master-0-root
uuid: "d7a62cc44b7444719979ddb0ec47a408"
format_stamp: "Formatted at 2024-05-02 07:58:41 on dist-test-slave-9d60"
I20240502 07:58:41.512593 7409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 07:58:41.528862 7409 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 07:58:41.529546 7409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 07:58:41.529719 7409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 07:58:41.536425 7409 rpc_server.cc:307] RPC server started. Bound to: 127.7.60.126:33175
I20240502 07:58:41.536435 7474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.60.126:33175 every 8 connection(s)
I20240502 07:58:41.538540 7475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 07:58:41.544203 7475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408: Bootstrap starting.
I20240502 07:58:41.546496 7475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408: Neither blocks nor log segments found. Creating new log.
I20240502 07:58:41.547142 7475 log.cc:824] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408: Log is configured to *not* fsync() on all Append() calls
I20240502 07:58:41.548664 7475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408: No bootstrap required, opened a new log
I20240502 07:58:41.551548 7475 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7a62cc44b7444719979ddb0ec47a408" member_type: VOTER }
I20240502 07:58:41.551712 7475 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 07:58:41.551813 7475 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7a62cc44b7444719979ddb0ec47a408, State: Initialized, Role: FOLLOWER
I20240502 07:58:41.552424 7475 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7a62cc44b7444719979ddb0ec47a408" member_type: VOTER }
I20240502 07:58:41.552575 7475 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 07:58:41.552647 7475 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 07:58:41.552968 7475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 0 FOLLOWER]: Advancing to term 1
I20240502 07:58:41.553841 7475 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7a62cc44b7444719979ddb0ec47a408" member_type: VOTER }
I20240502 07:58:41.554289 7475 leader_election.cc:302] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7a62cc44b7444719979ddb0ec47a408; no voters:
I20240502 07:58:41.554598 7475 leader_election.cc:288] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 07:58:41.554749 7478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 07:58:41.555027 7478 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [term 1 LEADER]: Becoming Leader. State: Replica: d7a62cc44b7444719979ddb0ec47a408, State: Running, Role: LEADER
I20240502 07:58:41.555495 7478 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7a62cc44b7444719979ddb0ec47a408" member_type: VOTER }
I20240502 07:58:41.555614 7475 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 07:58:41.557336 7479 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7a62cc44b7444719979ddb0ec47a408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7a62cc44b7444719979ddb0ec47a408" member_type: VOTER } }
I20240502 07:58:41.557336 7480 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7a62cc44b7444719979ddb0ec47a408. Latest consensus state: current_term: 1 leader_uuid: "d7a62cc44b7444719979ddb0ec47a408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7a62cc44b7444719979ddb0ec47a408" member_type: VOTER } }
I20240502 07:58:41.557498 7480 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [sys.catalog]: This master's current role is: LEADER
I20240502 07:58:41.557499 7479 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408 [sys.catalog]: This master's current role is: LEADER
I20240502 07:58:41.557813 7409 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 07:58:41.558342 7492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 07:58:41.560539 7492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 07:58:41.565178 7492 catalog_manager.cc:1347] Generated new cluster ID: ddb88a627cd243378fdde0a2c74f2b01
I20240502 07:58:41.565249 7492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 07:58:41.575548 7492 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 07:58:41.576761 7492 catalog_manager.cc:1504] Loading token signing keys...
I20240502 07:58:41.586791 7492 catalog_manager.cc:5857] T 00000000000000000000000000000000 P d7a62cc44b7444719979ddb0ec47a408: Generated new TSK 0
I20240502 07:58:41.587452 7492 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 07:58:41.590651 7409 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 07:58:41.593818 7498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 07:58:41.594612 7497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 07:58:41.595376 7500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 07:58:41.596115 7409 server_base.cc:1034] running on GCE node
I20240502 07:58:41.596321 7409 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 07:58:41.596369 7409 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 07:58:41.596407 7409 hybrid_clock.cc:648] HybridClock initialized: now 1714636721596407 us; error 0 us; skew 500 ppm
I20240502 07:58:41.597478 7409 webserver.cc:460] Webserver started at http://127.7.60.65:37851/ using document root <none> and password file <none>
I20240502 07:58:41.597648 7409 fs_manager.cc:359] Metadata directory not provided
I20240502 07:58:41.597708 7409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 07:58:41.597788 7409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 07:58:41.598245 7409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/ts-0-root/instance:
uuid: "009b29d7a7504a629f0641196e8c2a30"
format_stamp: "Formatted at 2024-05-02 07:58:41 on dist-test-slave-9d60"
I20240502 07:58:41.600137 7409 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 07:58:41.601372 7505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 07:58:41.601773 7409 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240502 07:58:41.601873 7409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/ts-0-root
uuid: "009b29d7a7504a629f0641196e8c2a30"
format_stamp: "Formatted at 2024-05-02 07:58:41 on dist-test-slave-9d60"
I20240502 07:58:41.601961 7409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOW_VQ4/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714636721473981-7409-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 07:58:41.611056 7409 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 07:58:41.611517 7409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 07:58:41.612016 7409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 07:58:41.612773 7409 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 07:58:41.612828 7409 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 07:58:41.612872 7409 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 07:58:41.612903 7409 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 07:58:41.619071 7409 rpc_server.cc:307] RPC server started. Bound to: 127.7.60.65:33165
I20240502 07:58:41.619115 7568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.60.65:33165 every 8 connection(s)
I20240502 07:58:41.629359 7569 heartbeater.cc:347] Connected to a master server at 127.7.60.126:33175
I20240502 07:58:41.629616 7569 heartbeater.cc:464] Registering TS with master...
I20240502 07:58:41.630116 7569 heartbeater.cc:511] Master 127.7.60.126:33175 requested a full tablet report, sending...
I20240502 07:58:41.631587 7439 ts_manager.cc:194] Registered new tserver with Master: 009b29d7a7504a629f0641196e8c2a30 (127.7.60.65:33165)
I20240502 07:58:41.632007 7409 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.012362191s
I20240502 07:58:41.633090 7439 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43502
I20240502 07:58:41.642495 7439 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43504:
name: "update-scan-delta-compact-tbl"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int64"
type: INT64
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 07:58:41.656769 7533 tablet_service.cc:1467] Processing CreateTablet for tablet f97c7f4b54b74abaa2b8c937a193afc6 (DEFAULT_TABLE table=update-scan-delta-compact-tbl [id=0ea8703c06604d2e8c1383ddcda7fb03]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 07:58:41.657231 7533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f97c7f4b54b74abaa2b8c937a193afc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 07:58:41.659353 7581 tablet_bootstrap.cc:492] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30: Bootstrap starting.
I20240502 07:58:41.660416 7581 tablet_bootstrap.cc:654] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30: Neither blocks nor log segments found. Creating new log.
I20240502 07:58:41.661458 7581 tablet_bootstrap.cc:492] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30: No bootstrap required, opened a new log
I20240502 07:58:41.661558 7581 ts_tablet_manager.cc:1367] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 07:58:41.661983 7581 raft_consensus.cc:348] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009b29d7a7504a629f0641196e8c2a30" member_type: VOTER last_known_addr { host: "127.7.60.65" port: 33165 } }
I20240502 07:58:41.662097 7581 raft_consensus.cc:374] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 07:58:41.662137 7581 raft_consensus.cc:729] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 009b29d7a7504a629f0641196e8c2a30, State: Initialized, Role: FOLLOWER
I20240502 07:58:41.662281 7581 consensus_queue.cc:260] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009b29d7a7504a629f0641196e8c2a30" member_type: VOTER last_known_addr { host: "127.7.60.65" port: 33165 } }
I20240502 07:58:41.662374 7581 raft_consensus.cc:388] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 07:58:41.662425 7581 raft_consensus.cc:482] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 07:58:41.662477 7581 raft_consensus.cc:3037] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 0 FOLLOWER]: Advancing to term 1
I20240502 07:58:41.663172 7581 raft_consensus.cc:504] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009b29d7a7504a629f0641196e8c2a30" member_type: VOTER last_known_addr { host: "127.7.60.65" port: 33165 } }
I20240502 07:58:41.663303 7581 leader_election.cc:302] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 009b29d7a7504a629f0641196e8c2a30; no voters:
I20240502 07:58:41.663511 7581 leader_election.cc:288] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 07:58:41.663829 7584 raft_consensus.cc:2781] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 07:58:41.664108 7584 raft_consensus.cc:686] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [term 1 LEADER]: Becoming Leader. State: Replica: 009b29d7a7504a629f0641196e8c2a30, State: Running, Role: LEADER
I20240502 07:58:41.663889 7581 ts_tablet_manager.cc:1398] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 07:58:41.664287 7569 heartbeater.cc:503] Master 127.7.60.126:33175 was elected leader, sending a full tablet report...
I20240502 07:58:41.664477 7584 consensus_queue.cc:237] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009b29d7a7504a629f0641196e8c2a30" member_type: VOTER last_known_addr { host: "127.7.60.65" port: 33165 } }
I20240502 07:58:41.667011 7439 catalog_manager.cc:5484] T f97c7f4b54b74abaa2b8c937a193afc6 P 009b29d7a7504a629f0641196e8c2a30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 009b29d7a7504a629f0641196e8c2a30 (127.7.60.65). New cstate: current_term: 1 leader_uuid: "009b29d7a7504a629f0641196e8c2a30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "009b29d7a7504a629f0641196e8c2a30" member_type: VOTER last_known_addr { host: "127.7.60.65" port: 33165 } health_report { overall_health: HEALTHY } } }
I20240502 07:58:45.620411 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=8.827903
I20240502 07:58:47.376125 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 1.755s user 1.734s sys 0.016s Metrics: {"bytes_written":333161,"cfile_init":1,"compiler_manager_pool.queue_time_us":5056,"compiler_manager_pool.run_cpu_time_us":242058,"compiler_manager_pool.run_wall_time_us":245690,"dirs.queue_time_us":212,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":1103,"drs_written":1,"lbm_read_time_us":95,"lbm_reads_lt_1ms":4,"lbm_write_time_us":10765,"lbm_writes_lt_1ms":157,"peak_mem_usage":0,"rows_written":120001,"thread_start_us":196,"threads_started":2}
I20240502 07:58:47.377233 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6): 803664 bytes on disk
I20240502 07:58:47.377890 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4}
I20240502 07:58:49.378687 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=6.843528
I20240502 07:58:50.814721 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 1.436s user 1.426s sys 0.000s Metrics: {"bytes_written":281510,"cfile_init":1,"dirs.queue_time_us":192,"dirs.run_cpu_time_us":181,"dirs.run_wall_time_us":1114,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9500,"lbm_writes_lt_1ms":140,"peak_mem_usage":0,"rows_written":105000,"thread_start_us":84,"threads_started":1}
I20240502 07:58:50.815829 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6): 702239 bytes on disk
I20240502 07:58:50.816362 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4}
I20240502 07:58:50.816852 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=0.014431
I20240502 07:58:52.939815 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 2.123s user 2.110s sys 0.012s Metrics: {"bytes_written":620102,"cfile_cache_hit":10,"cfile_cache_hit_bytes":2716,"cfile_cache_miss":266,"cfile_cache_miss_bytes":3139638,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":985,"dirs.run_cpu_time_us":232,"dirs.run_wall_time_us":1857,"drs_written":1,"lbm_read_time_us":7839,"lbm_reads_lt_1ms":286,"lbm_write_time_us":15605,"lbm_writes_lt_1ms":278,"num_input_rowsets":2,"peak_mem_usage":1912232,"rows_written":225001,"spinlock_wait_cycles":1920,"thread_start_us":439,"threads_started":6}
I20240502 07:58:52.940526 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=4.859153
I20240502 07:58:54.173648 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 1.233s user 1.223s sys 0.008s Metrics: {"bytes_written":245946,"cfile_init":1,"dirs.queue_time_us":1738,"dirs.run_cpu_time_us":157,"dirs.run_wall_time_us":833,"drs_written":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7968,"lbm_writes_lt_1ms":124,"peak_mem_usage":0,"rows_written":92000,"thread_start_us":105,"threads_started":1}
I20240502 07:58:54.174234 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=0.014198
I20240502 07:58:57.182878 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 3.008s user 2.980s sys 0.028s Metrics: {"bytes_written":873786,"cfile_cache_hit":10,"cfile_cache_hit_bytes":3706,"cfile_cache_miss":370,"cfile_cache_miss_bytes":4440518,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":625,"dirs.run_cpu_time_us":260,"dirs.run_wall_time_us":1389,"drs_written":1,"lbm_read_time_us":10875,"lbm_reads_lt_1ms":398,"lbm_write_time_us":22264,"lbm_writes_lt_1ms":385,"num_input_rowsets":2,"peak_mem_usage":3618365,"rows_written":317001,"thread_start_us":399,"threads_started":6}
I20240502 07:58:57.183494 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6): 2129428 bytes on disk
I20240502 07:58:57.184018 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4}
I20240502 07:58:57.184370 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=7.835715
I20240502 07:58:58.650666 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 1.466s user 1.463s sys 0.000s Metrics: {"bytes_written":305804,"cfile_init":1,"dirs.queue_time_us":239,"dirs.run_cpu_time_us":152,"dirs.run_wall_time_us":780,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9362,"lbm_writes_lt_1ms":149,"peak_mem_usage":0,"rows_written":113000,"thread_start_us":94,"threads_started":1}
I20240502 07:58:58.651387 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=0.013910
I20240502 07:59:02.711930 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 4.060s user 4.017s sys 0.032s Metrics: {"bytes_written":1184431,"cfile_cache_hit":10,"cfile_cache_hit_bytes":4985,"cfile_cache_miss":500,"cfile_cache_miss_bytes":6036841,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":866,"dirs.run_cpu_time_us":257,"dirs.run_wall_time_us":1686,"drs_written":1,"lbm_read_time_us":15118,"lbm_reads_lt_1ms":524,"lbm_write_time_us":27599,"lbm_writes_lt_1ms":517,"mutex_wait_us":31,"num_input_rowsets":2,"peak_mem_usage":5113262,"rows_written":430001,"spinlock_wait_cycles":2304,"thread_start_us":472,"threads_started":7}
I20240502 07:59:02.712625 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6): 2889827 bytes on disk
I20240502 07:59:02.713032 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: UndoDeltaBlockGCOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":45,"lbm_reads_lt_1ms":4}
I20240502 07:59:02.713364 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=12.796653
I20240502 07:59:04.711894 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 1.998s user 1.977s sys 0.011s Metrics: {"bytes_written":390707,"cfile_init":1,"dirs.queue_time_us":199,"dirs.run_cpu_time_us":162,"dirs.run_wall_time_us":985,"drs_written":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4,"lbm_write_time_us":13084,"lbm_writes_lt_1ms":188,"peak_mem_usage":0,"rows_written":147000,"thread_start_us":97,"threads_started":1}
I20240502 07:59:04.712536 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=0.013538
I20240502 07:59:10.190869 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 5.478s user 5.439s sys 0.024s Metrics: {"bytes_written":1588880,"cfile_cache_hit":10,"cfile_cache_hit_bytes":6562,"cfile_cache_miss":672,"cfile_cache_miss_bytes":8106882,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":840,"dirs.run_cpu_time_us":209,"dirs.run_wall_time_us":1110,"drs_written":1,"lbm_read_time_us":19454,"lbm_reads_lt_1ms":696,"lbm_write_time_us":37906,"lbm_writes_lt_1ms":685,"num_input_rowsets":2,"peak_mem_usage":6949383,"rows_written":577001,"thread_start_us":494,"threads_started":7}
I20240502 07:59:10.191622 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=19.741965
I20240502 07:59:12.770159 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 2.578s user 2.546s sys 0.016s Metrics: {"bytes_written":532999,"cfile_init":1,"dirs.queue_time_us":215,"dirs.run_cpu_time_us":185,"dirs.run_wall_time_us":759,"drs_written":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4,"lbm_write_time_us":16196,"lbm_writes_lt_1ms":250,"peak_mem_usage":0,"rows_written":200000,"thread_start_us":101,"threads_started":1}
I20240502 07:59:12.770860 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=1.000000
I20240502 07:59:13.650699 7510 maintenance_manager.cc:643] P 009b29d7a7504a629f0641196e8c2a30: FlushMRSOp(f97c7f4b54b74abaa2b8c937a193afc6) complete. Timing: real 0.880s user 0.867s sys 0.009s Metrics: {"bytes_written":173074,"cfile_init":1,"dirs.queue_time_us":210,"dirs.run_cpu_time_us":167,"dirs.run_wall_time_us":799,"drs_written":1,"lbm_read_time_us":37,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5838,"lbm_writes_lt_1ms":91,"peak_mem_usage":0,"rows_written":64000,"thread_start_us":101,"threads_started":1}
I20240502 07:59:13.651392 7570 maintenance_manager.cc:419] P 009b29d7a7504a629f0641196e8c2a30: Scheduling CompactRowSetsOp(f97c7f4b54b74abaa2b8c937a193afc6): perf score=0.021870
I20240502 07:59:18.641897 7409 update_scan_delta_compact-test.cc:209] Time spent Insert: real 36.965s user 35.002s sys 1.695s
I20240502 07:59:18.645131 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.648794 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.650396 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.652562 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.654525 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.656428 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.658304 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.660182 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.662014 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.663847 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.665843 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.667666 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.669492 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.671353 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.673173 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.675259 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.677026 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.679934 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 07:59:18.684682 7628 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
F20240502 07:59:18.685654 7628 monotime.cc:342] Check failed: t_beg.Initialized()
*** Check failure stack trace: ***
*** Aborted at 1714636758 (unix time) try "date -d @1714636758" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800001cf1) received by PID 7409 (TID 0x7ff32b32b700) from PID 7409; stack trace: ***
@ 0x7ff387e81980 (unknown) at ??:0
@ 0x7ff385ee1fb7 gsignal at ??:0
@ 0x7ff385ee3921 abort at ??:0
@ 0x7ff386a50dcd google::LogMessage::Fail() at ??:0
@ 0x7ff386a54b93 google::LogMessage::SendToLog() at ??:0
@ 0x7ff386a507cc google::LogMessage::Flush() at ??:0
@ 0x7ff386a51f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff3877455b1 kudu::operator-() at ??:0
@ 0x7ff3885f0fd2 kudu::tablet::WriteOp::ToString() at ??:0
@ 0x7ff3885da05b kudu::tablet::OpDriver::ToStringUnlocked() at ??:0
@ 0x7ff3885d9f90 kudu::tablet::OpDriver::ToString() at ??:0
@ 0x7ff3885b09bd kudu::tablet::TabletReplica::GetInFlightOps() at ??:0
@ 0x7ff389090861 kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0
@ 0x7ff38908f93a _ZZN4kudu7tserver24TabletServerPathHandlers8RegisterEPNS_9WebserverEENKUlRKNS_19WebCallbackRegistry10WebRequestEPNS4_22PrerenderedWebResponseEE2_clES7_S9_ at ??:0
@ 0x7ff389098149 _ZNSt17_Function_handlerIFvRKN4kudu19WebCallbackRegistry10WebRequestEPNS1_22PrerenderedWebResponseEEZNS0_7tserver24TabletServerPathHandlers8RegisterEPNS0_9WebserverEEUlS4_S6_E2_E9_M_invokeERKSt9_Any_dataS4_OS6_ at ??:0
@ 0x7ff385669d09 std::function<>::operator()() at ??:0
@ 0x7ff385664143 kudu::Webserver::RunPathHandler() at ??:0
@ 0x7ff385663a38 kudu::Webserver::BeginRequestCallback() at ??:0
@ 0x7ff385663123 kudu::Webserver::BeginRequestCallbackStatic() at ??:0
@ 0x7ff38568bb89 handle_request at ??:0
@ 0x7ff38568e26b worker_thread at ??:0
@ 0x7ff387e766db start_thread at ??:0
@ 0x7ff385fc471f clone at ??:0