Diagnosed failure

UpdateScanDeltaCompactionTest.TestAll: Unrecognized error type. Please see the error log for more information.

Full log

[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from UpdateScanDeltaCompactionTest
[ RUN      ] UpdateScanDeltaCompactionTest.TestAll
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 14:08:47.371685 19050 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.18.154.190:43743
I20240501 14:08:47.372608 19050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 14:08:47.373214 19050 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:08:47.380277 19055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:08:47.380672 19056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:08:47.380887 19058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:08:47.381393 19050 server_base.cc:1034] running on GCE node
I20240501 14:08:47.381883 19050 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:08:47.381984 19050 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:08:47.382032 19050 hybrid_clock.cc:648] HybridClock initialized: now 1714572527382031 us; error 0 us; skew 500 ppm
I20240501 14:08:47.388995 19050 webserver.cc:460] Webserver started at http://127.18.154.190:44095/ using document root <none> and password file <none>
I20240501 14:08:47.389547 19050 fs_manager.cc:359] Metadata directory not provided
I20240501 14:08:47.389611 19050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:08:47.389850 19050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:08:47.391680 19050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/master-0-root/instance:
uuid: "729ef692a28c49d29f3a5a132f4bd164"
format_stamp: "Formatted at 2024-05-01 14:08:47 on dist-test-slave-bs5v"
I20240501 14:08:47.395234 19050 fs_manager.cc:691] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20240501 14:08:47.397411 19063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240501 14:08:47.398463 19050 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20240501 14:08:47.398576 19050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/master-0-root
uuid: "729ef692a28c49d29f3a5a132f4bd164"
format_stamp: "Formatted at 2024-05-01 14:08:47 on dist-test-slave-bs5v"
I20240501 14:08:47.398674 19050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:08:47.413234 19050 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240501 14:08:47.413910 19050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 14:08:47.414080 19050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:08:47.421144 19050 rpc_server.cc:307] RPC server started. Bound to: 127.18.154.190:43743
I20240501 14:08:47.421149 19115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.154.190:43743 every 8 connection(s)
I20240501 14:08:47.423403 19116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:08:47.429149 19116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164: Bootstrap starting.
I20240501 14:08:47.431419 19116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164: Neither blocks nor log segments found. Creating new log.
I20240501 14:08:47.432037 19116 log.cc:824] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164: Log is configured to *not* fsync() on all Append() calls
I20240501 14:08:47.433583 19116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164: No bootstrap required, opened a new log
I20240501 14:08:47.436616 19116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729ef692a28c49d29f3a5a132f4bd164" member_type: VOTER }
I20240501 14:08:47.436789 19116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:08:47.436831 19116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729ef692a28c49d29f3a5a132f4bd164, State: Initialized, Role: FOLLOWER
I20240501 14:08:47.437376 19116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729ef692a28c49d29f3a5a132f4bd164" member_type: VOTER }
I20240501 14:08:47.437505 19116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:08:47.437553 19116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:08:47.437644 19116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:08:47.438397 19116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729ef692a28c49d29f3a5a132f4bd164" member_type: VOTER }
I20240501 14:08:47.438803 19116 leader_election.cc:302] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 729ef692a28c49d29f3a5a132f4bd164; no voters: 
I20240501 14:08:47.439071 19116 leader_election.cc:288] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240501 14:08:47.439213 19119 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:08:47.439455 19119 raft_consensus.cc:686] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [term 1 LEADER]: Becoming Leader. State: Replica: 729ef692a28c49d29f3a5a132f4bd164, State: Running, Role: LEADER
I20240501 14:08:47.439888 19119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729ef692a28c49d29f3a5a132f4bd164" member_type: VOTER }
I20240501 14:08:47.440030 19116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 14:08:47.441813 19120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "729ef692a28c49d29f3a5a132f4bd164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729ef692a28c49d29f3a5a132f4bd164" member_type: VOTER } }
I20240501 14:08:47.441826 19121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 729ef692a28c49d29f3a5a132f4bd164. Latest consensus state: current_term: 1 leader_uuid: "729ef692a28c49d29f3a5a132f4bd164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "729ef692a28c49d29f3a5a132f4bd164" member_type: VOTER } }
I20240501 14:08:47.441957 19120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [sys.catalog]: This master's current role is: LEADER
I20240501 14:08:47.441957 19121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164 [sys.catalog]: This master's current role is: LEADER
I20240501 14:08:47.442112 19050 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20240501 14:08:47.444132 19133 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240501 14:08:47.444195 19133 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240501 14:08:47.444269 19134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 14:08:47.444972 19134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 14:08:47.449837 19134 catalog_manager.cc:1347] Generated new cluster ID: 99c871e7f686494480b8464c74cbfa74
I20240501 14:08:47.449905 19134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 14:08:47.466029 19134 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 14:08:47.467294 19134 catalog_manager.cc:1504] Loading token signing keys...
I20240501 14:08:47.475415 19134 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 729ef692a28c49d29f3a5a132f4bd164: Generated new TSK 0
I20240501 14:08:47.476217 19134 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 14:08:47.507051 19050 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 14:08:47.509992 19138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:08:47.510119 19141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 14:08:47.510541 19139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 14:08:47.511369 19050 server_base.cc:1034] running on GCE node
I20240501 14:08:47.511585 19050 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 14:08:47.511627 19050 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 14:08:47.511642 19050 hybrid_clock.cc:648] HybridClock initialized: now 1714572527511643 us; error 0 us; skew 500 ppm
I20240501 14:08:47.512992 19050 webserver.cc:460] Webserver started at http://127.18.154.129:36283/ using document root <none> and password file <none>
I20240501 14:08:47.513175 19050 fs_manager.cc:359] Metadata directory not provided
I20240501 14:08:47.513223 19050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 14:08:47.513320 19050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 14:08:47.513751 19050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/ts-0-root/instance:
uuid: "2986bee26c7645129553fad80c7f2efa"
format_stamp: "Formatted at 2024-05-01 14:08:47 on dist-test-slave-bs5v"
I20240501 14:08:47.515460 19050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20240501 14:08:47.516435 19146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240501 14:08:47.516680 19050 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20240501 14:08:47.516748 19050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/ts-0-root
uuid: "2986bee26c7645129553fad80c7f2efa"
format_stamp: "Formatted at 2024-05-01 14:08:47 on dist-test-slave-bs5v"
I20240501 14:08:47.516822 19050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCAx62B/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714572527361795-19050-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 14:08:47.555052 19050 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240501 14:08:47.555462 19050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 14:08:47.555871 19050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 14:08:47.556622 19050 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 14:08:47.556674 19050 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20240501 14:08:47.556711 19050 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 14:08:47.556737 19050 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20240501 14:08:47.562984 19050 rpc_server.cc:307] RPC server started. Bound to: 127.18.154.129:40941
I20240501 14:08:47.563027 19209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.18.154.129:40941 every 8 connection(s)
I20240501 14:08:47.572743 19210 heartbeater.cc:347] Connected to a master server at 127.18.154.190:43743
I20240501 14:08:47.572948 19210 heartbeater.cc:464] Registering TS with master...
I20240501 14:08:47.573341 19210 heartbeater.cc:511] Master 127.18.154.190:43743 requested a full tablet report, sending...
I20240501 14:08:47.574678 19079 ts_manager.cc:194] Registered new tserver with Master: 2986bee26c7645129553fad80c7f2efa (127.18.154.129:40941)
I20240501 14:08:47.574903 19050 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.011366749s
I20240501 14:08:47.575762 19079 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32858
I20240501 14:08:47.585595 19079 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32862:
name: "update-scan-delta-compact-tbl"
schema {
  columns {
    name: "key"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int64"
    type: INT64
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20240501 14:08:47.599951 19174 tablet_service.cc:1467] Processing CreateTablet for tablet ec55ca33c12c4d0cb92c2e2f3d621fd7 (DEFAULT_TABLE table=update-scan-delta-compact-tbl [id=29692bc4d96949a3a0338b6e811e7f49]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 14:08:47.600405 19174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec55ca33c12c4d0cb92c2e2f3d621fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 14:08:47.603377 19222 tablet_bootstrap.cc:492] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa: Bootstrap starting.
I20240501 14:08:47.604383 19222 tablet_bootstrap.cc:654] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa: Neither blocks nor log segments found. Creating new log.
I20240501 14:08:47.605459 19222 tablet_bootstrap.cc:492] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa: No bootstrap required, opened a new log
I20240501 14:08:47.605556 19222 ts_tablet_manager.cc:1367] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20240501 14:08:47.605942 19222 raft_consensus.cc:348] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2986bee26c7645129553fad80c7f2efa" member_type: VOTER last_known_addr { host: "127.18.154.129" port: 40941 } }
I20240501 14:08:47.606091 19222 raft_consensus.cc:374] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 14:08:47.606160 19222 raft_consensus.cc:729] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2986bee26c7645129553fad80c7f2efa, State: Initialized, Role: FOLLOWER
I20240501 14:08:47.606334 19222 consensus_queue.cc:260] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2986bee26c7645129553fad80c7f2efa" member_type: VOTER last_known_addr { host: "127.18.154.129" port: 40941 } }
I20240501 14:08:47.606464 19222 raft_consensus.cc:388] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 14:08:47.606525 19222 raft_consensus.cc:482] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 14:08:47.606580 19222 raft_consensus.cc:3037] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 0 FOLLOWER]: Advancing to term 1
I20240501 14:08:47.607251 19222 raft_consensus.cc:504] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2986bee26c7645129553fad80c7f2efa" member_type: VOTER last_known_addr { host: "127.18.154.129" port: 40941 } }
I20240501 14:08:47.607393 19222 leader_election.cc:302] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2986bee26c7645129553fad80c7f2efa; no voters: 
I20240501 14:08:47.607576 19222 leader_election.cc:288] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240501 14:08:47.607688 19224 raft_consensus.cc:2781] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 1 FOLLOWER]: Leader election won for term 1
I20240501 14:08:47.607867 19224 raft_consensus.cc:686] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [term 1 LEADER]: Becoming Leader. State: Replica: 2986bee26c7645129553fad80c7f2efa, State: Running, Role: LEADER
I20240501 14:08:47.607961 19222 ts_tablet_manager.cc:1398] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.003s
I20240501 14:08:47.608196 19210 heartbeater.cc:503] Master 127.18.154.190:43743 was elected leader, sending a full tablet report...
I20240501 14:08:47.608062 19224 consensus_queue.cc:237] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2986bee26c7645129553fad80c7f2efa" member_type: VOTER last_known_addr { host: "127.18.154.129" port: 40941 } }
I20240501 14:08:47.610993 19079 catalog_manager.cc:5484] T ec55ca33c12c4d0cb92c2e2f3d621fd7 P 2986bee26c7645129553fad80c7f2efa reported cstate change: term changed from 0 to 1, leader changed from <none> to 2986bee26c7645129553fad80c7f2efa (127.18.154.129). New cstate: current_term: 1 leader_uuid: "2986bee26c7645129553fad80c7f2efa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2986bee26c7645129553fad80c7f2efa" member_type: VOTER last_known_addr { host: "127.18.154.129" port: 40941 } health_report { overall_health: HEALTHY } } }
I20240501 14:08:49.564110 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=1.000000
I20240501 14:08:50.622911 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 1.058s	user 1.038s	sys 0.004s Metrics: {"bytes_written":173462,"cfile_init":1,"compiler_manager_pool.queue_time_us":223,"compiler_manager_pool.run_cpu_time_us":192441,"compiler_manager_pool.run_wall_time_us":193650,"dirs.queue_time_us":236,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":949,"drs_written":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5636,"lbm_writes_lt_1ms":89,"peak_mem_usage":0,"rows_written":62001,"thread_start_us":203,"threads_started":2}
I20240501 14:08:50.624003 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 416585 bytes on disk
I20240501 14:08:50.624584 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20240501 14:08:52.625303 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=3.866965
I20240501 14:08:53.735704 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 1.110s	user 1.080s	sys 0.000s Metrics: {"bytes_written":227401,"cfile_init":1,"dirs.queue_time_us":177,"dirs.run_cpu_time_us":208,"dirs.run_wall_time_us":1809,"drs_written":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6367,"lbm_writes_lt_1ms":116,"peak_mem_usage":0,"rows_written":84000,"spinlock_wait_cycles":1408,"thread_start_us":78,"threads_started":1}
I20240501 14:08:53.736724 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 562786 bytes on disk
I20240501 14:08:53.737197 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20240501 14:08:53.737692 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=0.014630
I20240501 14:08:55.283730 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 1.546s	user 1.448s	sys 0.000s Metrics: {"bytes_written":403654,"cfile_cache_hit":10,"cfile_cache_hit_bytes":1861,"cfile_cache_miss":174,"cfile_cache_miss_bytes":2039327,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":198,"dirs.run_cpu_time_us":174,"dirs.run_wall_time_us":13380,"drs_written":1,"lbm_read_time_us":4927,"lbm_reads_lt_1ms":194,"lbm_write_time_us":9999,"lbm_writes_lt_1ms":188,"num_input_rowsets":2,"peak_mem_usage":1294476,"rows_written":146001,"thread_start_us":388,"threads_started":6}
I20240501 14:08:55.284596 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=1.882590
I20240501 14:08:56.515221 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 1.230s	user 1.047s	sys 0.012s Metrics: {"bytes_written":196449,"cfile_init":1,"dirs.queue_time_us":207,"dirs.run_cpu_time_us":162,"dirs.run_wall_time_us":43357,"drs_written":1,"lbm_read_time_us":64,"lbm_reads_lt_1ms":4,"lbm_write_time_us":68502,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":102,"peak_mem_usage":0,"rows_written":72000,"thread_start_us":93,"threads_started":1}
I20240501 14:08:56.515905 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=0.014446
I20240501 14:08:58.551160 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 2.035s	user 2.004s	sys 0.020s Metrics: {"bytes_written":601158,"cfile_cache_hit":10,"cfile_cache_hit_bytes":2620,"cfile_cache_miss":262,"cfile_cache_miss_bytes":3059994,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":939,"dirs.run_cpu_time_us":207,"dirs.run_wall_time_us":1399,"drs_written":1,"lbm_read_time_us":6710,"lbm_reads_lt_1ms":290,"lbm_write_time_us":13193,"lbm_writes_lt_1ms":270,"num_input_rowsets":2,"peak_mem_usage":2334699,"rows_written":218001,"spinlock_wait_cycles":1920,"thread_start_us":400,"threads_started":6}
I20240501 14:08:58.551788 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 1461884 bytes on disk
I20240501 14:08:58.552161 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4}
I20240501 14:08:58.552543 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=3.866965
I20240501 14:08:59.663895 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 1.111s	user 1.109s	sys 0.000s Metrics: {"bytes_written":226818,"cfile_init":1,"dirs.queue_time_us":211,"dirs.run_cpu_time_us":178,"dirs.run_wall_time_us":850,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6459,"lbm_writes_lt_1ms":116,"peak_mem_usage":0,"rows_written":84000,"thread_start_us":96,"threads_started":1}
I20240501 14:08:59.664498 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 562785 bytes on disk
I20240501 14:08:59.664892 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20240501 14:08:59.665263 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=0.014235
I20240501 14:09:02.571679 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 2.906s	user 2.870s	sys 0.012s Metrics: {"bytes_written":831544,"cfile_cache_hit":10,"cfile_cache_hit_bytes":3534,"cfile_cache_miss":354,"cfile_cache_miss_bytes":4231742,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":778,"dirs.run_cpu_time_us":234,"dirs.run_wall_time_us":121263,"drs_written":1,"lbm_read_time_us":9824,"lbm_reads_lt_1ms":374,"lbm_write_time_us":18336,"lbm_writes_lt_1ms":368,"num_input_rowsets":2,"peak_mem_usage":3504624,"rows_written":302001,"spinlock_wait_cycles":2304,"thread_start_us":403,"threads_started":6}
I20240501 14:09:02.572433 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 2030178 bytes on disk
I20240501 14:09:02.572927 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4}
I20240501 14:09:02.573379 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=6.843528
I20240501 14:09:04.014411 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 1.441s	user 1.405s	sys 0.012s Metrics: {"bytes_written":291077,"cfile_init":1,"dirs.queue_time_us":177,"dirs.run_cpu_time_us":147,"dirs.run_wall_time_us":832,"drs_written":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7651,"lbm_writes_lt_1ms":144,"peak_mem_usage":0,"rows_written":109000,"thread_start_us":84,"threads_started":1}
I20240501 14:09:04.015151 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=0.013959
I20240501 14:09:07.800940 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 3.786s	user 3.766s	sys 0.004s Metrics: {"bytes_written":1132630,"cfile_cache_hit":10,"cfile_cache_hit_bytes":4655,"cfile_cache_miss":480,"cfile_cache_miss_bytes":5769507,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":827,"dirs.run_cpu_time_us":218,"dirs.run_wall_time_us":1733,"drs_written":1,"lbm_read_time_us":12563,"lbm_reads_lt_1ms":504,"lbm_write_time_us":24613,"lbm_writes_lt_1ms":494,"num_input_rowsets":2,"peak_mem_usage":4869527,"rows_written":411001,"thread_start_us":448,"threads_started":7}
I20240501 14:09:07.801776 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 2763052 bytes on disk
I20240501 14:09:07.802227 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4}
I20240501 14:09:07.802704 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=11.804465
I20240501 14:09:09.617884 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 1.815s	user 1.792s	sys 0.008s Metrics: {"bytes_written":371984,"cfile_init":1,"dirs.queue_time_us":222,"dirs.run_cpu_time_us":200,"dirs.run_wall_time_us":948,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":11425,"lbm_writes_lt_1ms":181,"peak_mem_usage":0,"rows_written":140000,"thread_start_us":111,"threads_started":1}
I20240501 14:09:09.618530 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 939453 bytes on disk
I20240501 14:09:09.618978 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4}
I20240501 14:09:09.619441 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=0.013603
I20240501 14:09:14.774843 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 5.155s	user 5.124s	sys 0.018s Metrics: {"bytes_written":1518146,"cfile_cache_hit":10,"cfile_cache_hit_bytes":6266,"cfile_cache_miss":642,"cfile_cache_miss_bytes":7741716,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":861,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":1050,"drs_written":1,"lbm_read_time_us":18054,"lbm_reads_lt_1ms":662,"lbm_write_time_us":34348,"lbm_writes_lt_1ms":656,"num_input_rowsets":2,"peak_mem_usage":6640658,"rows_written":551001,"spinlock_wait_cycles":896,"thread_start_us":543,"threads_started":7}
I20240501 14:09:14.775560 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 3703200 bytes on disk
I20240501 14:09:14.775960 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":41,"lbm_reads_lt_1ms":4}
I20240501 14:09:14.776530 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=17.757590
I20240501 14:09:17.066768 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 2.290s	user 2.280s	sys 0.009s Metrics: {"bytes_written":506340,"cfile_init":1,"dirs.queue_time_us":220,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":999,"drs_written":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4,"lbm_write_time_us":15436,"lbm_writes_lt_1ms":236,"peak_mem_usage":0,"rows_written":189000,"thread_start_us":116,"threads_started":1}
I20240501 14:09:17.067414 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 1270226 bytes on disk
I20240501 14:09:17.067950 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":83,"lbm_reads_lt_1ms":4}
I20240501 14:09:17.068406 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=0.013123
I20240501 14:09:24.006731 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: CompactRowSetsOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 6.938s	user 6.896s	sys 0.030s Metrics: {"bytes_written":2036511,"cfile_cache_hit":10,"cfile_cache_hit_bytes":8379,"cfile_cache_miss":854,"cfile_cache_miss_bytes":10405493,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":441,"dirs.run_cpu_time_us":169,"dirs.run_wall_time_us":934,"drs_written":1,"lbm_read_time_us":23994,"lbm_reads_lt_1ms":874,"lbm_write_time_us":46073,"lbm_writes_lt_1ms":874,"num_input_rowsets":2,"peak_mem_usage":8915498,"rows_written":740001,"spinlock_wait_cycles":896,"thread_start_us":484,"threads_started":7}
I20240501 14:09:24.007558 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): 4972768 bytes on disk
I20240501 14:09:24.008074 19151 maintenance_manager.cc:643] P 2986bee26c7645129553fad80c7f2efa: UndoDeltaBlockGCOp(ec55ca33c12c4d0cb92c2e2f3d621fd7) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":98,"lbm_reads_lt_1ms":4}
I20240501 14:09:24.008530 19211 maintenance_manager.cc:419] P 2986bee26c7645129553fad80c7f2efa: Scheduling FlushMRSOp(ec55ca33c12c4d0cb92c2e2f3d621fd7): perf score=26.687278
I20240501 14:09:24.330421 19050 update_scan_delta_compact-test.cc:209] Time spent Insert: real 36.713s	user 34.587s	sys 1.824s
I20240501 14:09:24.347190 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.349834 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.351697 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.353528 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.355378 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.357183 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.358994 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.360836 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.362766 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.364576 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.366417 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.368392 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.370198 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.372025 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.373818 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.375641 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.377468 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 14:09:24.379299 19282 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
F20240501 14:09:24.380196 19282 monotime.cc:342] Check failed: t_beg.Initialized() 
*** Check failure stack trace: ***
*** Aborted at 1714572564 (unix time) try "date -d @1714572564" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800004a6a) received by PID 19050 (TID 0x7f558f392700) from PID 19050; stack trace: ***
    @     0x7f55c489e980 (unknown) at ??:0
    @     0x7f55c28fefb7 gsignal at ??:0
    @     0x7f55c2900921 abort at ??:0
    @     0x7f55c346ddcd google::LogMessage::Fail() at ??:0
    @     0x7f55c3471b93 google::LogMessage::SendToLog() at ??:0
    @     0x7f55c346d7cc google::LogMessage::Flush() at ??:0
    @     0x7f55c346ef59 google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7f55c41625b1 kudu::operator-() at ??:0
    @     0x7f55c500dfd2 kudu::tablet::WriteOp::ToString() at ??:0
    @     0x7f55c4ff705b kudu::tablet::OpDriver::ToStringUnlocked() at ??:0
    @     0x7f55c4ff6f90 kudu::tablet::OpDriver::ToString() at ??:0
    @     0x7f55c4fcd9bd kudu::tablet::TabletReplica::GetInFlightOps() at ??:0
    @     0x7f55c5aad861 kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0
    @     0x7f55c5aac93a _ZZN4kudu7tserver24TabletServerPathHandlers8RegisterEPNS_9WebserverEENKUlRKNS_19WebCallbackRegistry10WebRequestEPNS4_22PrerenderedWebResponseEE2_clES7_S9_ at ??:0
    @     0x7f55c5ab5149 _ZNSt17_Function_handlerIFvRKN4kudu19WebCallbackRegistry10WebRequestEPNS1_22PrerenderedWebResponseEEZNS0_7tserver24TabletServerPathHandlers8RegisterEPNS0_9WebserverEEUlS4_S6_E2_E9_M_invokeERKSt9_Any_dataS4_OS6_ at ??:0
    @     0x7f55c2086d09 std::function<>::operator()() at ??:0
    @     0x7f55c2081143 kudu::Webserver::RunPathHandler() at ??:0
    @     0x7f55c2080a38 kudu::Webserver::BeginRequestCallback() at ??:0
    @     0x7f55c2080123 kudu::Webserver::BeginRequestCallbackStatic() at ??:0
    @     0x7f55c20a8b89 handle_request at ??:0
    @     0x7f55c20ab26b worker_thread at ??:0
    @     0x7f55c48936db start_thread at ??:0
    @     0x7f55c29e171f clone at ??:0