Diagnosed failure

UpdateScanDeltaCompactionTest.TestAll: Unrecognized error type. Please see the error log for more information.

Full log

[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from UpdateScanDeltaCompactionTest
[ RUN      ] UpdateScanDeltaCompactionTest.TestAll
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 19:55:57.334025 22913 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.96.126:36433
I20240501 19:55:57.335036 22913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 19:55:57.335686 22913 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:55:57.346946 22918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:55:57.347008 22919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:55:57.347404 22921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:55:57.348214 22913 server_base.cc:1034] running on GCE node
I20240501 19:55:57.348839 22913 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:55:57.349033 22913 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:55:57.349097 22913 hybrid_clock.cc:648] HybridClock initialized: now 1714593357349093 us; error 0 us; skew 500 ppm
I20240501 19:55:57.352108 22913 webserver.cc:460] Webserver started at http://127.22.96.126:46065/ using document root <none> and password file <none>
I20240501 19:55:57.352772 22913 fs_manager.cc:359] Metadata directory not provided
I20240501 19:55:57.352864 22913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:55:57.353155 22913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:55:57.355635 22913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/master-0-root/instance:
uuid: "b92140bd0ea44b51a95407c41ebcd8f3"
format_stamp: "Formatted at 2024-05-01 19:55:57 on dist-test-slave-7q1d"
I20240501 19:55:57.360540 22913 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20240501 19:55:57.363416 22926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240501 19:55:57.364941 22913 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20240501 19:55:57.365095 22913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/master-0-root
uuid: "b92140bd0ea44b51a95407c41ebcd8f3"
format_stamp: "Formatted at 2024-05-01 19:55:57 on dist-test-slave-7q1d"
I20240501 19:55:57.365226 22913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:55:57.392184 22913 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240501 19:55:57.392977 22913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 19:55:57.393172 22913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:55:57.400748 22913 rpc_server.cc:307] RPC server started. Bound to: 127.22.96.126:36433
I20240501 19:55:57.400811 22978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.96.126:36433 every 8 connection(s)
I20240501 19:55:57.403200 22979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:55:57.409695 22979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3: Bootstrap starting.
I20240501 19:55:57.412195 22979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3: Neither blocks nor log segments found. Creating new log.
I20240501 19:55:57.412937 22979 log.cc:824] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3: Log is configured to *not* fsync() on all Append() calls
I20240501 19:55:57.414850 22979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3: No bootstrap required, opened a new log
I20240501 19:55:57.418175 22979 raft_consensus.cc:348] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" member_type: VOTER }
I20240501 19:55:57.418402 22979 raft_consensus.cc:374] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:55:57.418449 22979 raft_consensus.cc:729] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b92140bd0ea44b51a95407c41ebcd8f3, State: Initialized, Role: FOLLOWER
I20240501 19:55:57.419176 22979 consensus_queue.cc:260] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" member_type: VOTER }
I20240501 19:55:57.419346 22979 raft_consensus.cc:388] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 19:55:57.419400 22979 raft_consensus.cc:482] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 19:55:57.419543 22979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:55:57.420441 22979 raft_consensus.cc:504] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" member_type: VOTER }
I20240501 19:55:57.420976 22979 leader_election.cc:302] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b92140bd0ea44b51a95407c41ebcd8f3; no voters: 
I20240501 19:55:57.421346 22979 leader_election.cc:288] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240501 19:55:57.421619 22982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:55:57.421947 22982 raft_consensus.cc:686] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [term 1 LEADER]: Becoming Leader. State: Replica: b92140bd0ea44b51a95407c41ebcd8f3, State: Running, Role: LEADER
I20240501 19:55:57.422385 22979 sys_catalog.cc:564] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 19:55:57.422392 22982 consensus_queue.cc:237] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" member_type: VOTER }
I20240501 19:55:57.424311 22984 sys_catalog.cc:455] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b92140bd0ea44b51a95407c41ebcd8f3. Latest consensus state: current_term: 1 leader_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" member_type: VOTER } }
I20240501 19:55:57.424444 22984 sys_catalog.cc:458] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [sys.catalog]: This master's current role is: LEADER
I20240501 19:55:57.424517 22913 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 19:55:57.424721 22983 sys_catalog.cc:455] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b92140bd0ea44b51a95407c41ebcd8f3" member_type: VOTER } }
I20240501 19:55:57.424790 22983 sys_catalog.cc:458] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3 [sys.catalog]: This master's current role is: LEADER
W20240501 19:55:57.426865 22996 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240501 19:55:57.426954 22996 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240501 19:55:57.427096 22997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 19:55:57.428460 22997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 19:55:57.434456 22997 catalog_manager.cc:1347] Generated new cluster ID: 715f7c4848ff44e2a883daee613e21d9
I20240501 19:55:57.434538 22997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 19:55:57.455205 22997 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 19:55:57.456231 22997 catalog_manager.cc:1504] Loading token signing keys...
I20240501 19:55:57.461886 22997 catalog_manager.cc:5857] T 00000000000000000000000000000000 P b92140bd0ea44b51a95407c41ebcd8f3: Generated new TSK 0
I20240501 19:55:57.462589 22997 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 19:55:57.489665 22913 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:55:57.493119 23002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:55:57.493592 23004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:55:57.494366 22913 server_base.cc:1034] running on GCE node
W20240501 19:55:57.494750 23001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:55:57.495029 22913 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:55:57.495080 22913 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:55:57.495100 22913 hybrid_clock.cc:648] HybridClock initialized: now 1714593357495100 us; error 0 us; skew 500 ppm
I20240501 19:55:57.496203 22913 webserver.cc:460] Webserver started at http://127.22.96.65:34433/ using document root <none> and password file <none>
I20240501 19:55:57.496358 22913 fs_manager.cc:359] Metadata directory not provided
I20240501 19:55:57.496412 22913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:55:57.496490 22913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:55:57.496881 22913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/ts-0-root/instance:
uuid: "b66c0550d9af494e8bc56d35fbbf76f7"
format_stamp: "Formatted at 2024-05-01 19:55:57 on dist-test-slave-7q1d"
I20240501 19:55:57.498467 22913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20240501 19:55:57.499511 23009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240501 19:55:57.499809 22913 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20240501 19:55:57.499895 22913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/ts-0-root
uuid: "b66c0550d9af494e8bc56d35fbbf76f7"
format_stamp: "Formatted at 2024-05-01 19:55:57 on dist-test-slave-7q1d"
I20240501 19:55:57.499972 22913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklgBXpJ/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714593357323161-22913-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:55:57.548072 22913 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240501 19:55:57.548579 22913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:55:57.549053 22913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:55:57.550058 22913 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:55:57.550128 22913 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20240501 19:55:57.550184 22913 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:55:57.550221 22913 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20240501 19:55:57.557700 22913 rpc_server.cc:307] RPC server started. Bound to: 127.22.96.65:42337
I20240501 19:55:57.558808 23072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.96.65:42337 every 8 connection(s)
I20240501 19:55:57.571413 23073 heartbeater.cc:347] Connected to a master server at 127.22.96.126:36433
I20240501 19:55:57.571699 23073 heartbeater.cc:464] Registering TS with master...
I20240501 19:55:57.572187 23073 heartbeater.cc:511] Master 127.22.96.126:36433 requested a full tablet report, sending...
I20240501 19:55:57.574029 22943 ts_manager.cc:194] Registered new tserver with Master: b66c0550d9af494e8bc56d35fbbf76f7 (127.22.96.65:42337)
I20240501 19:55:57.574618 22913 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.016073023s
I20240501 19:55:57.575354 22943 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45264
I20240501 19:55:57.588531 22943 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45268:
name: "update-scan-delta-compact-tbl"
schema {
  columns {
    name: "key"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int64"
    type: INT64
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20240501 19:55:57.607316 23036 tablet_service.cc:1467] Processing CreateTablet for tablet f4b099422ab24e27a36b387eae7156c8 (DEFAULT_TABLE table=update-scan-delta-compact-tbl [id=39732d531c4d45e398068616d6e80169]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 19:55:57.607815 23036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4b099422ab24e27a36b387eae7156c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:55:57.611097 23085 tablet_bootstrap.cc:492] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7: Bootstrap starting.
I20240501 19:55:57.611984 23085 tablet_bootstrap.cc:654] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7: Neither blocks nor log segments found. Creating new log.
I20240501 19:55:57.613123 23085 tablet_bootstrap.cc:492] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7: No bootstrap required, opened a new log
I20240501 19:55:57.613276 23085 ts_tablet_manager.cc:1367] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20240501 19:55:57.613689 23085 raft_consensus.cc:348] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66c0550d9af494e8bc56d35fbbf76f7" member_type: VOTER last_known_addr { host: "127.22.96.65" port: 42337 } }
I20240501 19:55:57.613822 23085 raft_consensus.cc:374] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:55:57.613857 23085 raft_consensus.cc:729] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b66c0550d9af494e8bc56d35fbbf76f7, State: Initialized, Role: FOLLOWER
I20240501 19:55:57.614096 23085 consensus_queue.cc:260] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66c0550d9af494e8bc56d35fbbf76f7" member_type: VOTER last_known_addr { host: "127.22.96.65" port: 42337 } }
I20240501 19:55:57.614208 23085 raft_consensus.cc:388] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 19:55:57.614254 23085 raft_consensus.cc:482] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 19:55:57.614336 23085 raft_consensus.cc:3037] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:55:57.615175 23085 raft_consensus.cc:504] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66c0550d9af494e8bc56d35fbbf76f7" member_type: VOTER last_known_addr { host: "127.22.96.65" port: 42337 } }
I20240501 19:55:57.615312 23085 leader_election.cc:302] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b66c0550d9af494e8bc56d35fbbf76f7; no voters: 
I20240501 19:55:57.615514 23085 leader_election.cc:288] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240501 19:55:57.615653 23087 raft_consensus.cc:2781] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:55:57.615839 23085 ts_tablet_manager.cc:1398] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20240501 19:55:57.615902 23087 raft_consensus.cc:686] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [term 1 LEADER]: Becoming Leader. State: Replica: b66c0550d9af494e8bc56d35fbbf76f7, State: Running, Role: LEADER
I20240501 19:55:57.616052 23073 heartbeater.cc:503] Master 127.22.96.126:36433 was elected leader, sending a full tablet report...
I20240501 19:55:57.616062 23087 consensus_queue.cc:237] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66c0550d9af494e8bc56d35fbbf76f7" member_type: VOTER last_known_addr { host: "127.22.96.65" port: 42337 } }
I20240501 19:55:57.619406 22943 catalog_manager.cc:5484] T f4b099422ab24e27a36b387eae7156c8 P b66c0550d9af494e8bc56d35fbbf76f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b66c0550d9af494e8bc56d35fbbf76f7 (127.22.96.65). New cstate: current_term: 1 leader_uuid: "b66c0550d9af494e8bc56d35fbbf76f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66c0550d9af494e8bc56d35fbbf76f7" member_type: VOTER last_known_addr { host: "127.22.96.65" port: 42337 } health_report { overall_health: HEALTHY } } }
I20240501 19:55:59.559031 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=1.000000
I20240501 19:56:00.470201 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.911s	user 0.905s	sys 0.004s Metrics: {"bytes_written":164229,"cfile_init":1,"compiler_manager_pool.queue_time_us":431,"compiler_manager_pool.run_cpu_time_us":194561,"compiler_manager_pool.run_wall_time_us":197480,"dirs.queue_time_us":239,"dirs.run_cpu_time_us":231,"dirs.run_wall_time_us":842,"drs_written":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5293,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":59001,"thread_start_us":212,"threads_started":2}
I20240501 19:56:00.471335 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 396273 bytes on disk
I20240501 19:56:00.471909 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4}
I20240501 19:56:02.472611 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=3.866965
I20240501 19:56:03.457042 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.984s	user 0.962s	sys 0.008s Metrics: {"bytes_written":217735,"cfile_init":1,"dirs.queue_time_us":211,"dirs.run_cpu_time_us":209,"dirs.run_wall_time_us":1346,"drs_written":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6993,"lbm_writes_lt_1ms":113,"peak_mem_usage":0,"rows_written":81000,"thread_start_us":90,"threads_started":1}
I20240501 19:56:03.458047 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8): perf score=0.014646
I20240501 19:56:04.823514 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 1.365s	user 1.347s	sys 0.016s Metrics: {"bytes_written":385142,"cfile_cache_hit":10,"cfile_cache_hit_bytes":1814,"cfile_cache_miss":170,"cfile_cache_miss_bytes":1955222,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":219,"dirs.run_cpu_time_us":210,"dirs.run_wall_time_us":1342,"drs_written":1,"lbm_read_time_us":5190,"lbm_reads_lt_1ms":194,"lbm_write_time_us":11217,"lbm_writes_lt_1ms":181,"num_input_rowsets":2,"peak_mem_usage":1245742,"rows_written":140001,"thread_start_us":106,"threads_started":1}
I20240501 19:56:04.823980 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=1.000000
I20240501 19:56:05.679946 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.856s	user 0.825s	sys 0.004s Metrics: {"bytes_written":168913,"cfile_init":1,"dirs.queue_time_us":201,"dirs.run_cpu_time_us":151,"dirs.run_wall_time_us":874,"drs_written":1,"lbm_read_time_us":37,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5396,"lbm_writes_lt_1ms":90,"peak_mem_usage":0,"rows_written":63000,"thread_start_us":92,"threads_started":1}
I20240501 19:56:05.680765 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 1362822 bytes on disk
I20240501 19:56:05.681306 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":119,"lbm_reads_lt_1ms":8}
I20240501 19:56:05.681798 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8): perf score=0.014486
I20240501 19:56:07.735390 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 2.053s	user 2.052s	sys 0.000s Metrics: {"bytes_written":559107,"cfile_cache_hit":10,"cfile_cache_hit_bytes":2434,"cfile_cache_miss":242,"cfile_cache_miss_bytes":2848040,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":958,"dirs.run_cpu_time_us":255,"dirs.run_wall_time_us":1434,"drs_written":1,"lbm_read_time_us":9449,"lbm_reads_lt_1ms":262,"lbm_write_time_us":16786,"lbm_writes_lt_1ms":254,"num_input_rowsets":2,"peak_mem_usage":2237207,"rows_written":203001,"thread_start_us":433,"threads_started":6}
I20240501 19:56:07.735956 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 1362539 bytes on disk
I20240501 19:56:07.736414 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4}
I20240501 19:56:07.736863 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=2.874778
I20240501 19:56:08.782734 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 1.046s	user 1.033s	sys 0.004s Metrics: {"bytes_written":199371,"cfile_init":1,"dirs.queue_time_us":222,"dirs.run_cpu_time_us":171,"dirs.run_wall_time_us":755,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6952,"lbm_writes_lt_1ms":105,"peak_mem_usage":0,"rows_written":74000,"thread_start_us":99,"threads_started":1}
I20240501 19:56:08.783324 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 497178 bytes on disk
I20240501 19:56:08.783787 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
I20240501 19:56:08.784227 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8): perf score=0.014298
I20240501 19:56:11.818197 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 3.034s	user 2.911s	sys 0.064s Metrics: {"bytes_written":761251,"cfile_cache_hit":10,"cfile_cache_hit_bytes":3277,"cfile_cache_miss":330,"cfile_cache_miss_bytes":3886821,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":277,"dirs.run_cpu_time_us":391,"dirs.run_wall_time_us":144467,"drs_written":1,"lbm_read_time_us":10552,"lbm_reads_lt_1ms":350,"lbm_write_time_us":21638,"lbm_writes_lt_1ms":339,"num_input_rowsets":2,"peak_mem_usage":3260886,"rows_written":277001,"thread_start_us":388,"threads_started":6}
I20240501 19:56:11.818869 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 1861391 bytes on disk
I20240501 19:56:11.819368 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4}
I20240501 19:56:11.819833 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=8.827903
I20240501 19:56:13.435811 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 1.616s	user 1.593s	sys 0.020s Metrics: {"bytes_written":314327,"cfile_init":1,"dirs.queue_time_us":174,"dirs.run_cpu_time_us":163,"dirs.run_wall_time_us":739,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9952,"lbm_writes_lt_1ms":153,"peak_mem_usage":0,"rows_written":117000,"thread_start_us":87,"threads_started":1}
I20240501 19:56:13.436611 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8): perf score=0.014002
I20240501 19:56:17.064025 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 3.627s	user 3.594s	sys 0.032s Metrics: {"bytes_written":1085620,"cfile_cache_hit":10,"cfile_cache_hit_bytes":4469,"cfile_cache_miss":460,"cfile_cache_miss_bytes":5528967,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":698,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":1302,"drs_written":1,"lbm_read_time_us":13482,"lbm_reads_lt_1ms":484,"lbm_write_time_us":25770,"lbm_writes_lt_1ms":476,"num_input_rowsets":2,"peak_mem_usage":4463304,"rows_written":394001,"thread_start_us":398,"threads_started":7}
I20240501 19:56:17.064688 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 2647848 bytes on disk
I20240501 19:56:17.065107 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4}
I20240501 19:56:17.065456 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=10.812278
I20240501 19:56:18.850026 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 1.784s	user 1.779s	sys 0.004s Metrics: {"bytes_written":363589,"cfile_init":1,"dirs.queue_time_us":196,"dirs.run_cpu_time_us":206,"dirs.run_wall_time_us":1027,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":11477,"lbm_writes_lt_1ms":177,"peak_mem_usage":0,"rows_written":136000,"thread_start_us":107,"threads_started":1}
I20240501 19:56:18.850745 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8): perf score=0.013656
I20240501 19:56:24.043448 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 5.193s	user 5.156s	sys 0.024s Metrics: {"bytes_written":1457427,"cfile_cache_hit":10,"cfile_cache_hit_bytes":6057,"cfile_cache_miss":622,"cfile_cache_miss_bytes":7445417,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":196,"dirs.run_cpu_time_us":187,"dirs.run_wall_time_us":806,"drs_written":1,"lbm_read_time_us":20926,"lbm_reads_lt_1ms":646,"lbm_write_time_us":40479,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":631,"num_input_rowsets":2,"peak_mem_usage":6364426,"rows_written":530001,"thread_start_us":100,"threads_started":1}
I20240501 19:56:24.043920 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=16.765403
I20240501 19:56:26.386183 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 2.342s	user 2.286s	sys 0.016s Metrics: {"bytes_written":493737,"cfile_init":1,"dirs.queue_time_us":205,"dirs.run_cpu_time_us":158,"dirs.run_wall_time_us":877,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":14634,"lbm_writes_lt_1ms":230,"peak_mem_usage":0,"rows_written":183000,"thread_start_us":92,"threads_started":1}
I20240501 19:56:26.386924 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 4793415 bytes on disk
I20240501 19:56:26.387475 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":134,"lbm_reads_lt_1ms":8}
I20240501 19:56:26.387923 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=1.000000
I20240501 19:56:27.218194 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: FlushMRSOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.830s	user 0.801s	sys 0.000s Metrics: {"bytes_written":160119,"cfile_init":1,"dirs.queue_time_us":176,"dirs.run_cpu_time_us":247,"dirs.run_wall_time_us":989,"drs_written":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5502,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":59000,"thread_start_us":77,"threads_started":1}
I20240501 19:56:27.219017 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8): 396258 bytes on disk
I20240501 19:56:27.219477 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: UndoDeltaBlockGCOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20240501 19:56:27.219928 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8): perf score=0.022042
I20240501 19:56:34.531018 23014 maintenance_manager.cc:643] P b66c0550d9af494e8bc56d35fbbf76f7: CompactRowSetsOp(f4b099422ab24e27a36b387eae7156c8) complete. Timing: real 7.311s	user 7.241s	sys 0.056s Metrics: {"bytes_written":2125865,"cfile_cache_hit":15,"cfile_cache_hit_bytes":8844,"cfile_cache_miss":897,"cfile_cache_miss_bytes":10853572,"cfile_init":7,"delta_iterators_relevant":6,"dirs.queue_time_us":1497,"dirs.run_cpu_time_us":379,"dirs.run_wall_time_us":381,"drs_written":1,"lbm_read_time_us":25805,"lbm_reads_lt_1ms":925,"lbm_write_time_us":53383,"lbm_writes_lt_1ms":911,"mutex_wait_us":31,"num_input_rowsets":3,"peak_mem_usage":8607053,"rows_written":772001,"spinlock_wait_cycles":1664,"thread_start_us":437,"threads_started":7}
I20240501 19:56:34.531657 23074 maintenance_manager.cc:419] P b66c0550d9af494e8bc56d35fbbf76f7: Scheduling FlushMRSOp(f4b099422ab24e27a36b387eae7156c8): perf score=21.726340
I20240501 19:56:34.970908 22913 update_scan_delta_compact-test.cc:209] Time spent Insert: real 37.343s	user 35.237s	sys 1.717s
I20240501 19:56:34.972679 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.975410 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.977031 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.978435 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.979882 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.981343 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.982785 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.984791 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.986685 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.988446 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.990414 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.992180 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.993958 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.995708 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.997490 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:34.999245 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.001091 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.002867 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.004618 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.006384 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.008087 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.009853 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.011608 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.013360 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.015126 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.016904 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.018680 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.020409 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.022217 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.023962 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 19:56:35.025735 23146 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
F20240501 19:56:35.026625 23146 monotime.cc:342] Check failed: t_beg.Initialized() 
*** Check failure stack trace: ***
*** Aborted at 1714593395 (unix time) try "date -d @1714593395" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800005981) received by PID 22913 (TID 0x7f68c99b3700) from PID 22913; stack trace: ***
    @     0x7f68feebf980 (unknown) at ??:0
    @     0x7f68fcf1ffb7 gsignal at ??:0
    @     0x7f68fcf21921 abort at ??:0
    @     0x7f68fda8edcd google::LogMessage::Fail() at ??:0
    @     0x7f68fda92b93 google::LogMessage::SendToLog() at ??:0
    @     0x7f68fda8e7cc google::LogMessage::Flush() at ??:0
    @     0x7f68fda8ff59 google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7f68fe7835b1 kudu::operator-() at ??:0
    @     0x7f68ff62efd2 kudu::tablet::WriteOp::ToString() at ??:0
    @     0x7f68ff61805b kudu::tablet::OpDriver::ToStringUnlocked() at ??:0
    @     0x7f68ff617f90 kudu::tablet::OpDriver::ToString() at ??:0
    @     0x7f68ff5ee9bd kudu::tablet::TabletReplica::GetInFlightOps() at ??:0
    @     0x7f69000ce861 kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0
    @     0x7f69000cd93a _ZZN4kudu7tserver24TabletServerPathHandlers8RegisterEPNS_9WebserverEENKUlRKNS_19WebCallbackRegistry10WebRequestEPNS4_22PrerenderedWebResponseEE2_clES7_S9_ at ??:0
    @     0x7f69000d6149 _ZNSt17_Function_handlerIFvRKN4kudu19WebCallbackRegistry10WebRequestEPNS1_22PrerenderedWebResponseEEZNS0_7tserver24TabletServerPathHandlers8RegisterEPNS0_9WebserverEEUlS4_S6_E2_E9_M_invokeERKSt9_Any_dataS4_OS6_ at ??:0
    @     0x7f68fc6a7d09 std::function<>::operator()() at ??:0
    @     0x7f68fc6a2143 kudu::Webserver::RunPathHandler() at ??:0
    @     0x7f68fc6a1a38 kudu::Webserver::BeginRequestCallback() at ??:0
    @     0x7f68fc6a1123 kudu::Webserver::BeginRequestCallbackStatic() at ??:0
    @     0x7f68fc6c9b89 handle_request at ??:0
    @     0x7f68fc6cc26b worker_thread at ??:0
    @     0x7f68feeb46db start_thread at ??:0
    @     0x7f68fd00271f clone at ??:0