Diagnosed failure

UpdateScanDeltaCompactionTest.TestAll: Unrecognized error type. Please see the error log for more information.

Full log

[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from UpdateScanDeltaCompactionTest
[ RUN      ] UpdateScanDeltaCompactionTest.TestAll
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 08:18:31.802084 28752 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.20.62:36421
I20240502 08:18:31.803777 28752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 08:18:31.805152 28752 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:18:31.818943 28758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:31.819559 28757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:31.819617 28760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:18:31.820174 28752 server_base.cc:1034] running on GCE node
I20240502 08:18:31.821116 28752 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:18:31.821296 28752 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:18:31.821372 28752 hybrid_clock.cc:648] HybridClock initialized: now 1714637911821355 us; error 0 us; skew 500 ppm
I20240502 08:18:31.821702 28752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:18:31.829706 28752 webserver.cc:460] Webserver started at http://127.28.20.62:34309/ using document root <none> and password file <none>
I20240502 08:18:31.830544 28752 fs_manager.cc:359] Metadata directory not provided
I20240502 08:18:31.830647 28752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:18:31.830976 28752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:18:31.835012 28752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/master-0-root/instance:
uuid: "ffb2cd382403417ca608eb37b71c6595"
format_stamp: "Formatted at 2024-05-02 08:18:31 on dist-test-slave-9sjq"
I20240502 08:18:31.841701 28752 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20240502 08:18:31.845377 28765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:18:31.847028 28752 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20240502 08:18:31.847213 28752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/master-0-root
uuid: "ffb2cd382403417ca608eb37b71c6595"
format_stamp: "Formatted at 2024-05-02 08:18:31 on dist-test-slave-9sjq"
I20240502 08:18:31.847414 28752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:18:31.877619 28752 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240502 08:18:31.878657 28752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 08:18:31.878957 28752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:18:31.900874 28752 rpc_server.cc:307] RPC server started. Bound to: 127.28.20.62:36421
I20240502 08:18:31.900915 28816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.20.62:36421 every 8 connection(s)
I20240502 08:18:31.906298 28817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:31.919557 28817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595: Bootstrap starting.
I20240502 08:18:31.923602 28817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:31.925474 28817 log.cc:824] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595: Log is configured to *not* fsync() on all Append() calls
I20240502 08:18:31.928509 28817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595: No bootstrap required, opened a new log
I20240502 08:18:31.936401 28817 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffb2cd382403417ca608eb37b71c6595" member_type: VOTER }
I20240502 08:18:31.936762 28817 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:31.936851 28817 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb2cd382403417ca608eb37b71c6595, State: Initialized, Role: FOLLOWER
I20240502 08:18:31.937623 28817 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffb2cd382403417ca608eb37b71c6595" member_type: VOTER }
I20240502 08:18:31.937813 28817 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 08:18:31.937916 28817 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 08:18:31.938047 28817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:31.988104 28817 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffb2cd382403417ca608eb37b71c6595" member_type: VOTER }
I20240502 08:18:31.989010 28817 leader_election.cc:302] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffb2cd382403417ca608eb37b71c6595; no voters: 
I20240502 08:18:31.989881 28817 leader_election.cc:288] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240502 08:18:31.990005 28820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:31.991591 28820 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [term 1 LEADER]: Becoming Leader. State: Replica: ffb2cd382403417ca608eb37b71c6595, State: Running, Role: LEADER
I20240502 08:18:31.992300 28820 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffb2cd382403417ca608eb37b71c6595" member_type: VOTER }
I20240502 08:18:31.993147 28817 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 08:18:31.995220 28821 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffb2cd382403417ca608eb37b71c6595" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffb2cd382403417ca608eb37b71c6595" member_type: VOTER } }
I20240502 08:18:31.995321 28822 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffb2cd382403417ca608eb37b71c6595. Latest consensus state: current_term: 1 leader_uuid: "ffb2cd382403417ca608eb37b71c6595" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffb2cd382403417ca608eb37b71c6595" member_type: VOTER } }
I20240502 08:18:31.995546 28822 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [sys.catalog]: This master's current role is: LEADER
I20240502 08:18:31.995550 28821 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595 [sys.catalog]: This master's current role is: LEADER
I20240502 08:18:31.998401 28825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 08:18:32.005339 28825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 08:18:32.005961 28752 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 08:18:32.015868 28825 catalog_manager.cc:1347] Generated new cluster ID: 0c7d3699c65145c390f6e1284da330cc
I20240502 08:18:32.016098 28825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 08:18:32.032485 28825 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 08:18:32.033834 28825 catalog_manager.cc:1504] Loading token signing keys...
I20240502 08:18:32.044589 28825 catalog_manager.cc:5857] T 00000000000000000000000000000000 P ffb2cd382403417ca608eb37b71c6595: Generated new TSK 0
I20240502 08:18:32.045579 28825 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 08:18:32.071568 28752 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:18:32.077056 28839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:32.077628 28840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:18:32.078387 28842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:18:32.078895 28752 server_base.cc:1034] running on GCE node
I20240502 08:18:32.079198 28752 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:18:32.079298 28752 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:18:32.079358 28752 hybrid_clock.cc:648] HybridClock initialized: now 1714637912079333 us; error 0 us; skew 500 ppm
I20240502 08:18:32.079551 28752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:18:32.081142 28752 webserver.cc:460] Webserver started at http://127.28.20.1:34735/ using document root <none> and password file <none>
I20240502 08:18:32.081413 28752 fs_manager.cc:359] Metadata directory not provided
I20240502 08:18:32.081506 28752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:18:32.081660 28752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:18:32.082392 28752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/ts-0-root/instance:
uuid: "cea66c25a1d04ef2a27230fbbd6e842f"
format_stamp: "Formatted at 2024-05-02 08:18:32 on dist-test-slave-9sjq"
I20240502 08:18:32.085427 28752 fs_manager.cc:691] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20240502 08:18:32.087785 28847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:18:32.088240 28752 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.002s	sys 0.001s
I20240502 08:18:32.088375 28752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/ts-0-root
uuid: "cea66c25a1d04ef2a27230fbbd6e842f"
format_stamp: "Formatted at 2024-05-02 08:18:32 on dist-test-slave-9sjq"
I20240502 08:18:32.088610 28752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjgZgZg/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637911721940-28752-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:18:32.103293 28752 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240502 08:18:32.104197 28752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:18:32.105895 28752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:18:32.107916 28752 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:18:32.108086 28752 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:18:32.108273 28752 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:18:32.108367 28752 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:18:32.134264 28752 rpc_server.cc:307] RPC server started. Bound to: 127.28.20.1:42379
I20240502 08:18:32.134328 28909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.20.1:42379 every 8 connection(s)
I20240502 08:18:32.154399 28910 heartbeater.cc:347] Connected to a master server at 127.28.20.62:36421
I20240502 08:18:32.154753 28910 heartbeater.cc:464] Registering TS with master...
I20240502 08:18:32.155582 28910 heartbeater.cc:511] Master 127.28.20.62:36421 requested a full tablet report, sending...
I20240502 08:18:32.157959 28782 ts_manager.cc:194] Registered new tserver with Master: cea66c25a1d04ef2a27230fbbd6e842f (127.28.20.1:42379)
I20240502 08:18:32.158713 28752 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015878524s
I20240502 08:18:32.160048 28782 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47820
I20240502 08:18:32.181577 28782 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47830:
name: "update-scan-delta-compact-tbl"
schema {
  columns {
    name: "key"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int64"
    type: INT64
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20240502 08:18:32.212664 28875 tablet_service.cc:1467] Processing CreateTablet for tablet 424af1bfcb804cdbaa0be45142eefbdf (DEFAULT_TABLE table=update-scan-delta-compact-tbl [id=8d9efef8e32b42c49850b62992c4012b]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 08:18:32.213449 28875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 424af1bfcb804cdbaa0be45142eefbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:18:32.219434 28922 tablet_bootstrap.cc:492] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f: Bootstrap starting.
I20240502 08:18:32.221864 28922 tablet_bootstrap.cc:654] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f: Neither blocks nor log segments found. Creating new log.
I20240502 08:18:32.223932 28922 tablet_bootstrap.cc:492] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f: No bootstrap required, opened a new log
I20240502 08:18:32.224094 28922 ts_tablet_manager.cc:1367] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.004s
I20240502 08:18:32.224905 28922 raft_consensus.cc:348] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea66c25a1d04ef2a27230fbbd6e842f" member_type: VOTER last_known_addr { host: "127.28.20.1" port: 42379 } }
I20240502 08:18:32.225209 28922 raft_consensus.cc:374] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:18:32.225332 28922 raft_consensus.cc:729] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cea66c25a1d04ef2a27230fbbd6e842f, State: Initialized, Role: FOLLOWER
I20240502 08:18:32.225584 28922 consensus_queue.cc:260] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea66c25a1d04ef2a27230fbbd6e842f" member_type: VOTER last_known_addr { host: "127.28.20.1" port: 42379 } }
I20240502 08:18:32.225813 28922 raft_consensus.cc:388] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 08:18:32.225925 28922 raft_consensus.cc:482] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 08:18:32.226089 28922 raft_consensus.cc:3037] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:18:32.233861 28922 raft_consensus.cc:504] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea66c25a1d04ef2a27230fbbd6e842f" member_type: VOTER last_known_addr { host: "127.28.20.1" port: 42379 } }
I20240502 08:18:32.234249 28922 leader_election.cc:302] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cea66c25a1d04ef2a27230fbbd6e842f; no voters: 
I20240502 08:18:32.236763 28922 leader_election.cc:288] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240502 08:18:32.236971 28924 raft_consensus.cc:2781] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:18:32.240080 28910 heartbeater.cc:503] Master 127.28.20.62:36421 was elected leader, sending a full tablet report...
I20240502 08:18:32.240140 28924 raft_consensus.cc:686] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [term 1 LEADER]: Becoming Leader. State: Replica: cea66c25a1d04ef2a27230fbbd6e842f, State: Running, Role: LEADER
I20240502 08:18:32.240404 28922 ts_tablet_manager.cc:1398] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20240502 08:18:32.240588 28924 consensus_queue.cc:237] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea66c25a1d04ef2a27230fbbd6e842f" member_type: VOTER last_known_addr { host: "127.28.20.1" port: 42379 } }
I20240502 08:18:32.245250 28782 catalog_manager.cc:5484] T 424af1bfcb804cdbaa0be45142eefbdf P cea66c25a1d04ef2a27230fbbd6e842f reported cstate change: term changed from 0 to 1, leader changed from <none> to cea66c25a1d04ef2a27230fbbd6e842f (127.28.20.1). New cstate: current_term: 1 leader_uuid: "cea66c25a1d04ef2a27230fbbd6e842f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea66c25a1d04ef2a27230fbbd6e842f" member_type: VOTER last_known_addr { host: "127.28.20.1" port: 42379 } health_report { overall_health: HEALTHY } } }
I20240502 08:18:36.144001 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=1.000000
I20240502 08:18:38.623731 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 2.479s	user 2.086s	sys 0.356s Metrics: {"bytes_written":173462,"cfile_init":1,"compiler_manager_pool.queue_time_us":721,"compiler_manager_pool.run_cpu_time_us":552282,"compiler_manager_pool.run_wall_time_us":573015,"dirs.queue_time_us":403,"dirs.run_cpu_time_us":244,"dirs.run_wall_time_us":893,"drs_written":1,"lbm_read_time_us":183,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7279,"lbm_writes_lt_1ms":89,"peak_mem_usage":0,"rows_written":62001,"thread_start_us":991,"threads_started":2}
I20240502 08:18:38.625555 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf): 416528 bytes on disk
I20240502 08:18:38.626327 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4}
I20240502 08:18:40.627332 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=2.874778
I20240502 08:18:42.917565 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 2.290s	user 2.184s	sys 0.072s Metrics: {"bytes_written":195812,"cfile_init":1,"dirs.queue_time_us":8068,"dirs.run_cpu_time_us":276,"dirs.run_wall_time_us":5853,"drs_written":1,"lbm_read_time_us":91,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8923,"lbm_writes_lt_1ms":104,"peak_mem_usage":0,"rows_written":73000,"thread_start_us":7936,"threads_started":1}
I20240502 08:18:42.918920 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=0.014658
I20240502 08:18:45.227561 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 2.308s	user 2.245s	sys 0.052s Metrics: {"bytes_written":371057,"cfile_cache_hit":10,"cfile_cache_hit_bytes":1745,"cfile_cache_miss":164,"cfile_cache_miss_bytes":1889677,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":2291,"dirs.run_cpu_time_us":659,"dirs.run_wall_time_us":4527,"drs_written":1,"lbm_read_time_us":7427,"lbm_reads_lt_1ms":188,"lbm_write_time_us":12795,"lbm_writes_lt_1ms":175,"num_input_rowsets":2,"peak_mem_usage":1115736,"rows_written":135001,"thread_start_us":1732,"threads_started":6}
I20240502 08:18:45.228500 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=1.882590
I20240502 08:18:47.339371 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 2.111s	user 2.043s	sys 0.044s Metrics: {"bytes_written":186852,"cfile_init":1,"dirs.queue_time_us":388,"dirs.run_cpu_time_us":194,"dirs.run_wall_time_us":971,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8041,"lbm_writes_lt_1ms":100,"peak_mem_usage":0,"rows_written":69000,"thread_start_us":266,"threads_started":1}
I20240502 08:18:47.340301 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf): 1369613 bytes on disk
I20240502 08:18:47.341034 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":126,"lbm_reads_lt_1ms":8}
I20240502 08:18:47.341691 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=0.014483
I20240502 08:18:50.896349 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 3.554s	user 3.494s	sys 0.060s Metrics: {"bytes_written":563590,"cfile_cache_hit":10,"cfile_cache_hit_bytes":2481,"cfile_cache_miss":248,"cfile_cache_miss_bytes":2861001,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":6157,"dirs.run_cpu_time_us":871,"dirs.run_wall_time_us":5764,"drs_written":1,"lbm_read_time_us":11990,"lbm_reads_lt_1ms":268,"lbm_write_time_us":20127,"lbm_writes_lt_1ms":255,"num_input_rowsets":2,"peak_mem_usage":2155965,"rows_written":204001,"thread_start_us":5930,"threads_started":6}
I20240502 08:18:50.897470 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=4.859153
I20240502 08:18:53.649796 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 2.752s	user 2.641s	sys 0.084s Metrics: {"bytes_written":245439,"cfile_init":1,"dirs.queue_time_us":412,"dirs.run_cpu_time_us":189,"dirs.run_wall_time_us":1130,"drs_written":1,"lbm_read_time_us":130,"lbm_reads_lt_1ms":4,"lbm_write_time_us":10393,"lbm_writes_lt_1ms":123,"peak_mem_usage":0,"rows_written":91000,"spinlock_wait_cycles":321408,"thread_start_us":284,"threads_started":1}
I20240502 08:18:53.650630 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=0.014252
I20240502 08:18:58.686985 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 5.036s	user 4.907s	sys 0.112s Metrics: {"bytes_written":812775,"cfile_cache_hit":10,"cfile_cache_hit_bytes":3471,"cfile_cache_miss":346,"cfile_cache_miss_bytes":4133867,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":3247,"dirs.run_cpu_time_us":386,"dirs.run_wall_time_us":2660,"drs_written":1,"lbm_read_time_us":15576,"lbm_reads_lt_1ms":374,"lbm_write_time_us":26292,"lbm_writes_lt_1ms":361,"num_input_rowsets":2,"peak_mem_usage":3277136,"rows_written":295001,"thread_start_us":3429,"threads_started":6}
I20240502 08:18:58.687889 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=9.820090
I20240502 08:19:02.544832 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 3.857s	user 3.674s	sys 0.180s Metrics: {"bytes_written":337412,"cfile_init":1,"dirs.queue_time_us":360,"dirs.run_cpu_time_us":160,"dirs.run_wall_time_us":1125,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":14071,"lbm_writes_lt_1ms":163,"peak_mem_usage":0,"rows_written":126000,"thread_start_us":259,"threads_started":1}
I20240502 08:19:02.545653 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf): 2827507 bytes on disk
I20240502 08:19:02.546526 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":189,"lbm_reads_lt_1ms":8}
I20240502 08:19:02.547122 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=1.000000
I20240502 08:19:04.358438 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 1.811s	user 1.768s	sys 0.024s Metrics: {"bytes_written":168394,"cfile_init":1,"dirs.queue_time_us":416,"dirs.run_cpu_time_us":210,"dirs.run_wall_time_us":1011,"drs_written":1,"lbm_read_time_us":130,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6678,"lbm_writes_lt_1ms":89,"peak_mem_usage":0,"rows_written":62000,"thread_start_us":284,"threads_started":1}
I20240502 08:19:04.359287 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=0.022776
I20240502 08:19:12.720817 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 8.361s	user 8.110s	sys 0.226s Metrics: {"bytes_written":1330298,"cfile_cache_hit":15,"cfile_cache_hit_bytes":5584,"cfile_cache_miss":565,"cfile_cache_miss_bytes":6774302,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":4541,"dirs.run_cpu_time_us":1490,"dirs.run_wall_time_us":1492,"drs_written":1,"lbm_read_time_us":24222,"lbm_reads_lt_1ms":597,"lbm_write_time_us":45637,"lbm_writes_lt_1ms":577,"mutex_wait_us":20,"num_input_rowsets":3,"peak_mem_usage":4788564,"rows_written":483001,"spinlock_wait_cycles":1280,"thread_start_us":7237,"threads_started":4}
I20240502 08:19:12.721767 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf): 3243991 bytes on disk
I20240502 08:19:12.722261 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4}
I20240502 08:19:12.722702 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=14.781028
I20240502 08:19:17.837285 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 5.114s	user 4.929s	sys 0.184s Metrics: {"bytes_written":446213,"cfile_init":1,"dirs.queue_time_us":1420,"dirs.run_cpu_time_us":184,"dirs.run_wall_time_us":1066,"drs_written":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4,"lbm_write_time_us":18625,"lbm_writes_lt_1ms":212,"peak_mem_usage":0,"rows_written":166000,"thread_start_us":1294,"threads_started":1}
I20240502 08:19:17.838155 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf): 1115634 bytes on disk
I20240502 08:19:17.838721 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4}
I20240502 08:19:17.839249 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=3.866965
I20240502 08:19:20.272037 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 2.433s	user 2.319s	sys 0.084s Metrics: {"bytes_written":214405,"cfile_init":1,"dirs.queue_time_us":380,"dirs.run_cpu_time_us":175,"dirs.run_wall_time_us":1115,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9120,"lbm_writes_lt_1ms":111,"peak_mem_usage":0,"rows_written":80000,"thread_start_us":262,"threads_started":1}
I20240502 08:19:20.273156 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf): 536527 bytes on disk
I20240502 08:19:20.273905 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: UndoDeltaBlockGCOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":125,"lbm_reads_lt_1ms":4}
I20240502 08:19:20.274574 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=0.022153
I20240502 08:19:32.831176 28852 maintenance_manager.cc:643] P cea66c25a1d04ef2a27230fbbd6e842f: CompactRowSetsOp(424af1bfcb804cdbaa0be45142eefbdf) complete. Timing: real 12.556s	user 12.256s	sys 0.251s Metrics: {"bytes_written":2007967,"cfile_cache_hit":15,"cfile_cache_hit_bytes":8442,"cfile_cache_miss":851,"cfile_cache_miss_bytes":10232430,"cfile_init":7,"delta_iterators_relevant":6,"dirs.queue_time_us":2823,"dirs.run_cpu_time_us":657,"dirs.run_wall_time_us":4620,"drs_written":1,"lbm_read_time_us":41117,"lbm_reads_lt_1ms":879,"lbm_write_time_us":71910,"lbm_writes_lt_1ms":863,"num_input_rowsets":3,"peak_mem_usage":7843356,"rows_written":729001,"thread_start_us":3019,"threads_started":6}
I20240502 08:19:32.832324 28911 maintenance_manager.cc:419] P cea66c25a1d04ef2a27230fbbd6e842f: Scheduling FlushMRSOp(424af1bfcb804cdbaa0be45142eefbdf): perf score=25.695090
I20240502 08:19:34.448483 28752 update_scan_delta_compact-test.cc:209] Time spent Insert: real 62.192s	user 56.867s	sys 4.740s
I20240502 08:19:34.462538 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.466482 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.469441 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.472419 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.476346 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.479737 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.483008 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.486348 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.489722 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.493142 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.496654 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.500136 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.503536 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.506899 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:19:34.510305 28972 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
F20240502 08:19:34.511960 28972 monotime.cc:342] Check failed: t_beg.Initialized() 
*** Check failure stack trace: ***
*** Aborted at 1714637974 (unix time) try "date -d @1714637974" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800007050) received by PID 28752 (TID 0x7f9d5caaa700) from PID 28752; stack trace: ***
    @     0x7f9db7ac9980 (unknown) at ??:0
    @     0x7f9db0b74fb7 gsignal at ??:0
    @     0x7f9db0b76921 abort at ??:0
    @     0x7f9db389ddcd google::LogMessage::Fail() at ??:0
    @     0x7f9db38a1b93 google::LogMessage::SendToLog() at ??:0
    @     0x7f9db389d7cc google::LogMessage::Flush() at ??:0
    @     0x7f9db389ef59 google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7f9db4e02c80 kudu::operator-() at ??:0
    @     0x7f9dc062314a kudu::tablet::WriteOp::ToString() at ??:0
    @     0x7f9dc05ed5de kudu::tablet::OpDriver::ToStringUnlocked() at ??:0
    @     0x7f9dc05ed336 kudu::tablet::OpDriver::ToString() at ??:0
    @     0x7f9dc059a2d9 kudu::tablet::TabletReplica::GetInFlightOps() at ??:0
    @     0x7f9dc7418e47 kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0
    @     0x7f9dc74279fc kudu::tserver::TabletServerPathHandlers::Register()::$_3::operator()() at ??:0
    @     0x7f9dc7427862 std::_Function_handler<>::_M_invoke() at ??:0
    @     0x7f9dbd78502a std::function<>::operator()() at ??:0
    @     0x7f9dbd77d7ba kudu::Webserver::RunPathHandler() at ??:0
    @     0x7f9dbd7787f1 kudu::Webserver::BeginRequestCallback() at ??:0
    @     0x7f9dbd776927 kudu::Webserver::BeginRequestCallbackStatic() at ??:0
    @     0x7f9dbd7b4089 handle_request at ??:0
    @     0x7f9dbd7b676b worker_thread at ??:0
    @     0x7f9db7abe6db start_thread at ??:0
    @     0x7f9db0c5771f clone at ??:0