Diagnosed failure

UpdateScanDeltaCompactionTest.TestAll: Unrecognized error type. Please see the error log for more information.

Full log

[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from UpdateScanDeltaCompactionTest
[ RUN      ] UpdateScanDeltaCompactionTest.TestAll
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 08:03:57.312063 12102 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.209.190:35243
I20240502 08:03:57.313319 12102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 08:03:57.314296 12102 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:03:57.331071 12111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:03:57.331647 12109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:03:57.332074 12108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:03:57.332989 12102 server_base.cc:1034] running on GCE node
I20240502 08:03:58.402225 12102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:03:58.402488 12102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:03:58.402683 12102 hybrid_clock.cc:648] HybridClock initialized: now 1714637038402659 us; error 0 us; skew 500 ppm
I20240502 08:03:58.403576 12102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:03:58.409397 12102 webserver.cc:460] Webserver started at http://127.11.209.190:46011/ using document root <none> and password file <none>
I20240502 08:03:58.410326 12102 fs_manager.cc:359] Metadata directory not provided
I20240502 08:03:58.410537 12102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:03:58.410975 12102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:03:58.417243 12102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/master-0-root/instance:
uuid: "1b9b8bfaad474ba6af89dfbe4c76185a"
format_stamp: "Formatted at 2024-05-02 08:03:58 on dist-test-slave-zfjt"
I20240502 08:03:58.425040 12102 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20240502 08:03:58.429896 12117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:03:58.430915 12102 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20240502 08:03:58.431248 12102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/master-0-root
uuid: "1b9b8bfaad474ba6af89dfbe4c76185a"
format_stamp: "Formatted at 2024-05-02 08:03:58 on dist-test-slave-zfjt"
I20240502 08:03:58.431617 12102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:03:58.485587 12102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240502 08:03:58.487035 12102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 08:03:58.487514 12102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:03:58.563578 12102 rpc_server.cc:307] RPC server started. Bound to: 127.11.209.190:35243
I20240502 08:03:58.563661 12168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.209.190:35243 every 8 connection(s)
I20240502 08:03:58.570071 12169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:03:58.592824 12169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a: Bootstrap starting.
I20240502 08:03:58.598430 12169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a: Neither blocks nor log segments found. Creating new log.
I20240502 08:03:58.600044 12169 log.cc:824] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a: Log is configured to *not* fsync() on all Append() calls
I20240502 08:03:58.604333 12169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a: No bootstrap required, opened a new log
I20240502 08:03:58.625787 12169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" member_type: VOTER }
I20240502 08:03:58.626289 12169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:03:58.626505 12169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9b8bfaad474ba6af89dfbe4c76185a, State: Initialized, Role: FOLLOWER
I20240502 08:03:58.627277 12169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" member_type: VOTER }
I20240502 08:03:58.627777 12169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 08:03:58.628042 12169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 08:03:58.628340 12169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:03:58.632321 12169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" member_type: VOTER }
I20240502 08:03:58.632944 12169 leader_election.cc:302] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b9b8bfaad474ba6af89dfbe4c76185a; no voters: 
I20240502 08:03:58.634898 12169 leader_election.cc:288] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240502 08:03:58.635251 12172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:03:58.638393 12172 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [term 1 LEADER]: Becoming Leader. State: Replica: 1b9b8bfaad474ba6af89dfbe4c76185a, State: Running, Role: LEADER
I20240502 08:03:58.639163 12172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" member_type: VOTER }
I20240502 08:03:58.640069 12169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [sys.catalog]: configured and running, proceeding with master startup.
W20240502 08:03:58.643774 12123 tablet.cc:2369] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 08:03:58.650019 12174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" member_type: VOTER } }
I20240502 08:03:58.650094 12173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b9b8bfaad474ba6af89dfbe4c76185a. Latest consensus state: current_term: 1 leader_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b9b8bfaad474ba6af89dfbe4c76185a" member_type: VOTER } }
I20240502 08:03:58.651054 12174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [sys.catalog]: This master's current role is: LEADER
I20240502 08:03:58.651122 12173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a [sys.catalog]: This master's current role is: LEADER
I20240502 08:03:58.657140 12180 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 08:03:58.670629 12180 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 08:03:58.672230 12102 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240502 08:03:58.686234 12180 catalog_manager.cc:1347] Generated new cluster ID: 14c50fcaa2e047fd9e4e43eaa8244556
I20240502 08:03:58.686478 12180 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 08:03:58.718408 12180 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 08:03:58.720232 12180 catalog_manager.cc:1504] Loading token signing keys...
I20240502 08:03:58.735414 12180 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 1b9b8bfaad474ba6af89dfbe4c76185a: Generated new TSK 0
I20240502 08:03:58.736364 12180 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 08:03:58.802706 12102 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 08:03:58.812808 12191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:03:58.816537 12192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 08:03:58.817598 12194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 08:03:58.818485 12102 server_base.cc:1034] running on GCE node
I20240502 08:03:58.819283 12102 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240502 08:03:58.819553 12102 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240502 08:03:58.819736 12102 hybrid_clock.cc:648] HybridClock initialized: now 1714637038819722 us; error 0 us; skew 500 ppm
I20240502 08:03:58.820571 12102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 08:03:58.824342 12102 webserver.cc:460] Webserver started at http://127.11.209.129:38973/ using document root <none> and password file <none>
I20240502 08:03:58.825080 12102 fs_manager.cc:359] Metadata directory not provided
I20240502 08:03:58.825340 12102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 08:03:58.825699 12102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 08:03:58.827222 12102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/ts-0-root/instance:
uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90"
format_stamp: "Formatted at 2024-05-02 08:03:58 on dist-test-slave-zfjt"
I20240502 08:03:58.834070 12102 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.004s
I20240502 08:03:58.838920 12199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:03:58.839838 12102 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20240502 08:03:58.840200 12102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/ts-0-root
uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90"
format_stamp: "Formatted at 2024-05-02 08:03:58 on dist-test-slave-zfjt"
I20240502 08:03:58.840566 12102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7u3EM8/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714637037154760-12102-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 08:03:58.878088 12102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20240502 08:03:58.879829 12102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 08:03:58.882956 12102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 08:03:58.888840 12102 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 08:03:58.889151 12102 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:03:58.889477 12102 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 08:03:58.889688 12102 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20240502 08:03:58.988363 12102 rpc_server.cc:307] RPC server started. Bound to: 127.11.209.129:44363
I20240502 08:03:58.988413 12261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.209.129:44363 every 8 connection(s)
I20240502 08:03:59.014457 12262 heartbeater.cc:347] Connected to a master server at 127.11.209.190:35243
I20240502 08:03:59.014909 12262 heartbeater.cc:464] Registering TS with master...
I20240502 08:03:59.015843 12262 heartbeater.cc:511] Master 127.11.209.190:35243 requested a full tablet report, sending...
I20240502 08:03:59.018568 12102 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.02358431s
I20240502 08:03:59.018592 12134 ts_manager.cc:194] Registered new tserver with Master: 655a3cc8a3a84a7a9e1228dac3ee8c90 (127.11.209.129:44363)
I20240502 08:03:59.021829 12134 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47960
I20240502 08:03:59.050321 12134 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47964:
name: "update-scan-delta-compact-tbl"
schema {
  columns {
    name: "key"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int64"
    type: INT64
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20240502 08:03:59.125193 12227 tablet_service.cc:1467] Processing CreateTablet for tablet 710890a70d0d4f72963e8c94bbec6e62 (DEFAULT_TABLE table=update-scan-delta-compact-tbl [id=fbacd8897d2e464199a43910aa9dfa3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 08:03:59.126317 12227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 710890a70d0d4f72963e8c94bbec6e62. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 08:03:59.139438 12274 tablet_bootstrap.cc:492] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90: Bootstrap starting.
I20240502 08:03:59.144062 12274 tablet_bootstrap.cc:654] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90: Neither blocks nor log segments found. Creating new log.
I20240502 08:03:59.149956 12274 tablet_bootstrap.cc:492] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90: No bootstrap required, opened a new log
I20240502 08:03:59.150259 12274 ts_tablet_manager.cc:1367] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90: Time spent bootstrapping tablet: real 0.012s	user 0.002s	sys 0.008s
I20240502 08:03:59.151914 12274 raft_consensus.cc:348] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90" member_type: VOTER last_known_addr { host: "127.11.209.129" port: 44363 } }
I20240502 08:03:59.152891 12274 raft_consensus.cc:374] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 08:03:59.153136 12274 raft_consensus.cc:729] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 655a3cc8a3a84a7a9e1228dac3ee8c90, State: Initialized, Role: FOLLOWER
I20240502 08:03:59.153635 12274 consensus_queue.cc:260] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90" member_type: VOTER last_known_addr { host: "127.11.209.129" port: 44363 } }
I20240502 08:03:59.154044 12274 raft_consensus.cc:388] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 08:03:59.154242 12274 raft_consensus.cc:482] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 08:03:59.154510 12274 raft_consensus.cc:3037] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 0 FOLLOWER]: Advancing to term 1
I20240502 08:03:59.158892 12274 raft_consensus.cc:504] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90" member_type: VOTER last_known_addr { host: "127.11.209.129" port: 44363 } }
I20240502 08:03:59.159345 12274 leader_election.cc:302] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 655a3cc8a3a84a7a9e1228dac3ee8c90; no voters: 
I20240502 08:03:59.161652 12274 leader_election.cc:288] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20240502 08:03:59.161938 12276 raft_consensus.cc:2781] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 08:03:59.165014 12262 heartbeater.cc:503] Master 127.11.209.190:35243 was elected leader, sending a full tablet report...
I20240502 08:03:59.165567 12276 raft_consensus.cc:686] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [term 1 LEADER]: Becoming Leader. State: Replica: 655a3cc8a3a84a7a9e1228dac3ee8c90, State: Running, Role: LEADER
I20240502 08:03:59.166647 12274 ts_tablet_manager.cc:1398] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.012s
I20240502 08:03:59.166734 12276 consensus_queue.cc:237] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90" member_type: VOTER last_known_addr { host: "127.11.209.129" port: 44363 } }
I20240502 08:03:59.177623 12134 catalog_manager.cc:5484] T 710890a70d0d4f72963e8c94bbec6e62 P 655a3cc8a3a84a7a9e1228dac3ee8c90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 655a3cc8a3a84a7a9e1228dac3ee8c90 (127.11.209.129). New cstate: current_term: 1 leader_uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "655a3cc8a3a84a7a9e1228dac3ee8c90" member_type: VOTER last_known_addr { host: "127.11.209.129" port: 44363 } health_report { overall_health: HEALTHY } } }
I20240502 08:03:59.840008 12102 update_scan_delta_compact-test.cc:209] Time spent Insert: real 0.636s	user 0.476s	sys 0.018s
I20240502 08:03:59.894784 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:03:59.928516 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:03:59.964468 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:03:59.981283 12284 update_scan_delta_compact-test.cc:265] Time spent Scan: real 0.125s	user 0.004s	sys 0.000s
I20240502 08:03:59.994954 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:04:00.020705 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:04:00.047397 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:04:00.058807 12284 update_scan_delta_compact-test.cc:265] Time spent Scan: real 0.076s	user 0.003s	sys 0.000s
I20240502 08:04:00.074672 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240502 08:04:00.100495 12286 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
F20240502 08:04:00.115208 12286 monotime.cc:342] Check failed: t_beg.Initialized() 
*** Check failure stack trace: ***
*** Aborted at 1714637040 (unix time) try "date -d @1714637040" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800002f46) received by PID 12102 (TID 0x7f18015f9700) from PID 12102; stack trace: ***
    @           0x2a1770 __tsan::CallUserSignalHandler() at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
    @           0x2a3c53 rtl_sigaction() at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
    @     0x7f183682a980 (unknown) at ??:0
    @     0x7f1831a68fb7 gsignal at ??:0
    @     0x7f1831a6a921 abort at ??:0
    @           0x2a7766 abort at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
    @     0x7f1834b1cda4 google::LogMessage::SendToLog() at ??:0
    @     0x7f1834b1d950 google::LogMessage::Flush() at ??:0
    @     0x7f1834b22a8b google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240502 08:04:00.237012 12284 update_scan_delta_compact-test.cc:265] Time spent Scan: real 0.177s	user 0.002s	sys 0.000s
    @     0x7f18353fbc3c kudu::operator-() at ??:0
    @     0x7f183c16903c kudu::tablet::WriteOp::ToString() at ??:0
    @     0x7f183c151c4e kudu::tablet::OpDriver::ToStringUnlocked() at ??:0
    @     0x7f183c151b92 kudu::tablet::OpDriver::ToString() at ??:0
    @     0x7f183c118181 kudu::tablet::TabletReplica::GetInFlightOps() at ??:0
    @     0x7f183df8a86a kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0
I20240502 08:04:00.331940 12284 update_scan_delta_compact-test.cc:265] Time spent Scan: real 0.094s	user 0.007s	sys 0.000s
    @     0x7f183df93322 kudu::tserver::TabletServerPathHandlers::Register()::$_3::operator()() at ??:0
    @     0x7f183df932c9 _ZNSt3__18__invokeIRZN4kudu7tserver24TabletServerPathHandlers8RegisterEPNS1_9WebserverEE3$_3JRKNS1_19WebCallbackRegistry10WebRequestEPNS8_22PrerenderedWebResponseEEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOSE_DpOSF_ at ??:0
    @     0x7f183df9322d std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
    @     0x7f183df931c9 std::__1::__function::__alloc_func<>::operator()() at ??:0
    @     0x7f183df92491 std::__1::__function::__func<>::operator()() at ??:0
    @     0x7f183b3e5feb std::__1::__function::__value_func<>::operator()() at ??:0
I20240502 08:04:00.429510 12284 update_scan_delta_compact-test.cc:265] Time spent Scan: real 0.096s	user 0.003s	sys 0.002s
    @     0x7f183b3dc242 std::__1::function<>::operator()() at ??:0
    @     0x7f183b3d6681 kudu::Webserver::RunPathHandler() at ??:0
    @     0x7f183b3d4d6c kudu::Webserver::BeginRequestCallback() at ??:0
I20240502 08:04:00.476037 12284 update_scan_delta_compact-test.cc:265] Time spent Scan: real 0.045s	user 0.000s	sys 0.002s
    @     0x7f183b3d4119 kudu::Webserver::BeginRequestCallbackStatic() at ??:0
    @     0x7f183b407548 handle_request at ??:0
    @     0x7f183b4053d8 worker_thread at ??:0
    @           0x2a1630 __tsan_thread_start_func at /home/jenkins-slave/workspace/build_and_test_flaky@2/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:959
    @     0x7f183681f6db start_thread at ??:0
    @     0x7f1831b4b71f clone at ??:0