[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from UpdateScanDeltaCompactionTest
[ RUN ] UpdateScanDeltaCompactionTest.TestAll
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 20:10:52.504850 12145 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.220.126:35017
I20240501 20:10:52.506471 12145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 20:10:52.507722 12145 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:10:52.518641 12150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:10:52.519153 12153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:10:52.519914 12151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:10:52.520654 12145 server_base.cc:1034] running on GCE node
I20240501 20:10:52.521466 12145 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:10:52.521633 12145 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:10:52.521725 12145 hybrid_clock.cc:648] HybridClock initialized: now 1714594252521708 us; error 0 us; skew 500 ppm
I20240501 20:10:52.522076 12145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:10:52.530431 12145 webserver.cc:460] Webserver started at http://127.11.220.126:43001/ using document root <none> and password file <none>
I20240501 20:10:52.531219 12145 fs_manager.cc:359] Metadata directory not provided
I20240501 20:10:52.531325 12145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:10:52.531698 12145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:10:52.535306 12145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/master-0-root/instance:
uuid: "c4665a9948fe4de0afa8a574ef2a27f7"
format_stamp: "Formatted at 2024-05-01 20:10:52 on dist-test-slave-jrmb"
I20240501 20:10:52.541188 12145 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20240501 20:10:52.544653 12158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:10:52.546180 12145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20240501 20:10:52.546375 12145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/master-0-root
uuid: "c4665a9948fe4de0afa8a574ef2a27f7"
format_stamp: "Formatted at 2024-05-01 20:10:52 on dist-test-slave-jrmb"
I20240501 20:10:52.546558 12145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:10:52.563479 12145 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:10:52.564390 12145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 20:10:52.564682 12145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:10:52.583598 12145 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.126:35017
I20240501 20:10:52.583613 12209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.220.126:35017 every 8 connection(s)
I20240501 20:10:52.587189 12210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:10:52.599699 12210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7: Bootstrap starting.
I20240501 20:10:52.603333 12210 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7: Neither blocks nor log segments found. Creating new log.
I20240501 20:10:52.604389 12210 log.cc:824] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7: Log is configured to *not* fsync() on all Append() calls
I20240501 20:10:52.607013 12210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7: No bootstrap required, opened a new log
I20240501 20:10:52.613752 12210 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" member_type: VOTER }
I20240501 20:10:52.614035 12210 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:10:52.614117 12210 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4665a9948fe4de0afa8a574ef2a27f7, State: Initialized, Role: FOLLOWER
I20240501 20:10:52.614742 12210 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" member_type: VOTER }
I20240501 20:10:52.614933 12210 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 20:10:52.615029 12210 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 20:10:52.615150 12210 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:10:52.616964 12210 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" member_type: VOTER }
I20240501 20:10:52.617456 12210 leader_election.cc:302] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4665a9948fe4de0afa8a574ef2a27f7; no voters:
I20240501 20:10:52.618018 12210 leader_election.cc:288] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 20:10:52.618139 12213 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:10:52.618803 12213 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [term 1 LEADER]: Becoming Leader. State: Replica: c4665a9948fe4de0afa8a574ef2a27f7, State: Running, Role: LEADER
I20240501 20:10:52.619335 12213 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" member_type: VOTER }
I20240501 20:10:52.620061 12210 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 20:10:52.622181 12214 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" member_type: VOTER } }
I20240501 20:10:52.622294 12215 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4665a9948fe4de0afa8a574ef2a27f7. Latest consensus state: current_term: 1 leader_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4665a9948fe4de0afa8a574ef2a27f7" member_type: VOTER } }
I20240501 20:10:52.622509 12214 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [sys.catalog]: This master's current role is: LEADER
I20240501 20:10:52.622526 12215 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7 [sys.catalog]: This master's current role is: LEADER
I20240501 20:10:52.624356 12222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 20:10:52.628971 12222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 20:10:52.629534 12145 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 20:10:52.638196 12222 catalog_manager.cc:1347] Generated new cluster ID: faffad698b6549a791304bf89f6714ec
I20240501 20:10:52.638314 12222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 20:10:52.684412 12222 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 20:10:52.685719 12222 catalog_manager.cc:1504] Loading token signing keys...
I20240501 20:10:52.697283 12222 catalog_manager.cc:5857] T 00000000000000000000000000000000 P c4665a9948fe4de0afa8a574ef2a27f7: Generated new TSK 0
I20240501 20:10:52.698199 12222 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 20:10:52.759243 12145 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 20:10:52.763828 12232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:10:52.764613 12233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 20:10:52.765235 12235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 20:10:52.766507 12145 server_base.cc:1034] running on GCE node
I20240501 20:10:52.766793 12145 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 20:10:52.766881 12145 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 20:10:52.766948 12145 hybrid_clock.cc:648] HybridClock initialized: now 1714594252766921 us; error 0 us; skew 500 ppm
I20240501 20:10:52.767143 12145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 20:10:52.768678 12145 webserver.cc:460] Webserver started at http://127.11.220.65:46783/ using document root <none> and password file <none>
I20240501 20:10:52.768924 12145 fs_manager.cc:359] Metadata directory not provided
I20240501 20:10:52.769016 12145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 20:10:52.769194 12145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 20:10:52.769997 12145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/ts-0-root/instance:
uuid: "176e77012c2f4c13ad9b2bfbd40056b7"
format_stamp: "Formatted at 2024-05-01 20:10:52 on dist-test-slave-jrmb"
I20240501 20:10:52.772915 12145 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20240501 20:10:52.774844 12240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 20:10:52.775255 12145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 20:10:52.775370 12145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/ts-0-root
uuid: "176e77012c2f4c13ad9b2bfbd40056b7"
format_stamp: "Formatted at 2024-05-01 20:10:52 on dist-test-slave-jrmb"
I20240501 20:10:52.775507 12145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskF7Bzzc/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714594252432592-12145-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 20:10:52.784699 12145 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 20:10:52.785365 12145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 20:10:52.786298 12145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 20:10:52.787834 12145 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 20:10:52.787956 12145 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 20:10:52.788079 12145 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 20:10:52.788161 12145 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 20:10:52.809821 12145 rpc_server.cc:307] RPC server started. Bound to: 127.11.220.65:44493
I20240501 20:10:52.809842 12302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.220.65:44493 every 8 connection(s)
I20240501 20:10:52.828262 12303 heartbeater.cc:347] Connected to a master server at 127.11.220.126:35017
I20240501 20:10:52.828615 12303 heartbeater.cc:464] Registering TS with master...
I20240501 20:10:52.829458 12303 heartbeater.cc:511] Master 127.11.220.126:35017 requested a full tablet report, sending...
I20240501 20:10:52.831660 12175 ts_manager.cc:194] Registered new tserver with Master: 176e77012c2f4c13ad9b2bfbd40056b7 (127.11.220.65:44493)
I20240501 20:10:52.831794 12145 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.020467695s
I20240501 20:10:52.833802 12175 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36862
I20240501 20:10:52.849645 12175 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36878:
name: "update-scan-delta-compact-tbl"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int64"
type: INT64
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 20:10:52.877225 12268 tablet_service.cc:1467] Processing CreateTablet for tablet d5c2b41c67534820975e8c15a1bd9e27 (DEFAULT_TABLE table=update-scan-delta-compact-tbl [id=99b3cb8cb79c4cafa8bd6d5c5d7cfff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 20:10:52.878155 12268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5c2b41c67534820975e8c15a1bd9e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 20:10:52.886088 12315 tablet_bootstrap.cc:492] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7: Bootstrap starting.
I20240501 20:10:52.887923 12315 tablet_bootstrap.cc:654] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7: Neither blocks nor log segments found. Creating new log.
I20240501 20:10:52.890311 12315 tablet_bootstrap.cc:492] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7: No bootstrap required, opened a new log
I20240501 20:10:52.890506 12315 ts_tablet_manager.cc:1367] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 20:10:52.891422 12315 raft_consensus.cc:348] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e77012c2f4c13ad9b2bfbd40056b7" member_type: VOTER last_known_addr { host: "127.11.220.65" port: 44493 } }
I20240501 20:10:52.891681 12315 raft_consensus.cc:374] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 20:10:52.891801 12315 raft_consensus.cc:729] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176e77012c2f4c13ad9b2bfbd40056b7, State: Initialized, Role: FOLLOWER
I20240501 20:10:52.892047 12315 consensus_queue.cc:260] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e77012c2f4c13ad9b2bfbd40056b7" member_type: VOTER last_known_addr { host: "127.11.220.65" port: 44493 } }
I20240501 20:10:52.892249 12315 raft_consensus.cc:388] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 20:10:52.892350 12315 raft_consensus.cc:482] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 20:10:52.892472 12315 raft_consensus.cc:3037] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 0 FOLLOWER]: Advancing to term 1
I20240501 20:10:52.895526 12315 raft_consensus.cc:504] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e77012c2f4c13ad9b2bfbd40056b7" member_type: VOTER last_known_addr { host: "127.11.220.65" port: 44493 } }
I20240501 20:10:52.895825 12315 leader_election.cc:302] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 176e77012c2f4c13ad9b2bfbd40056b7; no voters:
I20240501 20:10:52.896517 12315 leader_election.cc:288] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 20:10:52.896714 12317 raft_consensus.cc:2781] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 20:10:52.897505 12317 raft_consensus.cc:686] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [term 1 LEADER]: Becoming Leader. State: Replica: 176e77012c2f4c13ad9b2bfbd40056b7, State: Running, Role: LEADER
I20240501 20:10:52.897928 12317 consensus_queue.cc:237] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e77012c2f4c13ad9b2bfbd40056b7" member_type: VOTER last_known_addr { host: "127.11.220.65" port: 44493 } }
I20240501 20:10:52.898085 12303 heartbeater.cc:503] Master 127.11.220.126:35017 was elected leader, sending a full tablet report...
I20240501 20:10:52.903136 12175 catalog_manager.cc:5484] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 176e77012c2f4c13ad9b2bfbd40056b7 (127.11.220.65). New cstate: current_term: 1 leader_uuid: "176e77012c2f4c13ad9b2bfbd40056b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e77012c2f4c13ad9b2bfbd40056b7" member_type: VOTER last_known_addr { host: "127.11.220.65" port: 44493 } health_report { overall_health: HEALTHY } } }
I20240501 20:10:52.905711 12315 ts_tablet_manager.cc:1398] T d5c2b41c67534820975e8c15a1bd9e27 P 176e77012c2f4c13ad9b2bfbd40056b7: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20240501 20:10:56.812275 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=1.000000
I20240501 20:10:59.432034 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 2.619s user 2.235s sys 0.364s Metrics: {"bytes_written":182685,"cfile_init":1,"compiler_manager_pool.queue_time_us":413,"compiler_manager_pool.run_cpu_time_us":457616,"compiler_manager_pool.run_wall_time_us":461098,"dirs.queue_time_us":370,"dirs.run_cpu_time_us":205,"dirs.run_wall_time_us":909,"drs_written":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7760,"lbm_writes_lt_1ms":93,"peak_mem_usage":0,"rows_written":65001,"thread_start_us":524,"threads_started":2}
I20240501 20:10:59.434471 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27): 436938 bytes on disk
I20240501 20:10:59.435274 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4}
I20240501 20:11:01.436504 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=2.874778
I20240501 20:11:03.813747 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 2.377s user 2.293s sys 0.056s Metrics: {"bytes_written":213322,"cfile_init":1,"dirs.queue_time_us":430,"dirs.run_cpu_time_us":229,"dirs.run_wall_time_us":1667,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9266,"lbm_writes_lt_1ms":111,"peak_mem_usage":0,"rows_written":79000,"spinlock_wait_cycles":252160,"thread_start_us":262,"threads_started":1}
I20240501 20:11:03.815451 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27): 530304 bytes on disk
I20240501 20:11:03.816107 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4}
I20240501 20:11:03.816743 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=0.014634
I20240501 20:11:06.261530 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 2.445s user 2.356s sys 0.068s Metrics: {"bytes_written":398848,"cfile_cache_hit":10,"cfile_cache_hit_bytes":1858,"cfile_cache_miss":174,"cfile_cache_miss_bytes":2013608,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":2196,"dirs.run_cpu_time_us":436,"dirs.run_wall_time_us":2638,"drs_written":1,"lbm_read_time_us":9788,"lbm_reads_lt_1ms":194,"lbm_write_time_us":15124,"lbm_writes_lt_1ms":186,"mutex_wait_us":60,"num_input_rowsets":2,"peak_mem_usage":1213228,"rows_written":144001,"thread_start_us":1752,"threads_started":6}
I20240501 20:11:06.262346 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=2.874778
I20240501 20:11:08.908555 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 2.646s user 2.515s sys 0.060s Metrics: {"bytes_written":200619,"cfile_init":1,"dirs.queue_time_us":401,"dirs.run_cpu_time_us":203,"dirs.run_wall_time_us":880,"drs_written":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9313,"lbm_writes_lt_1ms":105,"peak_mem_usage":0,"rows_written":74000,"thread_start_us":285,"threads_started":1}
I20240501 20:11:08.909466 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=0.014447
I20240501 20:11:12.725787 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 3.816s user 3.624s sys 0.097s Metrics: {"bytes_written":601158,"cfile_cache_hit":10,"cfile_cache_hit_bytes":2632,"cfile_cache_miss":262,"cfile_cache_miss_bytes":3058008,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":4559,"dirs.run_cpu_time_us":228,"dirs.run_wall_time_us":11303,"drs_written":1,"lbm_read_time_us":14280,"lbm_reads_lt_1ms":290,"lbm_write_time_us":41468,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":269,"num_input_rowsets":2,"peak_mem_usage":2302205,"rows_written":218001,"thread_start_us":3467,"threads_started":7}
I20240501 20:11:12.727185 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27): 1461878 bytes on disk
I20240501 20:11:12.727917 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":114,"lbm_reads_lt_1ms":4}
I20240501 20:11:12.728842 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=5.851340
I20240501 20:11:16.018813 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 3.290s user 3.088s sys 0.157s Metrics: {"bytes_written":263182,"cfile_init":1,"dirs.queue_time_us":397,"dirs.run_cpu_time_us":295,"dirs.run_wall_time_us":73403,"drs_written":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4,"lbm_write_time_us":12238,"lbm_writes_lt_1ms":131,"peak_mem_usage":0,"rows_written":98000,"thread_start_us":256,"threads_started":1}
I20240501 20:11:16.019784 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=0.014200
I20240501 20:11:21.276501 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 5.256s user 5.138s sys 0.116s Metrics: {"bytes_written":869351,"cfile_cache_hit":10,"cfile_cache_hit_bytes":3703,"cfile_cache_miss":368,"cfile_cache_miss_bytes":4423531,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":2776,"dirs.run_cpu_time_us":422,"dirs.run_wall_time_us":3014,"drs_written":1,"lbm_read_time_us":20148,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":391,"lbm_write_time_us":32098,"lbm_writes_lt_1ms":383,"num_input_rowsets":2,"peak_mem_usage":3504624,"rows_written":316001,"thread_start_us":2744,"threads_started":6}
I20240501 20:11:21.277647 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=10.812278
I20240501 20:11:25.522280 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 4.244s user 4.074s sys 0.156s Metrics: {"bytes_written":360814,"cfile_init":1,"dirs.queue_time_us":376,"dirs.run_cpu_time_us":211,"dirs.run_wall_time_us":972,"drs_written":1,"lbm_read_time_us":76,"lbm_reads_lt_1ms":4,"lbm_write_time_us":15385,"lbm_writes_lt_1ms":175,"peak_mem_usage":0,"rows_written":135000,"spinlock_wait_cycles":19712,"thread_start_us":264,"threads_started":1}
I20240501 20:11:25.523149 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27): 3028492 bytes on disk
I20240501 20:11:25.523859 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":129,"lbm_reads_lt_1ms":8}
I20240501 20:11:25.524627 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=1.882590
I20240501 20:11:27.409030 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 1.884s user 1.858s sys 0.022s Metrics: {"bytes_written":181531,"cfile_init":1,"dirs.queue_time_us":405,"dirs.run_cpu_time_us":193,"dirs.run_wall_time_us":986,"drs_written":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7814,"lbm_writes_lt_1ms":98,"peak_mem_usage":0,"rows_written":67000,"thread_start_us":287,"threads_started":1}
I20240501 20:11:27.410168 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=0.022688
I20240501 20:11:36.044034 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 8.634s user 8.369s sys 0.244s Metrics: {"bytes_written":1424524,"cfile_cache_hit":15,"cfile_cache_hit_bytes":6158,"cfile_cache_miss":611,"cfile_cache_miss_bytes":7264880,"cfile_init":8,"delta_iterators_relevant":6,"dirs.queue_time_us":1572,"dirs.run_cpu_time_us":1501,"dirs.run_wall_time_us":1506,"drs_written":1,"lbm_read_time_us":25766,"lbm_reads_lt_1ms":643,"lbm_write_time_us":47322,"lbm_writes_lt_1ms":616,"num_input_rowsets":3,"peak_mem_usage":5129789,"rows_written":518001,"spinlock_wait_cycles":2304,"thread_start_us":1653,"threads_started":5}
I20240501 20:11:36.044889 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27): 3481491 bytes on disk
I20240501 20:11:36.045542 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":129,"lbm_reads_lt_1ms":4}
I20240501 20:11:36.046051 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=15.773215
I20240501 20:11:41.035930 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 4.990s user 4.810s sys 0.144s Metrics: {"bytes_written":449865,"cfile_init":1,"dirs.queue_time_us":396,"dirs.run_cpu_time_us":188,"dirs.run_wall_time_us":1105,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":17714,"lbm_writes_lt_1ms":214,"peak_mem_usage":0,"rows_written":168000,"thread_start_us":275,"threads_started":1}
I20240501 20:11:41.036878 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27): 1129313 bytes on disk
I20240501 20:11:41.037482 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: UndoDeltaBlockGCOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":124,"lbm_reads_lt_1ms":4}
I20240501 20:11:41.038123 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=2.874778
I20240501 20:11:43.355453 12245 maintenance_manager.cc:643] P 176e77012c2f4c13ad9b2bfbd40056b7: FlushMRSOp(d5c2b41c67534820975e8c15a1bd9e27) complete. Timing: real 2.317s user 2.261s sys 0.032s Metrics: {"bytes_written":213961,"cfile_init":1,"dirs.queue_time_us":369,"dirs.run_cpu_time_us":213,"dirs.run_wall_time_us":1074,"drs_written":1,"lbm_read_time_us":82,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9117,"lbm_writes_lt_1ms":111,"peak_mem_usage":0,"rows_written":79000,"thread_start_us":239,"threads_started":1}
I20240501 20:11:43.356595 12304 maintenance_manager.cc:419] P 176e77012c2f4c13ad9b2bfbd40056b7: Scheduling CompactRowSetsOp(d5c2b41c67534820975e8c15a1bd9e27): perf score=0.022061
I20240501 20:11:55.607267 12145 update_scan_delta_compact-test.cc:209] Time spent Insert: real 62.686s user 57.720s sys 4.433s
I20240501 20:11:55.640396 12362 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 20:11:55.644960 12362 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 20:11:55.648093 12362 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 20:11:55.658027 12362 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 20:11:55.661089 12362 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
F20240501 20:11:55.663350 12362 monotime.cc:342] Check failed: t_beg.Initialized()
*** Check failure stack trace: ***
*** Aborted at 1714594315 (unix time) try "date -d @1714594315" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800002f71) received by PID 12145 (TID 0x7eff2eaa0700) from PID 12145; stack trace: ***
@ 0x7eff5afc1980 (unknown) at ??:0
@ 0x7eff5406cfb7 gsignal at ??:0
@ 0x7eff5406e921 abort at ??:0
@ 0x7eff56d95dcd google::LogMessage::Fail() at ??:0
@ 0x7eff56d99b93 google::LogMessage::SendToLog() at ??:0
@ 0x7eff56d957cc google::LogMessage::Flush() at ??:0
@ 0x7eff56d96f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7eff582fac80 kudu::operator-() at ??:0
@ 0x7eff63b1b14a kudu::tablet::WriteOp::ToString() at ??:0
@ 0x7eff63ae55de kudu::tablet::OpDriver::ToStringUnlocked() at ??:0
@ 0x7eff63ae5336 kudu::tablet::OpDriver::ToString() at ??:0
@ 0x7eff63a922d9 kudu::tablet::TabletReplica::GetInFlightOps() at ??:0
@ 0x7eff6a910e47 kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0
@ 0x7eff6a91f9fc kudu::tserver::TabletServerPathHandlers::Register()::$_3::operator()() at ??:0
@ 0x7eff6a91f862 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7eff60c7d02a std::function<>::operator()() at ??:0
@ 0x7eff60c757ba kudu::Webserver::RunPathHandler() at ??:0
@ 0x7eff60c707f1 kudu::Webserver::BeginRequestCallback() at ??:0
@ 0x7eff60c6e927 kudu::Webserver::BeginRequestCallbackStatic() at ??:0
@ 0x7eff60cac089 handle_request at ??:0
@ 0x7eff60cae76b worker_thread at ??:0
@ 0x7eff5afb66db start_thread at ??:0
@ 0x7eff5414f71f clone at ??:0