[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from UpdateScanDeltaCompactionTest
[ RUN ] UpdateScanDeltaCompactionTest.TestAll
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 08:00:36.687619 390 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.97.190:41827
I20240501 08:00:36.688743 390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:00:36.689522 390 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:00:36.698120 396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:00:36.698518 398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:00:36.700228 390 server_base.cc:1034] running on GCE node
W20240501 08:00:36.700630 395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:00:36.701339 390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:00:36.701467 390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:00:36.701512 390 hybrid_clock.cc:648] HybridClock initialized: now 1714550436701507 us; error 0 us; skew 500 ppm
I20240501 08:00:36.709275 390 webserver.cc:460] Webserver started at http://127.0.97.190:34275/ using document root <none> and password file <none>
I20240501 08:00:36.710137 390 fs_manager.cc:359] Metadata directory not provided
I20240501 08:00:36.710244 390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:00:36.710539 390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:00:36.712620 390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/master-0-root/instance:
uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9"
format_stamp: "Formatted at 2024-05-01 08:00:36 on dist-test-slave-3sxf"
I20240501 08:00:36.718050 390 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20240501 08:00:36.721740 403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:00:36.723933 390 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20240501 08:00:36.724156 390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/master-0-root
uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9"
format_stamp: "Formatted at 2024-05-01 08:00:36 on dist-test-slave-3sxf"
I20240501 08:00:36.724326 390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:00:36.758881 390 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:00:36.760330 390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:00:36.760634 390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:00:36.768626 390 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.190:41827
I20240501 08:00:36.768651 455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.190:41827 every 8 connection(s)
I20240501 08:00:36.772071 456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:00:36.780114 456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9: Bootstrap starting.
I20240501 08:00:36.783054 456 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9: Neither blocks nor log segments found. Creating new log.
I20240501 08:00:36.783891 456 log.cc:824] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9: Log is configured to *not* fsync() on all Append() calls
I20240501 08:00:36.786288 456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9: No bootstrap required, opened a new log
I20240501 08:00:36.790046 456 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" member_type: VOTER }
I20240501 08:00:36.790318 456 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:00:36.790366 456 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b0d4d6be8ee415f8d8ba3cc6e46a3a9, State: Initialized, Role: FOLLOWER
I20240501 08:00:36.791326 456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" member_type: VOTER }
I20240501 08:00:36.791554 456 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:00:36.791641 456 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:00:36.791783 456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:00:36.797518 456 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" member_type: VOTER }
I20240501 08:00:36.798308 456 leader_election.cc:302] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b0d4d6be8ee415f8d8ba3cc6e46a3a9; no voters:
I20240501 08:00:36.799089 456 leader_election.cc:288] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:00:36.799254 459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:00:36.799589 459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [term 1 LEADER]: Becoming Leader. State: Replica: 8b0d4d6be8ee415f8d8ba3cc6e46a3a9, State: Running, Role: LEADER
I20240501 08:00:36.800249 459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" member_type: VOTER }
I20240501 08:00:36.800484 456 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:00:36.802953 460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" member_type: VOTER } }
I20240501 08:00:36.803283 390 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 08:00:36.803337 460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [sys.catalog]: This master's current role is: LEADER
I20240501 08:00:36.803427 461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b0d4d6be8ee415f8d8ba3cc6e46a3a9. Latest consensus state: current_term: 1 leader_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0d4d6be8ee415f8d8ba3cc6e46a3a9" member_type: VOTER } }
I20240501 08:00:36.804100 461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9 [sys.catalog]: This master's current role is: LEADER
W20240501 08:00:36.807489 473 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240501 08:00:36.807614 473 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240501 08:00:36.807715 475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:00:36.809015 475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:00:36.818909 475 catalog_manager.cc:1347] Generated new cluster ID: a1903ec40adc45769252b4b258206521
I20240501 08:00:36.819022 475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:00:36.840272 475 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:00:36.841823 475 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:00:36.854844 475 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 8b0d4d6be8ee415f8d8ba3cc6e46a3a9: Generated new TSK 0
I20240501 08:00:36.855710 475 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:00:36.869907 390 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:00:36.875416 478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:00:36.876156 390 server_base.cc:1034] running on GCE node
W20240501 08:00:36.876931 479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:00:36.877664 481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:00:36.877997 390 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:00:36.878053 390 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:00:36.878070 390 hybrid_clock.cc:648] HybridClock initialized: now 1714550436878070 us; error 0 us; skew 500 ppm
I20240501 08:00:36.879146 390 webserver.cc:460] Webserver started at http://127.0.97.129:40173/ using document root <none> and password file <none>
I20240501 08:00:36.879320 390 fs_manager.cc:359] Metadata directory not provided
I20240501 08:00:36.879372 390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:00:36.879459 390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:00:36.879894 390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/ts-0-root/instance:
uuid: "0c8542f94b6a4adb93348a291843856b"
format_stamp: "Formatted at 2024-05-01 08:00:36 on dist-test-slave-3sxf"
I20240501 08:00:36.882373 390 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:00:36.884290 486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:00:36.884662 390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 08:00:36.884763 390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/ts-0-root
uuid: "0c8542f94b6a4adb93348a291843856b"
format_stamp: "Formatted at 2024-05-01 08:00:36 on dist-test-slave-3sxf"
I20240501 08:00:36.884892 390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9rJIjo/test-tmp/update_scan_delta_compact-test.0.UpdateScanDeltaCompactionTest.TestAll.1714550436676044-390-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:00:36.906589 390 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:00:36.907244 390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:00:36.908279 390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:00:36.909516 390 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:00:36.909804 390 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:00:36.909919 390 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:00:36.909953 390 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:00:36.919813 390 rpc_server.cc:307] RPC server started. Bound to: 127.0.97.129:35299
I20240501 08:00:36.919849 549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.97.129:35299 every 8 connection(s)
I20240501 08:00:36.932473 550 heartbeater.cc:347] Connected to a master server at 127.0.97.190:41827
I20240501 08:00:36.932792 550 heartbeater.cc:464] Registering TS with master...
I20240501 08:00:36.933444 550 heartbeater.cc:511] Master 127.0.97.190:41827 requested a full tablet report, sending...
I20240501 08:00:36.935427 416 ts_manager.cc:194] Registered new tserver with Master: 0c8542f94b6a4adb93348a291843856b (127.0.97.129:35299)
I20240501 08:00:36.935490 390 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.015038231s
I20240501 08:00:36.937109 416 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46890
I20240501 08:00:36.950918 416 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46896:
name: "update-scan-delta-compact-tbl"
schema {
columns {
name: "key"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int64"
type: INT64
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240501 08:00:36.972265 512 tablet_service.cc:1467] Processing CreateTablet for tablet 7e223514585b4ee9966f4a8ed1380397 (DEFAULT_TABLE table=update-scan-delta-compact-tbl [id=e5caba83e6414e478dc15de8d93df952]), partition=RANGE (key) PARTITION UNBOUNDED
I20240501 08:00:36.972851 512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e223514585b4ee9966f4a8ed1380397. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:00:36.976981 562 tablet_bootstrap.cc:492] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b: Bootstrap starting.
I20240501 08:00:36.979990 562 tablet_bootstrap.cc:654] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b: Neither blocks nor log segments found. Creating new log.
I20240501 08:00:36.983532 562 tablet_bootstrap.cc:492] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b: No bootstrap required, opened a new log
I20240501 08:00:36.983736 562 ts_tablet_manager.cc:1367] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20240501 08:00:36.984473 562 raft_consensus.cc:348] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8542f94b6a4adb93348a291843856b" member_type: VOTER last_known_addr { host: "127.0.97.129" port: 35299 } }
I20240501 08:00:36.984666 562 raft_consensus.cc:374] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:00:36.984714 562 raft_consensus.cc:729] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c8542f94b6a4adb93348a291843856b, State: Initialized, Role: FOLLOWER
I20240501 08:00:36.985033 562 consensus_queue.cc:260] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8542f94b6a4adb93348a291843856b" member_type: VOTER last_known_addr { host: "127.0.97.129" port: 35299 } }
I20240501 08:00:36.985168 562 raft_consensus.cc:388] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:00:36.985216 562 raft_consensus.cc:482] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:00:36.985263 562 raft_consensus.cc:3037] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:00:36.992586 562 raft_consensus.cc:504] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8542f94b6a4adb93348a291843856b" member_type: VOTER last_known_addr { host: "127.0.97.129" port: 35299 } }
I20240501 08:00:36.992897 562 leader_election.cc:302] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c8542f94b6a4adb93348a291843856b; no voters:
I20240501 08:00:36.993222 562 leader_election.cc:288] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:00:36.993444 564 raft_consensus.cc:2781] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:00:36.993683 562 ts_tablet_manager.cc:1398] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b: Time spent starting tablet: real 0.010s user 0.003s sys 0.002s
I20240501 08:00:36.993880 550 heartbeater.cc:503] Master 127.0.97.190:41827 was elected leader, sending a full tablet report...
I20240501 08:00:36.993978 564 raft_consensus.cc:686] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [term 1 LEADER]: Becoming Leader. State: Replica: 0c8542f94b6a4adb93348a291843856b, State: Running, Role: LEADER
I20240501 08:00:36.994238 564 consensus_queue.cc:237] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8542f94b6a4adb93348a291843856b" member_type: VOTER last_known_addr { host: "127.0.97.129" port: 35299 } }
I20240501 08:00:36.998456 416 catalog_manager.cc:5484] T 7e223514585b4ee9966f4a8ed1380397 P 0c8542f94b6a4adb93348a291843856b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c8542f94b6a4adb93348a291843856b (127.0.97.129). New cstate: current_term: 1 leader_uuid: "0c8542f94b6a4adb93348a291843856b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c8542f94b6a4adb93348a291843856b" member_type: VOTER last_known_addr { host: "127.0.97.129" port: 35299 } health_report { overall_health: HEALTHY } } }
I20240501 08:00:40.921382 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling FlushMRSOp(7e223514585b4ee9966f4a8ed1380397): perf score=7.835715
I20240501 08:00:42.881598 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: FlushMRSOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 1.960s user 1.903s sys 0.004s Metrics: {"bytes_written":319466,"cfile_init":1,"compiler_manager_pool.queue_time_us":544,"compiler_manager_pool.run_cpu_time_us":218348,"compiler_manager_pool.run_wall_time_us":221816,"dirs.queue_time_us":241,"dirs.run_cpu_time_us":252,"dirs.run_wall_time_us":907,"drs_written":1,"lbm_read_time_us":75,"lbm_reads_lt_1ms":4,"lbm_write_time_us":12738,"lbm_writes_lt_1ms":152,"peak_mem_usage":0,"rows_written":116001,"thread_start_us":213,"threads_started":2}
I20240501 08:00:42.882689 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397): 776575 bytes on disk
I20240501 08:00:42.883284 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20240501 08:00:44.884079 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling FlushMRSOp(7e223514585b4ee9966f4a8ed1380397): perf score=6.843528
I20240501 08:00:46.416368 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: FlushMRSOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 1.532s user 1.529s sys 0.000s Metrics: {"bytes_written":282781,"cfile_init":1,"dirs.queue_time_us":243,"dirs.run_cpu_time_us":411,"dirs.run_wall_time_us":1623,"drs_written":1,"lbm_read_time_us":89,"lbm_reads_lt_1ms":4,"lbm_write_time_us":12144,"lbm_writes_lt_1ms":140,"peak_mem_usage":0,"rows_written":105000,"thread_start_us":109,"threads_started":1}
I20240501 08:00:46.417532 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397): perf score=0.014442
I20240501 08:00:48.644527 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 2.227s user 2.202s sys 0.012s Metrics: {"bytes_written":610441,"cfile_cache_hit":10,"cfile_cache_hit_bytes":2676,"cfile_cache_miss":262,"cfile_cache_miss_bytes":3085514,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":602,"dirs.run_cpu_time_us":376,"dirs.run_wall_time_us":2044,"drs_written":1,"lbm_read_time_us":10361,"lbm_reads_lt_1ms":286,"lbm_write_time_us":25809,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":273,"num_input_rowsets":2,"peak_mem_usage":1847234,"rows_written":221001,"thread_start_us":393,"threads_started":6}
I20240501 08:00:48.645323 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling FlushMRSOp(7e223514585b4ee9966f4a8ed1380397): perf score=4.859153
I20240501 08:00:49.932662 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: FlushMRSOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 1.287s user 1.255s sys 0.004s Metrics: {"bytes_written":241085,"cfile_init":1,"dirs.queue_time_us":193,"dirs.run_cpu_time_us":198,"dirs.run_wall_time_us":918,"drs_written":1,"lbm_read_time_us":39,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9416,"lbm_writes_lt_1ms":122,"peak_mem_usage":0,"rows_written":90000,"thread_start_us":82,"threads_started":1}
I20240501 08:00:49.933398 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397): 2084105 bytes on disk
I20240501 08:00:49.933933 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":94,"lbm_reads_lt_1ms":8}
I20240501 08:00:49.934496 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397): perf score=0.014213
I20240501 08:00:53.180194 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 3.245s user 3.204s sys 0.040s Metrics: {"bytes_written":855232,"cfile_cache_hit":10,"cfile_cache_hit_bytes":3644,"cfile_cache_miss":364,"cfile_cache_miss_bytes":4356362,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":864,"dirs.run_cpu_time_us":195,"dirs.run_wall_time_us":1222,"drs_written":1,"lbm_read_time_us":15346,"lbm_reads_lt_1ms":384,"lbm_write_time_us":29926,"lbm_writes_lt_1ms":378,"num_input_rowsets":2,"peak_mem_usage":3553367,"rows_written":311001,"spinlock_wait_cycles":4096,"thread_start_us":477,"threads_started":7}
I20240501 08:00:53.180960 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397): 2090084 bytes on disk
I20240501 08:00:53.181430 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4}
I20240501 08:00:53.181859 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling FlushMRSOp(7e223514585b4ee9966f4a8ed1380397): perf score=8.827903
I20240501 08:00:54.895736 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: FlushMRSOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 1.714s user 1.698s sys 0.012s Metrics: {"bytes_written":319657,"cfile_init":1,"dirs.queue_time_us":229,"dirs.run_cpu_time_us":186,"dirs.run_wall_time_us":1100,"drs_written":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":12518,"lbm_writes_lt_1ms":155,"peak_mem_usage":0,"rows_written":119000,"thread_start_us":127,"threads_started":1}
I20240501 08:00:54.896494 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397): perf score=0.013911
I20240501 08:00:59.109911 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 4.213s user 4.158s sys 0.040s Metrics: {"bytes_written":1184431,"cfile_cache_hit":10,"cfile_cache_hit_bytes":4865,"cfile_cache_miss":500,"cfile_cache_miss_bytes":6038331,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":467,"dirs.run_cpu_time_us":338,"dirs.run_wall_time_us":4070,"drs_written":1,"lbm_read_time_us":19226,"lbm_reads_lt_1ms":524,"lbm_write_time_us":37351,"lbm_writes_lt_1ms":517,"num_input_rowsets":2,"peak_mem_usage":5015767,"rows_written":430001,"spinlock_wait_cycles":102656,"thread_start_us":411,"threads_started":7}
I20240501 08:00:59.110692 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397): 2890032 bytes on disk
I20240501 08:00:59.111109 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":44,"lbm_reads_lt_1ms":4}
I20240501 08:00:59.111598 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling FlushMRSOp(7e223514585b4ee9966f4a8ed1380397): perf score=12.796653
I20240501 08:01:01.066529 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: FlushMRSOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 1.955s user 1.930s sys 0.012s Metrics: {"bytes_written":399732,"cfile_init":1,"dirs.queue_time_us":226,"dirs.run_cpu_time_us":159,"dirs.run_wall_time_us":1090,"drs_written":1,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":14720,"lbm_writes_lt_1ms":192,"peak_mem_usage":0,"rows_written":150000,"thread_start_us":104,"threads_started":1}
I20240501 08:01:01.067418 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397): 1007200 bytes on disk
I20240501 08:01:01.068001 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: UndoDeltaBlockGCOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":97,"lbm_reads_lt_1ms":4}
I20240501 08:01:01.068578 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397): perf score=0.013530
I20240501 08:01:06.691300 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 5.623s user 5.607s sys 0.012s Metrics: {"bytes_written":1598136,"cfile_cache_hit":10,"cfile_cache_hit_bytes":6610,"cfile_cache_miss":676,"cfile_cache_miss_bytes":8149674,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":711,"dirs.run_cpu_time_us":203,"dirs.run_wall_time_us":981,"drs_written":1,"lbm_read_time_us":26666,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":695,"lbm_write_time_us":49032,"lbm_writes_lt_1ms":689,"num_input_rowsets":2,"peak_mem_usage":6949383,"rows_written":580001,"spinlock_wait_cycles":2816,"thread_start_us":470,"threads_started":7}
I20240501 08:01:06.692063 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling FlushMRSOp(7e223514585b4ee9966f4a8ed1380397): perf score=18.749778
I20240501 08:01:08.814137 491 maintenance_manager.cc:643] P 0c8542f94b6a4adb93348a291843856b: FlushMRSOp(7e223514585b4ee9966f4a8ed1380397) complete. Timing: real 2.122s user 2.094s sys 0.008s Metrics: {"bytes_written":520323,"cfile_init":1,"dirs.queue_time_us":230,"dirs.run_cpu_time_us":192,"dirs.run_wall_time_us":880,"drs_written":1,"lbm_read_time_us":39,"lbm_reads_lt_1ms":4,"lbm_write_time_us":18561,"lbm_writes_lt_1ms":242,"peak_mem_usage":0,"rows_written":194000,"thread_start_us":102,"threads_started":1}
I20240501 08:01:08.814850 551 maintenance_manager.cc:419] P 0c8542f94b6a4adb93348a291843856b: Scheduling CompactRowSetsOp(7e223514585b4ee9966f4a8ed1380397): perf score=0.013037
I20240501 08:01:16.063202 390 update_scan_delta_compact-test.cc:209] Time spent Insert: real 39.052s user 37.073s sys 1.764s
I20240501 08:01:16.065510 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.069581 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.071548 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.073467 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.075825 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.078239 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.080308 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.082379 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.084376 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.086351 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.088337 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.090478 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.092504 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.094522 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.096513 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.098517 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.100622 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.102653 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
I20240501 08:01:16.105155 610 scanners.cc:360] Slow scans show is disabled. Set --show_slow_scans to enable it.
F20240501 08:01:16.106336 610 monotime.cc:342] Check failed: t_beg.Initialized()
*** Check failure stack trace: ***
*** Aborted at 1714550476 (unix time) try "date -d @1714550476" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000186) received by PID 390 (TID 0x7f8e9af8e700) from PID 390; stack trace: ***
@ 0x7f8ec8285980 (unknown) at ??:0
@ 0x7f8ec62e5fb7 gsignal at ??:0
@ 0x7f8ec62e7921 abort at ??:0
@ 0x7f8ec6e54dcd google::LogMessage::Fail() at ??:0
@ 0x7f8ec6e58b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f8ec6e547cc google::LogMessage::Flush() at ??:0
@ 0x7f8ec6e55f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8ec7b495b1 kudu::operator-() at ??:0
@ 0x7f8ec89f4fd2 kudu::tablet::WriteOp::ToString() at ??:0
@ 0x7f8ec89de05b kudu::tablet::OpDriver::ToStringUnlocked() at ??:0
@ 0x7f8ec89ddf90 kudu::tablet::OpDriver::ToString() at ??:0
@ 0x7f8ec89b49bd kudu::tablet::TabletReplica::GetInFlightOps() at ??:0
@ 0x7f8ec9494861 kudu::tserver::TabletServerPathHandlers::HandleTransactionsPage() at ??:0
@ 0x7f8ec949393a _ZZN4kudu7tserver24TabletServerPathHandlers8RegisterEPNS_9WebserverEENKUlRKNS_19WebCallbackRegistry10WebRequestEPNS4_22PrerenderedWebResponseEE2_clES7_S9_ at ??:0
@ 0x7f8ec949c149 _ZNSt17_Function_handlerIFvRKN4kudu19WebCallbackRegistry10WebRequestEPNS1_22PrerenderedWebResponseEEZNS0_7tserver24TabletServerPathHandlers8RegisterEPNS0_9WebserverEEUlS4_S6_E2_E9_M_invokeERKSt9_Any_dataS4_OS6_ at ??:0
@ 0x7f8ec5a6dd09 std::function<>::operator()() at ??:0
@ 0x7f8ec5a68143 kudu::Webserver::RunPathHandler() at ??:0
@ 0x7f8ec5a67a38 kudu::Webserver::BeginRequestCallback() at ??:0
@ 0x7f8ec5a67123 kudu::Webserver::BeginRequestCallbackStatic() at ??:0
@ 0x7f8ec5a8fb89 handle_request at ??:0
@ 0x7f8ec5a9226b worker_thread at ??:0
@ 0x7f8ec827a6db start_thread at ??:0
@ 0x7f8ec63c871f clone at ??:0