Note: This is test shard 1 of 8.
[==========] Running 28 tests from 7 test suites.
[----------] Global test environment set-up.
[----------] 21 tests from ClientTest
[ RUN ] ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250114 20:57:07.599985 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:41771
I20250114 20:57:07.601266 6853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250114 20:57:07.602080 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:07.617576 6862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:07.618443 6860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:07.619467 6859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:07.620258 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:08.796483 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:08.796674 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:08.796823 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888228796810 us; error 0 us; skew 500 ppm
I20250114 20:57:08.797600 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:08.809881 6853 webserver.cc:458] Webserver started at http://127.6.177.126:39009/ using document root <none> and password file <none>
I20250114 20:57:08.810611 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:08.810798 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:08.811189 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:08.816838 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "40090800a9254240923bbdbe05cfe2a2"
format_stamp: "Formatted at 2025-01-14 20:57:08 on dist-test-slave-26qh"
I20250114 20:57:08.823630 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20250114 20:57:08.827971 6868 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:08.828943 6853 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20250114 20:57:08.829218 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "40090800a9254240923bbdbe05cfe2a2"
format_stamp: "Formatted at 2025-01-14 20:57:08 on dist-test-slave-26qh"
I20250114 20:57:08.829489 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:08.882802 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:08.884101 6853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250114 20:57:08.884539 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:08.956060 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:41771
I20250114 20:57:08.956127 6929 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:41771 every 8 connection(s)
I20250114 20:57:08.961576 6930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:08.981451 6930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2: Bootstrap starting.
I20250114 20:57:08.987715 6930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:08.989723 6930 log.cc:826] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2: Log is configured to *not* fsync() on all Append() calls
I20250114 20:57:08.993860 6930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2: No bootstrap required, opened a new log
I20250114 20:57:09.012907 6930 raft_consensus.cc:357] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40090800a9254240923bbdbe05cfe2a2" member_type: VOTER }
I20250114 20:57:09.013330 6930 raft_consensus.cc:383] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:09.013532 6930 raft_consensus.cc:738] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40090800a9254240923bbdbe05cfe2a2, State: Initialized, Role: FOLLOWER
I20250114 20:57:09.014256 6930 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40090800a9254240923bbdbe05cfe2a2" member_type: VOTER }
I20250114 20:57:09.014703 6930 raft_consensus.cc:397] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:09.014973 6930 raft_consensus.cc:491] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:09.015309 6930 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:09.019495 6930 raft_consensus.cc:513] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40090800a9254240923bbdbe05cfe2a2" member_type: VOTER }
I20250114 20:57:09.020416 6930 leader_election.cc:304] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40090800a9254240923bbdbe05cfe2a2; no voters:
I20250114 20:57:09.022032 6930 leader_election.cc:290] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:09.022349 6933 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:09.024341 6933 raft_consensus.cc:695] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 1 LEADER]: Becoming Leader. State: Replica: 40090800a9254240923bbdbe05cfe2a2, State: Running, Role: LEADER
I20250114 20:57:09.025084 6933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40090800a9254240923bbdbe05cfe2a2" member_type: VOTER }
I20250114 20:57:09.025942 6930 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:09.034240 6934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40090800a9254240923bbdbe05cfe2a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40090800a9254240923bbdbe05cfe2a2" member_type: VOTER } }
I20250114 20:57:09.034973 6934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:09.035403 6935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40090800a9254240923bbdbe05cfe2a2. Latest consensus state: current_term: 1 leader_uuid: "40090800a9254240923bbdbe05cfe2a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40090800a9254240923bbdbe05cfe2a2" member_type: VOTER } }
I20250114 20:57:09.035797 6935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:09.038514 6940 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:09.048254 6940 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:09.052227 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:09.063884 6940 catalog_manager.cc:1348] Generated new cluster ID: 00272c5afdaa4fdab2cf44b4b7bd6ba6
I20250114 20:57:09.064109 6940 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:09.080507 6940 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:09.081804 6940 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:09.095748 6940 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2: Generated new TSK 0
I20250114 20:57:09.096467 6940 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:09.121946 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:09.131156 6952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:09.133385 6953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:09.135463 6853 server_base.cc:1034] running on GCE node
W20250114 20:57:09.136294 6955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:09.137059 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:09.137255 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:09.137432 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888229137414 us; error 0 us; skew 500 ppm
I20250114 20:57:09.137952 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:09.142010 6853 webserver.cc:458] Webserver started at http://127.6.177.65:46415/ using document root <none> and password file <none>
I20250114 20:57:09.142596 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:09.142779 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:09.143013 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:09.144063 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "a66f3efab08b45e0bb3ab254319923de"
format_stamp: "Formatted at 2025-01-14 20:57:09 on dist-test-slave-26qh"
I20250114 20:57:09.149060 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20250114 20:57:09.152715 6960 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:09.153412 6853 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:57:09.153697 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "a66f3efab08b45e0bb3ab254319923de"
format_stamp: "Formatted at 2025-01-14 20:57:09 on dist-test-slave-26qh"
I20250114 20:57:09.154016 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:09.191218 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:09.192703 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:09.204974 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:09.205237 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:09.205500 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:09.205689 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:09.296303 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:41913
I20250114 20:57:09.296336 7030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:41913 every 8 connection(s)
I20250114 20:57:09.302881 7031 heartbeater.cc:346] Connected to a master server at 127.6.177.126:41771
I20250114 20:57:09.303223 7031 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:09.304000 7031 heartbeater.cc:510] Master 127.6.177.126:41771 requested a full tablet report, sending...
I20250114 20:57:09.306142 6885 ts_manager.cc:194] Registered new tserver with Master: a66f3efab08b45e0bb3ab254319923de (127.6.177.65:41913)
I20250114 20:57:09.306216 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00397667s
I20250114 20:57:09.308060 6885 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55936
I20250114 20:57:09.321218 7031 heartbeater.cc:502] Master 127.6.177.126:41771 was elected leader, sending a full tablet report...
I20250114 20:57:09.332252 6885 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55954:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:09.390130 6996 tablet_service.cc:1467] Processing CreateTablet for tablet 339259c47d4d4143961b2a616b25b3ac (DEFAULT_TABLE table=client-testtb [id=ef64575463c8448a8e9b37a4405b7526]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:09.391250 6996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 339259c47d4d4143961b2a616b25b3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:09.394929 6995 tablet_service.cc:1467] Processing CreateTablet for tablet ae4fe2b63e9646959c6683d99cc351d8 (DEFAULT_TABLE table=client-testtb [id=ef64575463c8448a8e9b37a4405b7526]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:09.396183 6995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4fe2b63e9646959c6683d99cc351d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:09.405123 7041 tablet_bootstrap.cc:492] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de: Bootstrap starting.
I20250114 20:57:09.411414 7041 tablet_bootstrap.cc:654] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:09.416100 7041 tablet_bootstrap.cc:492] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de: No bootstrap required, opened a new log
I20250114 20:57:09.416373 7041 ts_tablet_manager.cc:1397] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20250114 20:57:09.418481 7041 raft_consensus.cc:357] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.419086 7041 raft_consensus.cc:383] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:09.419370 7041 raft_consensus.cc:738] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a66f3efab08b45e0bb3ab254319923de, State: Initialized, Role: FOLLOWER
I20250114 20:57:09.419878 7041 consensus_queue.cc:260] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.420298 7041 raft_consensus.cc:397] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:09.420588 7041 raft_consensus.cc:491] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:09.420876 7041 raft_consensus.cc:3054] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:09.424952 7041 raft_consensus.cc:513] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.425410 7041 leader_election.cc:304] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a66f3efab08b45e0bb3ab254319923de; no voters:
I20250114 20:57:09.427551 7041 leader_election.cc:290] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:09.428035 7043 raft_consensus.cc:2798] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:09.432744 7041 ts_tablet_manager.cc:1428] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de: Time spent starting tablet: real 0.016s user 0.004s sys 0.012s
I20250114 20:57:09.433643 7041 tablet_bootstrap.cc:492] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de: Bootstrap starting.
I20250114 20:57:09.435526 7043 raft_consensus.cc:695] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 1 LEADER]: Becoming Leader. State: Replica: a66f3efab08b45e0bb3ab254319923de, State: Running, Role: LEADER
I20250114 20:57:09.436180 7043 consensus_queue.cc:237] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.440017 7041 tablet_bootstrap.cc:654] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:09.446990 6884 catalog_manager.cc:5526] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de reported cstate change: term changed from 0 to 1, leader changed from <none> to a66f3efab08b45e0bb3ab254319923de (127.6.177.65). New cstate: current_term: 1 leader_uuid: "a66f3efab08b45e0bb3ab254319923de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:09.462211 7041 tablet_bootstrap.cc:492] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de: No bootstrap required, opened a new log
I20250114 20:57:09.462544 7041 ts_tablet_manager.cc:1397] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de: Time spent bootstrapping tablet: real 0.029s user 0.020s sys 0.006s
I20250114 20:57:09.464879 7041 raft_consensus.cc:357] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.465333 7041 raft_consensus.cc:383] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:09.465564 7041 raft_consensus.cc:738] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a66f3efab08b45e0bb3ab254319923de, State: Initialized, Role: FOLLOWER
I20250114 20:57:09.466060 7041 consensus_queue.cc:260] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.466602 7041 raft_consensus.cc:397] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:09.466856 7041 raft_consensus.cc:491] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:09.467137 7041 raft_consensus.cc:3054] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:09.472309 7041 raft_consensus.cc:513] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.472851 7041 leader_election.cc:304] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a66f3efab08b45e0bb3ab254319923de; no voters:
I20250114 20:57:09.473343 7041 leader_election.cc:290] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:09.473449 7043 raft_consensus.cc:2798] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:09.473815 7043 raft_consensus.cc:695] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 1 LEADER]: Becoming Leader. State: Replica: a66f3efab08b45e0bb3ab254319923de, State: Running, Role: LEADER
I20250114 20:57:09.474350 7043 consensus_queue.cc:237] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } }
I20250114 20:57:09.475029 7041 ts_tablet_manager.cc:1428] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20250114 20:57:09.479923 6884 catalog_manager.cc:5526] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de reported cstate change: term changed from 0 to 1, leader changed from <none> to a66f3efab08b45e0bb3ab254319923de (127.6.177.65). New cstate: current_term: 1 leader_uuid: "a66f3efab08b45e0bb3ab254319923de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f3efab08b45e0bb3ab254319923de" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 41913 } health_report { overall_health: HEALTHY } } }
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/client-test.cc:1032: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20250114 20:57:09.493064 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:09.511673 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:09.512606 6853 tablet_replica.cc:331] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de: stopping tablet replica
I20250114 20:57:09.513206 6853 raft_consensus.cc:2238] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:09.513643 6853 raft_consensus.cc:2267] T ae4fe2b63e9646959c6683d99cc351d8 P a66f3efab08b45e0bb3ab254319923de [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:09.516281 6853 tablet_replica.cc:331] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de: stopping tablet replica
I20250114 20:57:09.516793 6853 raft_consensus.cc:2238] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:09.517159 6853 raft_consensus.cc:2267] T 339259c47d4d4143961b2a616b25b3ac P a66f3efab08b45e0bb3ab254319923de [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:09.645628 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:09.657822 6853 master.cc:537] Master@127.6.177.126:41771 shutting down...
I20250114 20:57:09.726954 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:09.727486 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:09.727773 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 40090800a9254240923bbdbe05cfe2a2: stopping tablet replica
I20250114 20:57:09.744704 6853 master.cc:559] Master@127.6.177.126:41771 shutdown complete.
[ SKIPPED ] ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent (2166 ms)
[ RUN ] ClientTest.TestMasterDown
I20250114 20:57:09.762953 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:44977
I20250114 20:57:09.763850 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:09.769554 7050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:09.770090 7051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:09.770916 7053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:09.771817 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:09.772544 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:09.772691 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:09.772838 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888229772824 us; error 0 us; skew 500 ppm
I20250114 20:57:09.773231 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:09.775745 6853 webserver.cc:458] Webserver started at http://127.6.177.126:34937/ using document root <none> and password file <none>
I20250114 20:57:09.776140 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:09.776314 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:09.776530 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:09.777500 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "b51bf3395440416ca129c58e0ee4fb00"
format_stamp: "Formatted at 2025-01-14 20:57:09 on dist-test-slave-26qh"
I20250114 20:57:09.782231 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250114 20:57:09.785987 7058 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:09.787137 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:57:09.787374 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "b51bf3395440416ca129c58e0ee4fb00"
format_stamp: "Formatted at 2025-01-14 20:57:09 on dist-test-slave-26qh"
I20250114 20:57:09.787635 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:09.810895 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:09.811789 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:09.864130 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:44977
I20250114 20:57:09.864221 7119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:44977 every 8 connection(s)
I20250114 20:57:09.867725 7120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:09.875275 7120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00: Bootstrap starting.
I20250114 20:57:09.878643 7120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:09.881886 7120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00: No bootstrap required, opened a new log
I20250114 20:57:09.883402 7120 raft_consensus.cc:357] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b51bf3395440416ca129c58e0ee4fb00" member_type: VOTER }
I20250114 20:57:09.883728 7120 raft_consensus.cc:383] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:09.883931 7120 raft_consensus.cc:738] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b51bf3395440416ca129c58e0ee4fb00, State: Initialized, Role: FOLLOWER
I20250114 20:57:09.884390 7120 consensus_queue.cc:260] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b51bf3395440416ca129c58e0ee4fb00" member_type: VOTER }
I20250114 20:57:09.884761 7120 raft_consensus.cc:397] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:09.884943 7120 raft_consensus.cc:491] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:09.885149 7120 raft_consensus.cc:3054] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:09.888288 7120 raft_consensus.cc:513] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b51bf3395440416ca129c58e0ee4fb00" member_type: VOTER }
I20250114 20:57:09.888746 7120 leader_election.cc:304] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b51bf3395440416ca129c58e0ee4fb00; no voters:
I20250114 20:57:09.889760 7120 leader_election.cc:290] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:09.890101 7123 raft_consensus.cc:2798] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:09.891323 7123 raft_consensus.cc:695] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 1 LEADER]: Becoming Leader. State: Replica: b51bf3395440416ca129c58e0ee4fb00, State: Running, Role: LEADER
I20250114 20:57:09.891855 7123 consensus_queue.cc:237] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b51bf3395440416ca129c58e0ee4fb00" member_type: VOTER }
I20250114 20:57:09.892204 7120 sys_catalog.cc:564] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:09.894390 7124 sys_catalog.cc:455] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b51bf3395440416ca129c58e0ee4fb00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b51bf3395440416ca129c58e0ee4fb00" member_type: VOTER } }
I20250114 20:57:09.894343 7125 sys_catalog.cc:455] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b51bf3395440416ca129c58e0ee4fb00. Latest consensus state: current_term: 1 leader_uuid: "b51bf3395440416ca129c58e0ee4fb00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b51bf3395440416ca129c58e0ee4fb00" member_type: VOTER } }
I20250114 20:57:09.894912 7124 sys_catalog.cc:458] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:09.894996 7125 sys_catalog.cc:458] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:09.912950 7128 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:09.919353 7128 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:09.920290 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:09.927480 7128 catalog_manager.cc:1348] Generated new cluster ID: b4a96f02519946e38807f3916bf4f71a
I20250114 20:57:09.927695 7128 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:09.960371 7128 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:09.961321 7128 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:09.976038 7128 catalog_manager.cc:5899] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00: Generated new TSK 0
I20250114 20:57:09.976480 7128 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:09.985869 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:09.992683 7141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:09.993777 7142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:10.001874 7144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:10.002847 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:10.003544 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:10.003728 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:10.003903 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888230003887 us; error 0 us; skew 500 ppm
I20250114 20:57:10.004364 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:10.006772 6853 webserver.cc:458] Webserver started at http://127.6.177.65:37541/ using document root <none> and password file <none>
I20250114 20:57:10.007239 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:10.007457 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:10.007730 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:10.008735 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "f21924169b1542018c012204746c2793"
format_stamp: "Formatted at 2025-01-14 20:57:10 on dist-test-slave-26qh"
I20250114 20:57:10.012518 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20250114 20:57:10.015254 7149 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:10.015928 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:10.016206 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "f21924169b1542018c012204746c2793"
format_stamp: "Formatted at 2025-01-14 20:57:10 on dist-test-slave-26qh"
I20250114 20:57:10.016515 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMasterDown.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:10.037436 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:10.038571 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:10.059499 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:10.059808 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:10.060042 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:10.060215 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:10.120249 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:46837
I20250114 20:57:10.120285 7219 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:46837 every 8 connection(s)
I20250114 20:57:10.125021 7220 heartbeater.cc:346] Connected to a master server at 127.6.177.126:44977
I20250114 20:57:10.125383 7220 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:10.126186 7220 heartbeater.cc:510] Master 127.6.177.126:44977 requested a full tablet report, sending...
I20250114 20:57:10.127985 7075 ts_manager.cc:194] Registered new tserver with Master: f21924169b1542018c012204746c2793 (127.6.177.65:46837)
I20250114 20:57:10.128718 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004758938s
I20250114 20:57:10.129436 7075 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50676
I20250114 20:57:10.141593 7220 heartbeater.cc:502] Master 127.6.177.126:44977 was elected leader, sending a full tablet report...
I20250114 20:57:10.150295 7075 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50700:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:10.182026 7180 tablet_service.cc:1467] Processing CreateTablet for tablet 779963f2120f495387a2aab196afcf04 (DEFAULT_TABLE table=client-testtb [id=356e31ed97a0421c8a7f268e1c920200]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:10.181907 7181 tablet_service.cc:1467] Processing CreateTablet for tablet 5eae037f4dbd44b9bd3c1a5f5fda6ad2 (DEFAULT_TABLE table=client-testtb [id=356e31ed97a0421c8a7f268e1c920200]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:10.183063 7180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 779963f2120f495387a2aab196afcf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:10.183610 7181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eae037f4dbd44b9bd3c1a5f5fda6ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:10.198693 7230 tablet_bootstrap.cc:492] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793: Bootstrap starting.
I20250114 20:57:10.204267 7230 tablet_bootstrap.cc:654] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:10.208546 7230 tablet_bootstrap.cc:492] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793: No bootstrap required, opened a new log
I20250114 20:57:10.208923 7230 ts_tablet_manager.cc:1397] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20250114 20:57:10.211110 7230 raft_consensus.cc:357] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.211591 7230 raft_consensus.cc:383] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:10.211823 7230 raft_consensus.cc:738] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f21924169b1542018c012204746c2793, State: Initialized, Role: FOLLOWER
I20250114 20:57:10.212333 7230 consensus_queue.cc:260] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.213022 7230 raft_consensus.cc:397] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:10.213439 7230 raft_consensus.cc:491] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:10.214474 7230 raft_consensus.cc:3054] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:10.221743 7230 raft_consensus.cc:513] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.222337 7230 leader_election.cc:304] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f21924169b1542018c012204746c2793; no voters:
I20250114 20:57:10.223497 7230 leader_election.cc:290] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:10.223790 7232 raft_consensus.cc:2798] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:10.229154 7232 raft_consensus.cc:695] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 1 LEADER]: Becoming Leader. State: Replica: f21924169b1542018c012204746c2793, State: Running, Role: LEADER
I20250114 20:57:10.229566 7230 ts_tablet_manager.cc:1428] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793: Time spent starting tablet: real 0.020s user 0.012s sys 0.008s
I20250114 20:57:10.229853 7232 consensus_queue.cc:237] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.230403 7230 tablet_bootstrap.cc:492] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793: Bootstrap starting.
I20250114 20:57:10.236109 7230 tablet_bootstrap.cc:654] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:10.236292 7074 catalog_manager.cc:5526] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 reported cstate change: term changed from 0 to 1, leader changed from <none> to f21924169b1542018c012204746c2793 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "f21924169b1542018c012204746c2793" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:10.245684 7230 tablet_bootstrap.cc:492] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793: No bootstrap required, opened a new log
I20250114 20:57:10.246024 7230 ts_tablet_manager.cc:1397] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20250114 20:57:10.247884 7230 raft_consensus.cc:357] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.248299 7230 raft_consensus.cc:383] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:10.248620 7230 raft_consensus.cc:738] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f21924169b1542018c012204746c2793, State: Initialized, Role: FOLLOWER
I20250114 20:57:10.249197 7230 consensus_queue.cc:260] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.249877 7230 raft_consensus.cc:397] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:10.250192 7230 raft_consensus.cc:491] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:10.250463 7230 raft_consensus.cc:3054] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:10.254693 7230 raft_consensus.cc:513] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.255199 7230 leader_election.cc:304] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f21924169b1542018c012204746c2793; no voters:
I20250114 20:57:10.255627 7230 leader_election.cc:290] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:10.255883 7233 raft_consensus.cc:2798] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:10.256258 7233 raft_consensus.cc:695] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 1 LEADER]: Becoming Leader. State: Replica: f21924169b1542018c012204746c2793, State: Running, Role: LEADER
I20250114 20:57:10.256814 7233 consensus_queue.cc:237] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } }
I20250114 20:57:10.257130 7230 ts_tablet_manager.cc:1428] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20250114 20:57:10.262320 7074 catalog_manager.cc:5526] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 reported cstate change: term changed from 0 to 1, leader changed from <none> to f21924169b1542018c012204746c2793 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "f21924169b1542018c012204746c2793" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f21924169b1542018c012204746c2793" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46837 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:10.274515 6853 master.cc:537] Master@127.6.177.126:44977 shutting down...
W20250114 20:57:10.285879 7220 heartbeater.cc:643] Failed to heartbeat to 127.6.177.126:44977 (0 consecutive failures): Remote error: Failed to send heartbeat to master: Service unavailable: service kudu.master.MasterService not registered on Master
I20250114 20:57:10.292251 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:10.292683 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:10.293066 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P b51bf3395440416ca129c58e0ee4fb00: stopping tablet replica
W20250114 20:57:10.297391 7151 connection.cc:537] client connection to 127.6.177.126:44977 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250114 20:57:10.301972 6853 master.cc:559] Master@127.6.177.126:44977 shutdown complete.
W20250114 20:57:10.313403 7224 master_proxy_rpc.cc:203] Re-attempting GetTableSchema request to leader Master (127.6.177.126:44977)
I20250114 20:57:11.907483 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:11.922096 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:11.922570 6853 tablet_replica.cc:331] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793: stopping tablet replica
I20250114 20:57:11.923000 6853 raft_consensus.cc:2238] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:11.923372 6853 raft_consensus.cc:2267] T 5eae037f4dbd44b9bd3c1a5f5fda6ad2 P f21924169b1542018c012204746c2793 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:11.924587 6853 tablet_replica.cc:331] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793: stopping tablet replica
I20250114 20:57:11.925004 6853 raft_consensus.cc:2238] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:11.925324 6853 raft_consensus.cc:2267] T 779963f2120f495387a2aab196afcf04 P f21924169b1542018c012204746c2793 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:11.941471 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
[ OK ] ClientTest.TestMasterDown (2194 ms)
[ RUN ] ClientTest.TestScanEmptyTable
I20250114 20:57:11.957351 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:37727
I20250114 20:57:11.958215 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:11.963032 7240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:11.963814 7241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:11.964609 7243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:11.965598 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:11.966924 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:11.967188 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:11.967314 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888231967299 us; error 0 us; skew 500 ppm
I20250114 20:57:11.967777 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:11.969754 6853 webserver.cc:458] Webserver started at http://127.6.177.126:44717/ using document root <none> and password file <none>
I20250114 20:57:11.970122 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:11.970275 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:11.970479 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:11.971392 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "194fb2216ff541a2a2e9be3671aa67be"
format_stamp: "Formatted at 2025-01-14 20:57:11 on dist-test-slave-26qh"
I20250114 20:57:11.974900 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:57:11.977489 7248 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:11.978143 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:11.978379 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "194fb2216ff541a2a2e9be3671aa67be"
format_stamp: "Formatted at 2025-01-14 20:57:11 on dist-test-slave-26qh"
I20250114 20:57:11.978616 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:11.994455 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:11.995285 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:12.031881 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:37727
I20250114 20:57:12.031970 7309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:37727 every 8 connection(s)
I20250114 20:57:12.035041 7310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:12.043079 7310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be: Bootstrap starting.
I20250114 20:57:12.046308 7310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:12.049345 7310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be: No bootstrap required, opened a new log
I20250114 20:57:12.050818 7310 raft_consensus.cc:357] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194fb2216ff541a2a2e9be3671aa67be" member_type: VOTER }
I20250114 20:57:12.051152 7310 raft_consensus.cc:383] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:12.051342 7310 raft_consensus.cc:738] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 194fb2216ff541a2a2e9be3671aa67be, State: Initialized, Role: FOLLOWER
I20250114 20:57:12.051802 7310 consensus_queue.cc:260] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194fb2216ff541a2a2e9be3671aa67be" member_type: VOTER }
I20250114 20:57:12.052181 7310 raft_consensus.cc:397] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:12.052357 7310 raft_consensus.cc:491] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:12.052559 7310 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:12.055626 7310 raft_consensus.cc:513] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194fb2216ff541a2a2e9be3671aa67be" member_type: VOTER }
I20250114 20:57:12.056077 7310 leader_election.cc:304] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 194fb2216ff541a2a2e9be3671aa67be; no voters:
I20250114 20:57:12.056937 7310 leader_election.cc:290] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:12.057148 7313 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:12.058423 7313 raft_consensus.cc:695] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 1 LEADER]: Becoming Leader. State: Replica: 194fb2216ff541a2a2e9be3671aa67be, State: Running, Role: LEADER
I20250114 20:57:12.059034 7313 consensus_queue.cc:237] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194fb2216ff541a2a2e9be3671aa67be" member_type: VOTER }
I20250114 20:57:12.059545 7310 sys_catalog.cc:564] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:12.061443 7315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 194fb2216ff541a2a2e9be3671aa67be. Latest consensus state: current_term: 1 leader_uuid: "194fb2216ff541a2a2e9be3671aa67be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194fb2216ff541a2a2e9be3671aa67be" member_type: VOTER } }
I20250114 20:57:12.061401 7314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "194fb2216ff541a2a2e9be3671aa67be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "194fb2216ff541a2a2e9be3671aa67be" member_type: VOTER } }
I20250114 20:57:12.061977 7315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:12.062239 7314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:12.069000 7319 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:12.072820 7319 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:12.075409 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:12.079490 7319 catalog_manager.cc:1348] Generated new cluster ID: d95e8f5121a040718f1d9f13baeb322c
I20250114 20:57:12.079730 7319 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:12.097741 7319 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:12.098842 7319 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:12.121829 7319 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be: Generated new TSK 0
I20250114 20:57:12.122306 7319 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:12.140830 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:12.146108 7331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:12.146898 7332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:12.147822 7334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:12.148720 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:12.149315 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:12.149467 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:12.149569 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888232149559 us; error 0 us; skew 500 ppm
I20250114 20:57:12.149932 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:12.151863 6853 webserver.cc:458] Webserver started at http://127.6.177.65:33199/ using document root <none> and password file <none>
I20250114 20:57:12.152230 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:12.152360 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:12.152542 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:12.153354 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "cedab59e5b124dd696d13d9389399611"
format_stamp: "Formatted at 2025-01-14 20:57:12 on dist-test-slave-26qh"
I20250114 20:57:12.156744 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20250114 20:57:12.159432 7339 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:12.160029 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20250114 20:57:12.160243 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "cedab59e5b124dd696d13d9389399611"
format_stamp: "Formatted at 2025-01-14 20:57:12 on dist-test-slave-26qh"
I20250114 20:57:12.160526 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanEmptyTable.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:12.172462 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:12.173164 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:12.176827 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:12.177047 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:12.177294 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:12.177486 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:12.220641 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:33057
I20250114 20:57:12.220711 7409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:33057 every 8 connection(s)
I20250114 20:57:12.223989 7410 heartbeater.cc:346] Connected to a master server at 127.6.177.126:37727
I20250114 20:57:12.224229 7410 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:12.224768 7410 heartbeater.cc:510] Master 127.6.177.126:37727 requested a full tablet report, sending...
I20250114 20:57:12.226145 7265 ts_manager.cc:194] Registered new tserver with Master: cedab59e5b124dd696d13d9389399611 (127.6.177.65:33057)
I20250114 20:57:12.226706 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003530148s
I20250114 20:57:12.227640 7265 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41570
I20250114 20:57:12.239861 7410 heartbeater.cc:502] Master 127.6.177.126:37727 was elected leader, sending a full tablet report...
I20250114 20:57:12.243669 7265 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41586:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:12.268894 7375 tablet_service.cc:1467] Processing CreateTablet for tablet 47918b9297e94ccdab25fc159666d045 (DEFAULT_TABLE table=client-testtb [id=2d570c4a7f7f4050a378c9fd7b64c955]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:12.269654 7375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47918b9297e94ccdab25fc159666d045. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:12.271831 7374 tablet_service.cc:1467] Processing CreateTablet for tablet 0143c087c2de428098d0060ab997f711 (DEFAULT_TABLE table=client-testtb [id=2d570c4a7f7f4050a378c9fd7b64c955]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:12.272696 7374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0143c087c2de428098d0060ab997f711. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:12.280274 7420 tablet_bootstrap.cc:492] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611: Bootstrap starting.
I20250114 20:57:12.283676 7420 tablet_bootstrap.cc:654] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:12.286801 7420 tablet_bootstrap.cc:492] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611: No bootstrap required, opened a new log
I20250114 20:57:12.287102 7420 ts_tablet_manager.cc:1397] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20250114 20:57:12.288650 7420 raft_consensus.cc:357] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.289013 7420 raft_consensus.cc:383] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:12.289166 7420 raft_consensus.cc:738] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cedab59e5b124dd696d13d9389399611, State: Initialized, Role: FOLLOWER
I20250114 20:57:12.289525 7420 consensus_queue.cc:260] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.289876 7420 raft_consensus.cc:397] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:12.290035 7420 raft_consensus.cc:491] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:12.290205 7420 raft_consensus.cc:3054] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:12.294204 7420 raft_consensus.cc:513] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.294654 7420 leader_election.cc:304] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cedab59e5b124dd696d13d9389399611; no voters:
I20250114 20:57:12.295497 7420 leader_election.cc:290] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:12.295701 7422 raft_consensus.cc:2798] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:12.297153 7422 raft_consensus.cc:695] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 1 LEADER]: Becoming Leader. State: Replica: cedab59e5b124dd696d13d9389399611, State: Running, Role: LEADER
I20250114 20:57:12.297310 7420 ts_tablet_manager.cc:1428] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20250114 20:57:12.297667 7422 consensus_queue.cc:237] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.297936 7420 tablet_bootstrap.cc:492] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611: Bootstrap starting.
I20250114 20:57:12.302345 7420 tablet_bootstrap.cc:654] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:12.303068 7264 catalog_manager.cc:5526] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 reported cstate change: term changed from 0 to 1, leader changed from <none> to cedab59e5b124dd696d13d9389399611 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "cedab59e5b124dd696d13d9389399611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:12.305855 7420 tablet_bootstrap.cc:492] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611: No bootstrap required, opened a new log
I20250114 20:57:12.306111 7420 ts_tablet_manager.cc:1397] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20250114 20:57:12.307701 7420 raft_consensus.cc:357] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.308099 7420 raft_consensus.cc:383] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:12.308387 7420 raft_consensus.cc:738] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cedab59e5b124dd696d13d9389399611, State: Initialized, Role: FOLLOWER
I20250114 20:57:12.308979 7420 consensus_queue.cc:260] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.309432 7420 raft_consensus.cc:397] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:12.309684 7420 raft_consensus.cc:491] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:12.309958 7420 raft_consensus.cc:3054] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:12.314867 7420 raft_consensus.cc:513] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.315371 7420 leader_election.cc:304] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cedab59e5b124dd696d13d9389399611; no voters:
I20250114 20:57:12.315737 7420 leader_election.cc:290] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:12.315845 7422 raft_consensus.cc:2798] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:12.316227 7422 raft_consensus.cc:695] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 1 LEADER]: Becoming Leader. State: Replica: cedab59e5b124dd696d13d9389399611, State: Running, Role: LEADER
I20250114 20:57:12.316723 7422 consensus_queue.cc:237] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } }
I20250114 20:57:12.316902 7420 ts_tablet_manager.cc:1428] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20250114 20:57:12.320818 7264 catalog_manager.cc:5526] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 reported cstate change: term changed from 0 to 1, leader changed from <none> to cedab59e5b124dd696d13d9389399611 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "cedab59e5b124dd696d13d9389399611" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedab59e5b124dd696d13d9389399611" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33057 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:12.354614 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:12.373582 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:12.374485 6853 tablet_replica.cc:331] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611: stopping tablet replica
I20250114 20:57:12.375011 6853 raft_consensus.cc:2238] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:12.375451 6853 raft_consensus.cc:2267] T 0143c087c2de428098d0060ab997f711 P cedab59e5b124dd696d13d9389399611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:12.377707 6853 tablet_replica.cc:331] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611: stopping tablet replica
I20250114 20:57:12.378278 6853 raft_consensus.cc:2238] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:12.378712 6853 raft_consensus.cc:2267] T 47918b9297e94ccdab25fc159666d045 P cedab59e5b124dd696d13d9389399611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:12.388830 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:12.396378 6853 master.cc:537] Master@127.6.177.126:37727 shutting down...
I20250114 20:57:12.412168 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:12.412506 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:12.412819 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 194fb2216ff541a2a2e9be3671aa67be: stopping tablet replica
I20250114 20:57:12.427203 6853 master.cc:559] Master@127.6.177.126:37727 shutdown complete.
[ OK ] ClientTest.TestScanEmptyTable (487 ms)
[ RUN ] ClientTest.TestRowPtrNoRedaction
I20250114 20:57:12.444991 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:34945
I20250114 20:57:12.445819 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:12.451045 7431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:12.452041 7432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:12.452932 6853 server_base.cc:1034] running on GCE node
W20250114 20:57:12.453650 7434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:12.454279 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:12.454432 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:12.454569 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888232454558 us; error 0 us; skew 500 ppm
I20250114 20:57:12.454998 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:12.457461 6853 webserver.cc:458] Webserver started at http://127.6.177.126:37983/ using document root <none> and password file <none>
I20250114 20:57:12.457870 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:12.458034 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:12.458266 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:12.459283 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "650f91f3ba8e4576a6a73b7c7e12ffed"
format_stamp: "Formatted at 2025-01-14 20:57:12 on dist-test-slave-26qh"
I20250114 20:57:12.463038 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:57:12.465795 7439 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:12.466439 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:12.466722 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "650f91f3ba8e4576a6a73b7c7e12ffed"
format_stamp: "Formatted at 2025-01-14 20:57:12 on dist-test-slave-26qh"
I20250114 20:57:12.467018 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:12.488524 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:12.489588 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:12.532084 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:34945
I20250114 20:57:12.532250 7500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:34945 every 8 connection(s)
I20250114 20:57:12.535530 7501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:12.547264 7501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed: Bootstrap starting.
I20250114 20:57:12.552075 7501 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:12.555872 7501 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed: No bootstrap required, opened a new log
I20250114 20:57:12.557808 7501 raft_consensus.cc:357] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" member_type: VOTER }
I20250114 20:57:12.558303 7501 raft_consensus.cc:383] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:12.558566 7501 raft_consensus.cc:738] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 650f91f3ba8e4576a6a73b7c7e12ffed, State: Initialized, Role: FOLLOWER
I20250114 20:57:12.559194 7501 consensus_queue.cc:260] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" member_type: VOTER }
I20250114 20:57:12.559681 7501 raft_consensus.cc:397] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:12.559916 7501 raft_consensus.cc:491] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:12.560185 7501 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:12.565122 7501 raft_consensus.cc:513] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" member_type: VOTER }
I20250114 20:57:12.565649 7501 leader_election.cc:304] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 650f91f3ba8e4576a6a73b7c7e12ffed; no voters:
I20250114 20:57:12.566697 7501 leader_election.cc:290] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:12.566895 7504 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:12.568823 7504 raft_consensus.cc:695] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 1 LEADER]: Becoming Leader. State: Replica: 650f91f3ba8e4576a6a73b7c7e12ffed, State: Running, Role: LEADER
I20250114 20:57:12.569514 7504 consensus_queue.cc:237] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" member_type: VOTER }
I20250114 20:57:12.569686 7501 sys_catalog.cc:564] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:12.571714 7505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" member_type: VOTER } }
I20250114 20:57:12.572134 7505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:12.573506 7506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 650f91f3ba8e4576a6a73b7c7e12ffed. Latest consensus state: current_term: 1 leader_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650f91f3ba8e4576a6a73b7c7e12ffed" member_type: VOTER } }
I20250114 20:57:12.574039 7506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:12.577807 7509 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:12.581730 7509 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:12.590291 7509 catalog_manager.cc:1348] Generated new cluster ID: 81dcbb28da8a4c63bca058b5b1c4a5bf
I20250114 20:57:12.590533 7509 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:12.591058 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:12.611235 7509 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:12.612536 7509 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:12.624042 7509 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed: Generated new TSK 0
I20250114 20:57:12.624526 7509 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:12.656858 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:12.663662 7523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:12.664814 7524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:12.665968 7526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:12.666800 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:12.667644 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:12.667858 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:12.668004 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888232667987 us; error 0 us; skew 500 ppm
I20250114 20:57:12.668504 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:12.671074 6853 webserver.cc:458] Webserver started at http://127.6.177.65:40321/ using document root <none> and password file <none>
I20250114 20:57:12.671569 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:12.671749 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:12.671972 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:12.672904 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "c30c1ad49d1d421bb411249322adcede"
format_stamp: "Formatted at 2025-01-14 20:57:12 on dist-test-slave-26qh"
I20250114 20:57:12.676800 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:12.679697 7531 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:12.680385 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:57:12.680677 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "c30c1ad49d1d421bb411249322adcede"
format_stamp: "Formatted at 2025-01-14 20:57:12 on dist-test-slave-26qh"
I20250114 20:57:12.680991 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRowPtrNoRedaction.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:12.712025 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:12.712769 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:12.721153 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:12.721329 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:12.721530 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:12.721657 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:12.778055 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:44229
I20250114 20:57:12.778105 7601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:44229 every 8 connection(s)
I20250114 20:57:12.783486 7602 heartbeater.cc:346] Connected to a master server at 127.6.177.126:34945
I20250114 20:57:12.783748 7602 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:12.784303 7602 heartbeater.cc:510] Master 127.6.177.126:34945 requested a full tablet report, sending...
I20250114 20:57:12.785768 7456 ts_manager.cc:194] Registered new tserver with Master: c30c1ad49d1d421bb411249322adcede (127.6.177.65:44229)
I20250114 20:57:12.786151 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003735752s
I20250114 20:57:12.787242 7456 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57354
I20250114 20:57:12.799382 7602 heartbeater.cc:502] Master 127.6.177.126:34945 was elected leader, sending a full tablet report...
I20250114 20:57:12.806010 7456 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57362:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:12.840710 7567 tablet_service.cc:1467] Processing CreateTablet for tablet 3c40f849a6f745a6ba58fa38e6bfa595 (DEFAULT_TABLE table=client-testtb [id=2124c24d5af0480ab0ce59b57be643df]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:12.841145 7566 tablet_service.cc:1467] Processing CreateTablet for tablet 31151bee898141a2b04a7c68608e0cdf (DEFAULT_TABLE table=client-testtb [id=2124c24d5af0480ab0ce59b57be643df]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:12.841701 7567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c40f849a6f745a6ba58fa38e6bfa595. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:12.842145 7566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31151bee898141a2b04a7c68608e0cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:12.851415 7612 tablet_bootstrap.cc:492] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede: Bootstrap starting.
I20250114 20:57:12.856460 7612 tablet_bootstrap.cc:654] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:12.859872 7612 tablet_bootstrap.cc:492] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede: No bootstrap required, opened a new log
I20250114 20:57:12.860126 7612 ts_tablet_manager.cc:1397] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20250114 20:57:12.861704 7612 raft_consensus.cc:357] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.862121 7612 raft_consensus.cc:383] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:12.862316 7612 raft_consensus.cc:738] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c30c1ad49d1d421bb411249322adcede, State: Initialized, Role: FOLLOWER
I20250114 20:57:12.862699 7612 consensus_queue.cc:260] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.863109 7612 raft_consensus.cc:397] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:12.863305 7612 raft_consensus.cc:491] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:12.863516 7612 raft_consensus.cc:3054] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:12.867274 7612 raft_consensus.cc:513] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.867779 7612 leader_election.cc:304] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c30c1ad49d1d421bb411249322adcede; no voters:
I20250114 20:57:12.875021 7614 raft_consensus.cc:2798] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:12.875377 7612 leader_election.cc:290] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:12.876246 7614 raft_consensus.cc:695] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 1 LEADER]: Becoming Leader. State: Replica: c30c1ad49d1d421bb411249322adcede, State: Running, Role: LEADER
I20250114 20:57:12.877058 7614 consensus_queue.cc:237] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.878808 7612 ts_tablet_manager.cc:1428] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede: Time spent starting tablet: real 0.018s user 0.006s sys 0.012s
I20250114 20:57:12.879748 7612 tablet_bootstrap.cc:492] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede: Bootstrap starting.
I20250114 20:57:12.883818 7456 catalog_manager.cc:5526] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede reported cstate change: term changed from 0 to 1, leader changed from <none> to c30c1ad49d1d421bb411249322adcede (127.6.177.65). New cstate: current_term: 1 leader_uuid: "c30c1ad49d1d421bb411249322adcede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:12.885228 7612 tablet_bootstrap.cc:654] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:12.890391 7612 tablet_bootstrap.cc:492] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede: No bootstrap required, opened a new log
I20250114 20:57:12.890712 7612 ts_tablet_manager.cc:1397] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20250114 20:57:12.892504 7612 raft_consensus.cc:357] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.892831 7612 raft_consensus.cc:383] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:12.893018 7612 raft_consensus.cc:738] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c30c1ad49d1d421bb411249322adcede, State: Initialized, Role: FOLLOWER
I20250114 20:57:12.893500 7612 consensus_queue.cc:260] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.893935 7612 raft_consensus.cc:397] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:12.894186 7612 raft_consensus.cc:491] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:12.894470 7612 raft_consensus.cc:3054] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:12.898828 7612 raft_consensus.cc:513] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.899466 7612 leader_election.cc:304] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c30c1ad49d1d421bb411249322adcede; no voters:
I20250114 20:57:12.899873 7612 leader_election.cc:290] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:12.900002 7616 raft_consensus.cc:2798] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:12.900609 7616 raft_consensus.cc:695] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 1 LEADER]: Becoming Leader. State: Replica: c30c1ad49d1d421bb411249322adcede, State: Running, Role: LEADER
I20250114 20:57:12.901460 7612 ts_tablet_manager.cc:1428] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
I20250114 20:57:12.901213 7616 consensus_queue.cc:237] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } }
I20250114 20:57:12.905911 7455 catalog_manager.cc:5526] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede reported cstate change: term changed from 0 to 1, leader changed from <none> to c30c1ad49d1d421bb411249322adcede (127.6.177.65). New cstate: current_term: 1 leader_uuid: "c30c1ad49d1d421bb411249322adcede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c30c1ad49d1d421bb411249322adcede" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44229 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:13.367861 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:13.393335 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:13.394151 6853 tablet_replica.cc:331] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede: stopping tablet replica
I20250114 20:57:13.394824 6853 raft_consensus.cc:2238] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:13.395339 6853 raft_consensus.cc:2267] T 3c40f849a6f745a6ba58fa38e6bfa595 P c30c1ad49d1d421bb411249322adcede [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:13.397336 6853 tablet_replica.cc:331] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede: stopping tablet replica
I20250114 20:57:13.397821 6853 raft_consensus.cc:2238] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:13.398350 6853 raft_consensus.cc:2267] T 31151bee898141a2b04a7c68608e0cdf P c30c1ad49d1d421bb411249322adcede [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:13.410135 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:13.421711 6853 master.cc:537] Master@127.6.177.126:34945 shutting down...
I20250114 20:57:13.440009 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:13.440446 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:13.440737 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 650f91f3ba8e4576a6a73b7c7e12ffed: stopping tablet replica
I20250114 20:57:13.457875 6853 master.cc:559] Master@127.6.177.126:34945 shutdown complete.
[ OK ] ClientTest.TestRowPtrNoRedaction (1029 ms)
[ RUN ] ClientTest.TestExclusiveInclusiveDecimalRangeBounds
I20250114 20:57:13.474164 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:39225
I20250114 20:57:13.475009 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:13.480183 7624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:13.481279 7625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:13.482427 7627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:13.483664 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:13.484288 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:13.484493 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:13.484648 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888233484629 us; error 0 us; skew 500 ppm
I20250114 20:57:13.485116 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:13.487450 6853 webserver.cc:458] Webserver started at http://127.6.177.126:35617/ using document root <none> and password file <none>
I20250114 20:57:13.487855 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:13.488018 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:13.488252 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:13.489147 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "e156adeb759d4e6295d4ebe35e0d0f6c"
format_stamp: "Formatted at 2025-01-14 20:57:13 on dist-test-slave-26qh"
I20250114 20:57:13.492759 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:13.495424 7632 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:13.496057 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:13.496270 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "e156adeb759d4e6295d4ebe35e0d0f6c"
format_stamp: "Formatted at 2025-01-14 20:57:13 on dist-test-slave-26qh"
I20250114 20:57:13.496528 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:13.516655 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:13.517416 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:13.569994 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:39225
I20250114 20:57:13.570073 7693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:39225 every 8 connection(s)
I20250114 20:57:13.574087 7694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:13.582943 7694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c: Bootstrap starting.
I20250114 20:57:13.586730 7694 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:13.590803 7694 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c: No bootstrap required, opened a new log
I20250114 20:57:13.592641 7694 raft_consensus.cc:357] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" member_type: VOTER }
I20250114 20:57:13.592953 7694 raft_consensus.cc:383] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:13.593132 7694 raft_consensus.cc:738] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e156adeb759d4e6295d4ebe35e0d0f6c, State: Initialized, Role: FOLLOWER
I20250114 20:57:13.593593 7694 consensus_queue.cc:260] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" member_type: VOTER }
I20250114 20:57:13.593987 7694 raft_consensus.cc:397] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:13.594183 7694 raft_consensus.cc:491] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:13.594421 7694 raft_consensus.cc:3054] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:13.597998 7694 raft_consensus.cc:513] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" member_type: VOTER }
I20250114 20:57:13.598625 7694 leader_election.cc:304] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e156adeb759d4e6295d4ebe35e0d0f6c; no voters:
I20250114 20:57:13.599817 7694 leader_election.cc:290] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:13.600082 7697 raft_consensus.cc:2798] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:13.601586 7697 raft_consensus.cc:695] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 1 LEADER]: Becoming Leader. State: Replica: e156adeb759d4e6295d4ebe35e0d0f6c, State: Running, Role: LEADER
I20250114 20:57:13.602234 7697 consensus_queue.cc:237] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" member_type: VOTER }
I20250114 20:57:13.602841 7694 sys_catalog.cc:564] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:13.604861 7698 sys_catalog.cc:455] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" member_type: VOTER } }
I20250114 20:57:13.605007 7699 sys_catalog.cc:455] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e156adeb759d4e6295d4ebe35e0d0f6c. Latest consensus state: current_term: 1 leader_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e156adeb759d4e6295d4ebe35e0d0f6c" member_type: VOTER } }
I20250114 20:57:13.605367 7698 sys_catalog.cc:458] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:13.605506 7699 sys_catalog.cc:458] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:13.608481 7702 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:13.616240 7702 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:13.626844 7702 catalog_manager.cc:1348] Generated new cluster ID: 6a67f51e97c545dd86f865a2582d8e02
I20250114 20:57:13.627100 7702 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:13.629330 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:13.643584 7702 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:13.644568 7702 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:13.661087 7702 catalog_manager.cc:5899] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c: Generated new TSK 0
I20250114 20:57:13.661528 7702 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:13.695362 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:13.702138 7715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:13.703050 7716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:13.704358 7718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:13.705248 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:13.705873 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:13.706058 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:13.706193 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888233706177 us; error 0 us; skew 500 ppm
I20250114 20:57:13.706610 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:13.709198 6853 webserver.cc:458] Webserver started at http://127.6.177.65:45093/ using document root <none> and password file <none>
I20250114 20:57:13.709575 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:13.709731 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:13.709931 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:13.710820 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774"
format_stamp: "Formatted at 2025-01-14 20:57:13 on dist-test-slave-26qh"
I20250114 20:57:13.714568 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:57:13.717371 7723 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:13.718137 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:13.718377 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774"
format_stamp: "Formatted at 2025-01-14 20:57:13 on dist-test-slave-26qh"
I20250114 20:57:13.718616 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestExclusiveInclusiveDecimalRangeBounds.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:13.733537 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:13.734237 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:13.750440 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:13.750736 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:13.751062 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:13.751284 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:13.812657 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:34139
I20250114 20:57:13.812736 7793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:34139 every 8 connection(s)
I20250114 20:57:13.816624 7794 heartbeater.cc:346] Connected to a master server at 127.6.177.126:39225
I20250114 20:57:13.816931 7794 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:13.817507 7794 heartbeater.cc:510] Master 127.6.177.126:39225 requested a full tablet report, sending...
I20250114 20:57:13.819299 7649 ts_manager.cc:194] Registered new tserver with Master: e0ac9bb6f167412bb8e7eb12fd7bd774 (127.6.177.65:34139)
I20250114 20:57:13.820204 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004792625s
I20250114 20:57:13.820842 7649 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34828
I20250114 20:57:13.832698 7794 heartbeater.cc:502] Master 127.6.177.126:39225 was elected leader, sending a full tablet report...
I20250114 20:57:13.846242 7649 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34856:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:13.875458 7759 tablet_service.cc:1467] Processing CreateTablet for tablet 9e045c5e749e47978c132554e3c83d78 (DEFAULT_TABLE table=client-testtb [id=5555b1824757483b8ba100862a4ef9f9]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:13.875759 7758 tablet_service.cc:1467] Processing CreateTablet for tablet cf349ca9aff84a489d53c218e564b454 (DEFAULT_TABLE table=client-testtb [id=5555b1824757483b8ba100862a4ef9f9]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:13.876570 7759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e045c5e749e47978c132554e3c83d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:13.877317 7758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf349ca9aff84a489d53c218e564b454. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:13.890280 7804 tablet_bootstrap.cc:492] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774: Bootstrap starting.
I20250114 20:57:13.894956 7804 tablet_bootstrap.cc:654] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:13.899192 7804 tablet_bootstrap.cc:492] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774: No bootstrap required, opened a new log
I20250114 20:57:13.899542 7804 ts_tablet_manager.cc:1397] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.004s
I20250114 20:57:13.901456 7804 raft_consensus.cc:357] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.901906 7804 raft_consensus.cc:383] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:13.902136 7804 raft_consensus.cc:738] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ac9bb6f167412bb8e7eb12fd7bd774, State: Initialized, Role: FOLLOWER
I20250114 20:57:13.902647 7804 consensus_queue.cc:260] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.903254 7804 raft_consensus.cc:397] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:13.903524 7804 raft_consensus.cc:491] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:13.903811 7804 raft_consensus.cc:3054] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:13.909255 7804 raft_consensus.cc:513] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.909811 7804 leader_election.cc:304] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0ac9bb6f167412bb8e7eb12fd7bd774; no voters:
I20250114 20:57:13.911079 7804 leader_election.cc:290] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:13.911451 7806 raft_consensus.cc:2798] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:13.913460 7804 ts_tablet_manager.cc:1428] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774: Time spent starting tablet: real 0.014s user 0.012s sys 0.002s
I20250114 20:57:13.914162 7804 tablet_bootstrap.cc:492] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774: Bootstrap starting.
I20250114 20:57:13.914212 7806 raft_consensus.cc:695] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 LEADER]: Becoming Leader. State: Replica: e0ac9bb6f167412bb8e7eb12fd7bd774, State: Running, Role: LEADER
I20250114 20:57:13.914996 7806 consensus_queue.cc:237] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.919524 7804 tablet_bootstrap.cc:654] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:13.921022 7648 catalog_manager.cc:5526] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0ac9bb6f167412bb8e7eb12fd7bd774 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:13.929777 7804 tablet_bootstrap.cc:492] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774: No bootstrap required, opened a new log
I20250114 20:57:13.930114 7804 ts_tablet_manager.cc:1397] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.004s
I20250114 20:57:13.932229 7804 raft_consensus.cc:357] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.932683 7804 raft_consensus.cc:383] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:13.932920 7804 raft_consensus.cc:738] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ac9bb6f167412bb8e7eb12fd7bd774, State: Initialized, Role: FOLLOWER
I20250114 20:57:13.933411 7804 consensus_queue.cc:260] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.933929 7804 raft_consensus.cc:397] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:13.934166 7804 raft_consensus.cc:491] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:13.934443 7804 raft_consensus.cc:3054] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:13.940196 7804 raft_consensus.cc:513] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.940827 7804 leader_election.cc:304] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0ac9bb6f167412bb8e7eb12fd7bd774; no voters:
I20250114 20:57:13.941373 7804 leader_election.cc:290] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:13.941584 7808 raft_consensus.cc:2798] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:13.942153 7808 raft_consensus.cc:695] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 LEADER]: Becoming Leader. State: Replica: e0ac9bb6f167412bb8e7eb12fd7bd774, State: Running, Role: LEADER
I20250114 20:57:13.942652 7808 consensus_queue.cc:237] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.942852 7804 ts_tablet_manager.cc:1428] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20250114 20:57:13.947125 7648 catalog_manager.cc:5526] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0ac9bb6f167412bb8e7eb12fd7bd774 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:13.959342 7649 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34856:
name: "TestExclusiveInclusiveDecimalRangeBounds"
schema {
columns {
name: "key"
type: DECIMAL32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
precision: 9
scale: 2
}
immutable: false
}
columns {
name: "value"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\010\001\377\377\377\377\t\001c\000\000\000""\010\001\377\377\377\377\t\001c\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:13.973852 7759 tablet_service.cc:1467] Processing CreateTablet for tablet 7f5b7580265043d981b73f938af41ea8 (DEFAULT_TABLE table=TestExclusiveInclusiveDecimalRangeBounds [id=030e0dec09da4f99b7f0aa72ce5371a0]), partition=RANGE (key) PARTITION 0_D32 <= VALUES < 100_D32
I20250114 20:57:13.974598 7759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5b7580265043d981b73f938af41ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:13.985347 7804 tablet_bootstrap.cc:492] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774: Bootstrap starting.
I20250114 20:57:13.989374 7804 tablet_bootstrap.cc:654] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:13.993093 7804 tablet_bootstrap.cc:492] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774: No bootstrap required, opened a new log
I20250114 20:57:13.993376 7804 ts_tablet_manager.cc:1397] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20250114 20:57:13.995361 7804 raft_consensus.cc:357] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.995865 7804 raft_consensus.cc:383] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:13.996134 7804 raft_consensus.cc:738] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0ac9bb6f167412bb8e7eb12fd7bd774, State: Initialized, Role: FOLLOWER
I20250114 20:57:13.996675 7804 consensus_queue.cc:260] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:13.997228 7804 raft_consensus.cc:397] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:13.997498 7804 raft_consensus.cc:491] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:13.997826 7804 raft_consensus.cc:3054] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:14.001729 7804 raft_consensus.cc:513] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:14.002242 7804 leader_election.cc:304] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0ac9bb6f167412bb8e7eb12fd7bd774; no voters:
I20250114 20:57:14.002874 7804 leader_election.cc:290] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:14.003005 7808 raft_consensus.cc:2798] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:14.003489 7808 raft_consensus.cc:695] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 LEADER]: Becoming Leader. State: Replica: e0ac9bb6f167412bb8e7eb12fd7bd774, State: Running, Role: LEADER
I20250114 20:57:14.004678 7804 ts_tablet_manager.cc:1428] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20250114 20:57:14.004135 7808 consensus_queue.cc:237] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } }
I20250114 20:57:14.010568 7649 catalog_manager.cc:5526] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0ac9bb6f167412bb8e7eb12fd7bd774 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0ac9bb6f167412bb8e7eb12fd7bd774" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34139 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:14.021793 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:14.041846 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:14.042809 6853 tablet_replica.cc:331] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774: stopping tablet replica
I20250114 20:57:14.043449 6853 raft_consensus.cc:2238] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:14.043872 6853 raft_consensus.cc:2267] T cf349ca9aff84a489d53c218e564b454 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:14.046087 6853 tablet_replica.cc:331] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774: stopping tablet replica
I20250114 20:57:14.046720 6853 raft_consensus.cc:2238] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:14.047145 6853 raft_consensus.cc:2267] T 7f5b7580265043d981b73f938af41ea8 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:14.049330 6853 tablet_replica.cc:331] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774: stopping tablet replica
I20250114 20:57:14.049810 6853 raft_consensus.cc:2238] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:14.050190 6853 raft_consensus.cc:2267] T 9e045c5e749e47978c132554e3c83d78 P e0ac9bb6f167412bb8e7eb12fd7bd774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:14.061429 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:14.070147 6853 master.cc:537] Master@127.6.177.126:39225 shutting down...
I20250114 20:57:14.085040 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:14.085428 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:14.085765 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P e156adeb759d4e6295d4ebe35e0d0f6c: stopping tablet replica
I20250114 20:57:14.095028 6853 master.cc:559] Master@127.6.177.126:39225 shutdown complete.
[ OK ] ClientTest.TestExclusiveInclusiveDecimalRangeBounds (643 ms)
[ RUN ] ClientTest.TestMetaCacheWithKeysAndIds
I20250114 20:57:14.119381 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:33565
I20250114 20:57:14.120430 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:14.125926 7815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:14.126703 7816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:14.127629 6853 server_base.cc:1034] running on GCE node
W20250114 20:57:14.128357 7818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:14.129156 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:14.129393 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:14.129545 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888234129533 us; error 0 us; skew 500 ppm
I20250114 20:57:14.130136 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:14.132575 6853 webserver.cc:458] Webserver started at http://127.6.177.126:39471/ using document root <none> and password file <none>
I20250114 20:57:14.133076 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:14.133265 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:14.133536 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:14.134671 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "c9c9f2b103c34fff9e21896e8d511566"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.139917 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20250114 20:57:14.143476 7823 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:14.144145 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20250114 20:57:14.144418 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "c9c9f2b103c34fff9e21896e8d511566"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.144702 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:14.157039 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:14.158185 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:14.201611 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:33565
I20250114 20:57:14.201659 7884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:33565 every 8 connection(s)
I20250114 20:57:14.205636 7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:14.213969 7885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566: Bootstrap starting.
I20250114 20:57:14.217281 7885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:14.220597 7885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566: No bootstrap required, opened a new log
I20250114 20:57:14.222039 7885 raft_consensus.cc:357] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9c9f2b103c34fff9e21896e8d511566" member_type: VOTER }
I20250114 20:57:14.222353 7885 raft_consensus.cc:383] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:14.222563 7885 raft_consensus.cc:738] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9c9f2b103c34fff9e21896e8d511566, State: Initialized, Role: FOLLOWER
I20250114 20:57:14.223001 7885 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9c9f2b103c34fff9e21896e8d511566" member_type: VOTER }
I20250114 20:57:14.223469 7885 raft_consensus.cc:397] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:14.223661 7885 raft_consensus.cc:491] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:14.223875 7885 raft_consensus.cc:3054] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:14.227299 7885 raft_consensus.cc:513] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9c9f2b103c34fff9e21896e8d511566" member_type: VOTER }
I20250114 20:57:14.227741 7885 leader_election.cc:304] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9c9f2b103c34fff9e21896e8d511566; no voters:
I20250114 20:57:14.228933 7885 leader_election.cc:290] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:14.229189 7888 raft_consensus.cc:2798] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:14.230659 7888 raft_consensus.cc:695] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 1 LEADER]: Becoming Leader. State: Replica: c9c9f2b103c34fff9e21896e8d511566, State: Running, Role: LEADER
I20250114 20:57:14.231328 7888 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9c9f2b103c34fff9e21896e8d511566" member_type: VOTER }
I20250114 20:57:14.232049 7885 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:14.233834 7890 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9c9f2b103c34fff9e21896e8d511566. Latest consensus state: current_term: 1 leader_uuid: "c9c9f2b103c34fff9e21896e8d511566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9c9f2b103c34fff9e21896e8d511566" member_type: VOTER } }
I20250114 20:57:14.233891 7889 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9c9f2b103c34fff9e21896e8d511566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9c9f2b103c34fff9e21896e8d511566" member_type: VOTER } }
I20250114 20:57:14.234339 7890 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:14.234414 7889 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:14.242774 7893 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:14.249361 7893 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:14.252770 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:14.257539 7893 catalog_manager.cc:1348] Generated new cluster ID: 4f006021581343979252906dc8d30749
I20250114 20:57:14.257820 7893 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:14.277029 7893 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:14.278391 7893 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:14.293262 7893 catalog_manager.cc:5899] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566: Generated new TSK 0
I20250114 20:57:14.293764 7893 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:14.318395 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:14.324779 7906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:14.325331 7907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:14.326532 7909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:14.327534 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:14.328198 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:14.328374 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:14.328532 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888234328514 us; error 0 us; skew 500 ppm
I20250114 20:57:14.329005 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:14.331596 6853 webserver.cc:458] Webserver started at http://127.6.177.65:37743/ using document root <none> and password file <none>
I20250114 20:57:14.332026 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:14.332166 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:14.332365 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:14.333334 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "7146d93a979e4fb29211cfe484081362"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.337033 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20250114 20:57:14.339874 7914 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:14.340585 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:57:14.340858 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "7146d93a979e4fb29211cfe484081362"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.341176 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMetaCacheWithKeysAndIds.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:14.370886 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:14.372049 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:14.383250 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:14.383492 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:14.383769 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:14.383961 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:14.450978 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:35399
I20250114 20:57:14.451031 7984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:35399 every 8 connection(s)
I20250114 20:57:14.455822 7985 heartbeater.cc:346] Connected to a master server at 127.6.177.126:33565
I20250114 20:57:14.456177 7985 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:14.456887 7985 heartbeater.cc:510] Master 127.6.177.126:33565 requested a full tablet report, sending...
I20250114 20:57:14.458707 7840 ts_manager.cc:194] Registered new tserver with Master: 7146d93a979e4fb29211cfe484081362 (127.6.177.65:35399)
I20250114 20:57:14.459555 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004629217s
I20250114 20:57:14.460731 7840 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41366
I20250114 20:57:14.473011 7985 heartbeater.cc:502] Master 127.6.177.126:33565 was elected leader, sending a full tablet report...
I20250114 20:57:14.482558 7840 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41388:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:14.510457 7950 tablet_service.cc:1467] Processing CreateTablet for tablet 5868bc3b17e542a8a6b8d30d707c9b46 (DEFAULT_TABLE table=client-testtb [id=824a1d7844e6401994e712a84db9bf95]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:14.510687 7949 tablet_service.cc:1467] Processing CreateTablet for tablet e2f389b3fa704fa2b3ab228eaf4d8f79 (DEFAULT_TABLE table=client-testtb [id=824a1d7844e6401994e712a84db9bf95]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:14.511693 7950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5868bc3b17e542a8a6b8d30d707c9b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:14.512364 7949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f389b3fa704fa2b3ab228eaf4d8f79. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:14.524894 7995 tablet_bootstrap.cc:492] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362: Bootstrap starting.
I20250114 20:57:14.528616 7995 tablet_bootstrap.cc:654] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:14.532132 7995 tablet_bootstrap.cc:492] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362: No bootstrap required, opened a new log
I20250114 20:57:14.532387 7995 ts_tablet_manager.cc:1397] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20250114 20:57:14.533972 7995 raft_consensus.cc:357] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.534317 7995 raft_consensus.cc:383] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:14.534518 7995 raft_consensus.cc:738] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7146d93a979e4fb29211cfe484081362, State: Initialized, Role: FOLLOWER
I20250114 20:57:14.534960 7995 consensus_queue.cc:260] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.535404 7995 raft_consensus.cc:397] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:14.535641 7995 raft_consensus.cc:491] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:14.535952 7995 raft_consensus.cc:3054] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:14.539829 7995 raft_consensus.cc:513] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.540252 7995 leader_election.cc:304] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7146d93a979e4fb29211cfe484081362; no voters:
I20250114 20:57:14.541281 7995 leader_election.cc:290] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:14.541532 7997 raft_consensus.cc:2798] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:14.546779 7995 ts_tablet_manager.cc:1428] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20250114 20:57:14.547194 7997 raft_consensus.cc:695] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 1 LEADER]: Becoming Leader. State: Replica: 7146d93a979e4fb29211cfe484081362, State: Running, Role: LEADER
I20250114 20:57:14.547478 7995 tablet_bootstrap.cc:492] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362: Bootstrap starting.
I20250114 20:57:14.547816 7997 consensus_queue.cc:237] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.552546 7995 tablet_bootstrap.cc:654] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:14.553246 7840 catalog_manager.cc:5526] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7146d93a979e4fb29211cfe484081362 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "7146d93a979e4fb29211cfe484081362" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:14.566237 7995 tablet_bootstrap.cc:492] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362: No bootstrap required, opened a new log
I20250114 20:57:14.566618 7995 ts_tablet_manager.cc:1397] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20250114 20:57:14.568271 7995 raft_consensus.cc:357] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.568666 7995 raft_consensus.cc:383] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:14.568895 7995 raft_consensus.cc:738] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7146d93a979e4fb29211cfe484081362, State: Initialized, Role: FOLLOWER
I20250114 20:57:14.569384 7995 consensus_queue.cc:260] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.569782 7995 raft_consensus.cc:397] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:14.570022 7995 raft_consensus.cc:491] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:14.570286 7995 raft_consensus.cc:3054] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:14.574241 7995 raft_consensus.cc:513] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.574821 7995 leader_election.cc:304] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7146d93a979e4fb29211cfe484081362; no voters:
I20250114 20:57:14.575284 7995 leader_election.cc:290] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:14.575423 7999 raft_consensus.cc:2798] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:14.576004 7999 raft_consensus.cc:695] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 1 LEADER]: Becoming Leader. State: Replica: 7146d93a979e4fb29211cfe484081362, State: Running, Role: LEADER
I20250114 20:57:14.576578 7995 ts_tablet_manager.cc:1428] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362: Time spent starting tablet: real 0.010s user 0.008s sys 0.002s
I20250114 20:57:14.576573 7999 consensus_queue.cc:237] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } }
I20250114 20:57:14.582017 7840 catalog_manager.cc:5526] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7146d93a979e4fb29211cfe484081362 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "7146d93a979e4fb29211cfe484081362" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7146d93a979e4fb29211cfe484081362" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35399 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:14.608294 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:14.624405 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:14.625020 6853 tablet_replica.cc:331] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362: stopping tablet replica
I20250114 20:57:14.625459 6853 raft_consensus.cc:2238] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:14.625778 6853 raft_consensus.cc:2267] T e2f389b3fa704fa2b3ab228eaf4d8f79 P 7146d93a979e4fb29211cfe484081362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:14.627524 6853 tablet_replica.cc:331] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362: stopping tablet replica
I20250114 20:57:14.627919 6853 raft_consensus.cc:2238] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:14.628253 6853 raft_consensus.cc:2267] T 5868bc3b17e542a8a6b8d30d707c9b46 P 7146d93a979e4fb29211cfe484081362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:14.637010 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:14.646159 6853 master.cc:537] Master@127.6.177.126:33565 shutting down...
I20250114 20:57:14.661247 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:14.661576 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:14.661890 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P c9c9f2b103c34fff9e21896e8d511566: stopping tablet replica
I20250114 20:57:14.670300 6853 master.cc:559] Master@127.6.177.126:33565 shutdown complete.
[ OK ] ClientTest.TestMetaCacheWithKeysAndIds (568 ms)
[ RUN ] ClientTest.TestScanTimeout
I20250114 20:57:14.686854 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:34425
I20250114 20:57:14.687662 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:14.692804 8004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:14.693703 8005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:14.694694 6853 server_base.cc:1034] running on GCE node
W20250114 20:57:14.695472 8007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:14.696170 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:14.696396 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:14.696549 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888234696537 us; error 0 us; skew 500 ppm
I20250114 20:57:14.697067 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:14.699571 6853 webserver.cc:458] Webserver started at http://127.6.177.126:46299/ using document root <none> and password file <none>
I20250114 20:57:14.700263 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:14.700537 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:14.700788 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:14.701956 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "0467c18689104fbeac1c06b08b13ea04"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.707149 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20250114 20:57:14.710691 8012 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:14.711453 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:57:14.711755 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "0467c18689104fbeac1c06b08b13ea04"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.712059 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:14.728617 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:14.729676 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:14.777451 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:34425
I20250114 20:57:14.777495 8073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:34425 every 8 connection(s)
I20250114 20:57:14.781656 8074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:14.791031 8074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04: Bootstrap starting.
I20250114 20:57:14.796227 8074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:14.799878 8074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04: No bootstrap required, opened a new log
I20250114 20:57:14.801394 8074 raft_consensus.cc:357] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467c18689104fbeac1c06b08b13ea04" member_type: VOTER }
I20250114 20:57:14.801719 8074 raft_consensus.cc:383] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:14.801930 8074 raft_consensus.cc:738] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0467c18689104fbeac1c06b08b13ea04, State: Initialized, Role: FOLLOWER
I20250114 20:57:14.802412 8074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467c18689104fbeac1c06b08b13ea04" member_type: VOTER }
I20250114 20:57:14.802832 8074 raft_consensus.cc:397] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:14.803033 8074 raft_consensus.cc:491] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:14.803311 8074 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:14.806471 8074 raft_consensus.cc:513] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467c18689104fbeac1c06b08b13ea04" member_type: VOTER }
I20250114 20:57:14.806893 8074 leader_election.cc:304] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0467c18689104fbeac1c06b08b13ea04; no voters:
I20250114 20:57:14.808070 8074 leader_election.cc:290] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:14.808328 8077 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:14.809847 8077 raft_consensus.cc:695] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 1 LEADER]: Becoming Leader. State: Replica: 0467c18689104fbeac1c06b08b13ea04, State: Running, Role: LEADER
I20250114 20:57:14.810438 8077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467c18689104fbeac1c06b08b13ea04" member_type: VOTER }
I20250114 20:57:14.811196 8074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:14.812846 8078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0467c18689104fbeac1c06b08b13ea04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467c18689104fbeac1c06b08b13ea04" member_type: VOTER } }
I20250114 20:57:14.813315 8078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:14.813761 8079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0467c18689104fbeac1c06b08b13ea04. Latest consensus state: current_term: 1 leader_uuid: "0467c18689104fbeac1c06b08b13ea04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0467c18689104fbeac1c06b08b13ea04" member_type: VOTER } }
I20250114 20:57:14.814323 8079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:14.821504 8082 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:14.827754 8082 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:14.830842 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:14.836031 8082 catalog_manager.cc:1348] Generated new cluster ID: df6725222a3e4b6c9ebc430f19ff80c7
I20250114 20:57:14.836256 8082 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:14.850137 8082 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:14.851233 8082 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:14.861999 8082 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04: Generated new TSK 0
I20250114 20:57:14.862449 8082 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:14.896729 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:14.902871 8095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:14.903956 8096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:14.905982 8098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:14.906634 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:14.907398 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:14.907616 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:14.907810 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888234907794 us; error 0 us; skew 500 ppm
I20250114 20:57:14.908386 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:14.910784 6853 webserver.cc:458] Webserver started at http://127.6.177.65:43147/ using document root <none> and password file <none>
I20250114 20:57:14.911224 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:14.911396 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:14.911621 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:14.912573 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "56864ba5f1e042d6bc26a1652b0af461"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.916456 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20250114 20:57:14.919299 8103 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:14.919986 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:14.920200 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "56864ba5f1e042d6bc26a1652b0af461"
format_stamp: "Formatted at 2025-01-14 20:57:14 on dist-test-slave-26qh"
I20250114 20:57:14.920400 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:14.935144 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:14.935845 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:14.946434 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:14.946719 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:14.947008 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:14.947253 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20250114 20:57:15.006922 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:39953
I20250114 20:57:15.007050 8173 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:39953 every 8 connection(s)
I20250114 20:57:15.012240 8174 heartbeater.cc:346] Connected to a master server at 127.6.177.126:34425
I20250114 20:57:15.012640 8174 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:15.013448 8174 heartbeater.cc:510] Master 127.6.177.126:34425 requested a full tablet report, sending...
I20250114 20:57:15.015501 8029 ts_manager.cc:194] Registered new tserver with Master: 56864ba5f1e042d6bc26a1652b0af461 (127.6.177.65:39953)
I20250114 20:57:15.018177 8029 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59258
I20250114 20:57:15.019069 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00027143s
I20250114 20:57:15.030658 8174 heartbeater.cc:502] Master 127.6.177.126:34425 was elected leader, sending a full tablet report...
I20250114 20:57:15.037405 8029 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59266:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:15.070581 8138 tablet_service.cc:1467] Processing CreateTablet for tablet 050b2a88e46f48f3a8c203b118e3e7c7 (DEFAULT_TABLE table=client-testtb [id=1f041f44f5d1411e87be9b7bfad080ff]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:15.070629 8139 tablet_service.cc:1467] Processing CreateTablet for tablet b4f3db903fa248feb7990815de642f5a (DEFAULT_TABLE table=client-testtb [id=1f041f44f5d1411e87be9b7bfad080ff]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:15.071532 8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050b2a88e46f48f3a8c203b118e3e7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:15.072072 8139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f3db903fa248feb7990815de642f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:15.083182 8184 tablet_bootstrap.cc:492] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461: Bootstrap starting.
I20250114 20:57:15.088460 8184 tablet_bootstrap.cc:654] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:15.092499 8184 tablet_bootstrap.cc:492] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461: No bootstrap required, opened a new log
I20250114 20:57:15.092782 8184 ts_tablet_manager.cc:1397] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20250114 20:57:15.094247 8184 raft_consensus.cc:357] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.094590 8184 raft_consensus.cc:383] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:15.094787 8184 raft_consensus.cc:738] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56864ba5f1e042d6bc26a1652b0af461, State: Initialized, Role: FOLLOWER
I20250114 20:57:15.095232 8184 consensus_queue.cc:260] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.095643 8184 raft_consensus.cc:397] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:15.095836 8184 raft_consensus.cc:491] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:15.096071 8184 raft_consensus.cc:3054] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:15.100085 8184 raft_consensus.cc:513] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.100551 8184 leader_election.cc:304] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56864ba5f1e042d6bc26a1652b0af461; no voters:
I20250114 20:57:15.102085 8184 leader_election.cc:290] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:15.102595 8186 raft_consensus.cc:2798] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:15.104172 8184 ts_tablet_manager.cc:1428] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461: Time spent starting tablet: real 0.011s user 0.007s sys 0.005s
I20250114 20:57:15.104676 8184 tablet_bootstrap.cc:492] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461: Bootstrap starting.
I20250114 20:57:15.107839 8184 tablet_bootstrap.cc:654] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:15.108428 8186 raft_consensus.cc:695] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 1 LEADER]: Becoming Leader. State: Replica: 56864ba5f1e042d6bc26a1652b0af461, State: Running, Role: LEADER
I20250114 20:57:15.109126 8186 consensus_queue.cc:237] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.111825 8184 tablet_bootstrap.cc:492] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461: No bootstrap required, opened a new log
I20250114 20:57:15.112159 8184 ts_tablet_manager.cc:1397] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20250114 20:57:15.114238 8184 raft_consensus.cc:357] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.114702 8184 raft_consensus.cc:383] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:15.115023 8184 raft_consensus.cc:738] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56864ba5f1e042d6bc26a1652b0af461, State: Initialized, Role: FOLLOWER
I20250114 20:57:15.114614 8028 catalog_manager.cc:5526] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56864ba5f1e042d6bc26a1652b0af461 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "56864ba5f1e042d6bc26a1652b0af461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:15.115738 8184 consensus_queue.cc:260] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.116575 8184 raft_consensus.cc:397] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:15.116930 8184 raft_consensus.cc:491] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:15.117326 8184 raft_consensus.cc:3054] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:15.123317 8184 raft_consensus.cc:513] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.123911 8184 leader_election.cc:304] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56864ba5f1e042d6bc26a1652b0af461; no voters:
I20250114 20:57:15.124406 8184 leader_election.cc:290] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:15.125072 8188 raft_consensus.cc:2798] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:15.126039 8184 ts_tablet_manager.cc:1428] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20250114 20:57:15.125818 8188 raft_consensus.cc:695] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 1 LEADER]: Becoming Leader. State: Replica: 56864ba5f1e042d6bc26a1652b0af461, State: Running, Role: LEADER
I20250114 20:57:15.127480 8188 consensus_queue.cc:237] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } }
I20250114 20:57:15.131805 8028 catalog_manager.cc:5526] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56864ba5f1e042d6bc26a1652b0af461 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "56864ba5f1e042d6bc26a1652b0af461" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56864ba5f1e042d6bc26a1652b0af461" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39953 } health_report { overall_health: HEALTHY } } }
W20250114 20:57:15.150046 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:16.182341 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:17.239174 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:18.243821 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:19.250247 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:20.308138 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:21.372880 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:22.426288 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:23.249666 8070 debug-util.cc:398] Leaking SignalData structure 0x7b08000cacc0 after lost signal to thread 6856
W20250114 20:57:23.250306 8070 debug-util.cc:398] Leaking SignalData structure 0x7b08000d7460 after lost signal to thread 8073
W20250114 20:57:23.250869 8070 debug-util.cc:398] Leaking SignalData structure 0x7b080004bd40 after lost signal to thread 8173
W20250114 20:57:23.551015 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:24.622725 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:25.759006 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:26.801645 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:27.892160 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:29.034209 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:30.056172 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:31.115485 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:32.206552 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:33.335599 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:34.496551 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:35.694173 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:36.722709 8180 master_proxy_rpc.cc:203] Re-attempting LookupRpc request to leader Master (127.6.177.126:34425)
W20250114 20:57:37.890693 6853 scanner-internal.cc:458] Time spent opening tablet: real 22.741s user 0.007s sys 0.006s
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/client-test.cc:3236: Failure
Value of: s.IsTimedOut()
Actual: false
Expected: true
OK
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/client-test.cc:3237: Failure
Value of: scanner.data_->remote_
Actual: true
Expected: false
should not have located any tablet
I20250114 20:57:37.908921 6853 scanner-internal.cc:172] Scan of tablet b4f3db903fa248feb7990815de642f5a at 56864ba5f1e042d6bc26a1652b0af461 (127.6.177.65:39953) deadline exceeded after 0.000s
W20250114 20:57:38.563562 8070 debug-util.cc:398] Leaking SignalData structure 0x7b08000212c0 after lost signal to thread 6856
W20250114 20:57:38.564296 8070 debug-util.cc:398] Leaking SignalData structure 0x7b08000e8ca0 after lost signal to thread 8073
W20250114 20:57:38.564836 8070 debug-util.cc:398] Leaking SignalData structure 0x7b08000cad40 after lost signal to thread 8173
I20250114 20:57:38.843436 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:38.873890 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:38.874630 6853 tablet_replica.cc:331] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461: stopping tablet replica
I20250114 20:57:38.875281 6853 raft_consensus.cc:2238] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:38.875883 6853 raft_consensus.cc:2267] T b4f3db903fa248feb7990815de642f5a P 56864ba5f1e042d6bc26a1652b0af461 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:38.878201 6853 tablet_replica.cc:331] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461: stopping tablet replica
I20250114 20:57:38.878757 6853 raft_consensus.cc:2238] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:38.879349 6853 raft_consensus.cc:2267] T 050b2a88e46f48f3a8c203b118e3e7c7 P 56864ba5f1e042d6bc26a1652b0af461 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:38.900718 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:38.913023 6853 master.cc:537] Master@127.6.177.126:34425 shutting down...
I20250114 20:57:38.943883 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:38.944325 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:38.944679 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 0467c18689104fbeac1c06b08b13ea04: stopping tablet replica
I20250114 20:57:38.977051 6853 master.cc:559] Master@127.6.177.126:34425 shutdown complete.
I20250114 20:57:38.995739 6853 test_util.cc:181] -----------------------------------------------
I20250114 20:57:38.995890 6853 test_util.cc:182] Had failures, leaving test files at /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestScanTimeout.1736888227440588-6853-0
[ FAILED ] ClientTest.TestScanTimeout (24311 ms)
[ RUN ] ClientTest.TestWriteWhileRestarting
I20250114 20:57:38.998979 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:45801
I20250114 20:57:38.999979 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:39.005877 8206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.006759 8207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.007833 8209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:39.008523 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:39.011155 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:39.011339 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:39.011462 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888259011450 us; error 0 us; skew 500 ppm
I20250114 20:57:39.011854 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:39.019994 6853 webserver.cc:458] Webserver started at http://127.6.177.126:34085/ using document root <none> and password file <none>
I20250114 20:57:39.020431 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:39.020587 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:39.020859 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:39.021864 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "23a8001530194e92b8e7164364e7b44b"
format_stamp: "Formatted at 2025-01-14 20:57:39 on dist-test-slave-26qh"
I20250114 20:57:39.025655 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:39.028380 8214 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:39.029008 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20250114 20:57:39.029230 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "23a8001530194e92b8e7164364e7b44b"
format_stamp: "Formatted at 2025-01-14 20:57:39 on dist-test-slave-26qh"
I20250114 20:57:39.029438 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:39.048393 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:39.049335 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:39.106771 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:45801
I20250114 20:57:39.106876 8275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:45801 every 8 connection(s)
I20250114 20:57:39.110750 8276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:39.120059 8276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b: Bootstrap starting.
I20250114 20:57:39.124197 8276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:39.127708 8276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b: No bootstrap required, opened a new log
I20250114 20:57:39.129297 8276 raft_consensus.cc:357] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a8001530194e92b8e7164364e7b44b" member_type: VOTER }
I20250114 20:57:39.129730 8276 raft_consensus.cc:383] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:39.129932 8276 raft_consensus.cc:738] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23a8001530194e92b8e7164364e7b44b, State: Initialized, Role: FOLLOWER
I20250114 20:57:39.130457 8276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a8001530194e92b8e7164364e7b44b" member_type: VOTER }
I20250114 20:57:39.131002 8276 raft_consensus.cc:397] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:39.131304 8276 raft_consensus.cc:491] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:39.131608 8276 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:39.135375 8276 raft_consensus.cc:513] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a8001530194e92b8e7164364e7b44b" member_type: VOTER }
I20250114 20:57:39.135794 8276 leader_election.cc:304] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23a8001530194e92b8e7164364e7b44b; no voters:
I20250114 20:57:39.136758 8276 leader_election.cc:290] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:39.137121 8279 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:39.138461 8279 raft_consensus.cc:695] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 1 LEADER]: Becoming Leader. State: Replica: 23a8001530194e92b8e7164364e7b44b, State: Running, Role: LEADER
I20250114 20:57:39.139230 8279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a8001530194e92b8e7164364e7b44b" member_type: VOTER }
I20250114 20:57:39.139518 8276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:39.144241 8281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23a8001530194e92b8e7164364e7b44b. Latest consensus state: current_term: 1 leader_uuid: "23a8001530194e92b8e7164364e7b44b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a8001530194e92b8e7164364e7b44b" member_type: VOTER } }
I20250114 20:57:39.144778 8281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:39.146231 8280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23a8001530194e92b8e7164364e7b44b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a8001530194e92b8e7164364e7b44b" member_type: VOTER } }
I20250114 20:57:39.146787 8280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:39.148881 8286 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:39.154798 8286 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:39.165611 8286 catalog_manager.cc:1348] Generated new cluster ID: cb0c6e60cb09419a8fbd449aced18149
I20250114 20:57:39.165865 8286 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:39.167822 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:39.187307 8286 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:39.188673 8286 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:39.205448 8286 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b: Generated new TSK 0
I20250114 20:57:39.206039 8286 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:39.233625 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:39.241293 8297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.242229 8298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.243253 8300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:39.244176 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:39.244938 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:39.245118 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:39.245285 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888259245269 us; error 0 us; skew 500 ppm
I20250114 20:57:39.245725 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:39.248466 6853 webserver.cc:458] Webserver started at http://127.6.177.65:34323/ using document root <none> and password file <none>
I20250114 20:57:39.248876 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:39.249045 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:39.249269 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:39.250329 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "b7250be631884f68841025e323714dfe"
format_stamp: "Formatted at 2025-01-14 20:57:39 on dist-test-slave-26qh"
I20250114 20:57:39.254479 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250114 20:57:39.257792 8305 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:39.258581 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:39.258890 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "b7250be631884f68841025e323714dfe"
format_stamp: "Formatted at 2025-01-14 20:57:39 on dist-test-slave-26qh"
I20250114 20:57:39.259275 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:39.285341 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:39.286521 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:39.298134 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:39.298440 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:39.298749 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:39.298996 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:39.357300 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:38641
I20250114 20:57:39.357363 8375 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:38641 every 8 connection(s)
I20250114 20:57:39.362429 8376 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45801
I20250114 20:57:39.362775 8376 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:39.363523 8376 heartbeater.cc:510] Master 127.6.177.126:45801 requested a full tablet report, sending...
I20250114 20:57:39.365316 8231 ts_manager.cc:194] Registered new tserver with Master: b7250be631884f68841025e323714dfe (127.6.177.65:38641)
I20250114 20:57:39.366190 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004605181s
I20250114 20:57:39.367340 8231 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41624
I20250114 20:57:39.379648 8376 heartbeater.cc:502] Master 127.6.177.126:45801 was elected leader, sending a full tablet report...
I20250114 20:57:39.384784 8230 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41648:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:39.420117 8341 tablet_service.cc:1467] Processing CreateTablet for tablet df2ae8eaa7234f3da70257ca6c10b11a (DEFAULT_TABLE table=client-testtb [id=1a1194aec4ae4b96985740c2ed76e6c5]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:39.421351 8341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2ae8eaa7234f3da70257ca6c10b11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:39.421465 8340 tablet_service.cc:1467] Processing CreateTablet for tablet a92b41749d0743a4b895ddca619a2dc0 (DEFAULT_TABLE table=client-testtb [id=1a1194aec4ae4b96985740c2ed76e6c5]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:39.422204 8340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92b41749d0743a4b895ddca619a2dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:39.436493 8386 tablet_bootstrap.cc:492] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Bootstrap starting.
I20250114 20:57:39.442109 8386 tablet_bootstrap.cc:654] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:39.446269 8386 tablet_bootstrap.cc:492] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: No bootstrap required, opened a new log
I20250114 20:57:39.446614 8386 ts_tablet_manager.cc:1397] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20250114 20:57:39.448675 8386 raft_consensus.cc:357] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.449225 8386 raft_consensus.cc:383] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:39.449460 8386 raft_consensus.cc:738] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7250be631884f68841025e323714dfe, State: Initialized, Role: FOLLOWER
I20250114 20:57:39.450099 8386 consensus_queue.cc:260] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.450722 8386 raft_consensus.cc:397] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:39.451109 8386 raft_consensus.cc:491] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:39.451403 8386 raft_consensus.cc:3054] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:39.460683 8386 raft_consensus.cc:513] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.461407 8386 leader_election.cc:304] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7250be631884f68841025e323714dfe; no voters:
I20250114 20:57:39.462733 8386 leader_election.cc:290] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:39.463253 8388 raft_consensus.cc:2798] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:39.465332 8388 raft_consensus.cc:695] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 LEADER]: Becoming Leader. State: Replica: b7250be631884f68841025e323714dfe, State: Running, Role: LEADER
I20250114 20:57:39.465688 8386 ts_tablet_manager.cc:1428] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Time spent starting tablet: real 0.019s user 0.015s sys 0.001s
I20250114 20:57:39.465938 8388 consensus_queue.cc:237] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.466441 8386 tablet_bootstrap.cc:492] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Bootstrap starting.
I20250114 20:57:39.475044 8386 tablet_bootstrap.cc:654] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:39.476457 8230 catalog_manager.cc:5526] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe reported cstate change: term changed from 0 to 1, leader changed from <none> to b7250be631884f68841025e323714dfe (127.6.177.65). New cstate: current_term: 1 leader_uuid: "b7250be631884f68841025e323714dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:39.481133 8386 tablet_bootstrap.cc:492] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: No bootstrap required, opened a new log
I20250114 20:57:39.481487 8386 ts_tablet_manager.cc:1397] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.003s
I20250114 20:57:39.484977 8386 raft_consensus.cc:357] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.485488 8386 raft_consensus.cc:383] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:39.485687 8386 raft_consensus.cc:738] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7250be631884f68841025e323714dfe, State: Initialized, Role: FOLLOWER
I20250114 20:57:39.486133 8386 consensus_queue.cc:260] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.486558 8386 raft_consensus.cc:397] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:39.486773 8386 raft_consensus.cc:491] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:39.487001 8386 raft_consensus.cc:3054] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:39.496459 8386 raft_consensus.cc:513] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.497025 8386 leader_election.cc:304] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7250be631884f68841025e323714dfe; no voters:
I20250114 20:57:39.497553 8386 leader_election.cc:290] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:39.497650 8388 raft_consensus.cc:2798] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:39.498046 8388 raft_consensus.cc:695] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 LEADER]: Becoming Leader. State: Replica: b7250be631884f68841025e323714dfe, State: Running, Role: LEADER
I20250114 20:57:39.498668 8388 consensus_queue.cc:237] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.499233 8386 ts_tablet_manager.cc:1428] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Time spent starting tablet: real 0.018s user 0.014s sys 0.000s
I20250114 20:57:39.503225 8230 catalog_manager.cc:5526] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe reported cstate change: term changed from 0 to 1, leader changed from <none> to b7250be631884f68841025e323714dfe (127.6.177.65). New cstate: current_term: 1 leader_uuid: "b7250be631884f68841025e323714dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:39.526271 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:39.547163 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:39.547982 6853 tablet_replica.cc:331] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: stopping tablet replica
I20250114 20:57:39.548465 6853 raft_consensus.cc:2238] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:39.548794 6853 raft_consensus.cc:2267] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:39.550652 6853 tablet_replica.cc:331] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: stopping tablet replica
I20250114 20:57:39.551249 6853 raft_consensus.cc:2238] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:39.551558 6853 raft_consensus.cc:2267] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Raft consensus is shut down!
W20250114 20:57:39.557737 8380 meta_cache.cc:302] tablet df2ae8eaa7234f3da70257ca6c10b11a: replica b7250be631884f68841025e323714dfe (127.6.177.65:38641) has failed: Network error: recv got EOF from unknown peer (error 108)
I20250114 20:57:39.571502 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:39.581593 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:39.587049 8397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.588517 8398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.593673 8401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:39.594576 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:39.595587 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:39.595826 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:39.595989 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888259595977 us; error 0 us; skew 500 ppm
I20250114 20:57:39.596633 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:39.599419 6853 webserver.cc:458] Webserver started at http://127.6.177.65:34323/ using document root <none> and password file <none>
I20250114 20:57:39.599989 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:39.600212 6853 fs_manager.cc:365] Using existing metadata directory in first data directory
I20250114 20:57:39.604478 6853 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20250114 20:57:39.607553 8405 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:39.608218 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20250114 20:57:39.608510 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "b7250be631884f68841025e323714dfe"
format_stamp: "Formatted at 2025-01-14 20:57:39 on dist-test-slave-26qh"
I20250114 20:57:39.608820 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestWriteWhileRestarting.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:39.649721 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:39.650765 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:39.656625 8414 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20250114 20:57:39.673162 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (2 total tablets, 2 live tablets)
I20250114 20:57:39.673450 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.018s user 0.002s sys 0.000s
I20250114 20:57:39.673735 6853 ts_tablet_manager.cc:594] Registering tablets (0/2 complete)
I20250114 20:57:39.679601 8414 tablet_bootstrap.cc:492] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Bootstrap starting.
I20250114 20:57:39.684049 6853 ts_tablet_manager.cc:610] Registered 2 tablets
I20250114 20:57:39.684286 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.011s user 0.010s sys 0.000s
I20250114 20:57:39.701926 8414 tablet_bootstrap.cc:492] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250114 20:57:39.702888 8414 tablet_bootstrap.cc:492] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Bootstrap complete.
I20250114 20:57:39.703491 8414 ts_tablet_manager.cc:1397] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.008s
I20250114 20:57:39.705538 8414 raft_consensus.cc:357] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.706046 8414 raft_consensus.cc:738] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7250be631884f68841025e323714dfe, State: Initialized, Role: FOLLOWER
I20250114 20:57:39.706815 8414 consensus_queue.cc:260] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.707461 8414 raft_consensus.cc:397] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:39.708669 8414 raft_consensus.cc:491] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:39.709458 8414 raft_consensus.cc:3054] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Advancing to term 2
I20250114 20:57:39.717274 8414 raft_consensus.cc:513] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.718032 8414 leader_election.cc:304] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7250be631884f68841025e323714dfe; no voters:
I20250114 20:57:39.719583 8414 leader_election.cc:290] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 2 election: Requested vote from peers
I20250114 20:57:39.719810 8444 raft_consensus.cc:2798] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 2 FOLLOWER]: Leader election won for term 2
I20250114 20:57:39.727530 8444 raft_consensus.cc:695] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 2 LEADER]: Becoming Leader. State: Replica: b7250be631884f68841025e323714dfe, State: Running, Role: LEADER
I20250114 20:57:39.728193 8444 consensus_queue.cc:237] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.733470 8414 ts_tablet_manager.cc:1428] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe: Time spent starting tablet: real 0.030s user 0.019s sys 0.008s
I20250114 20:57:39.734426 8414 tablet_bootstrap.cc:492] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Bootstrap starting.
I20250114 20:57:39.754316 8414 tablet_bootstrap.cc:492] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250114 20:57:39.755375 8414 tablet_bootstrap.cc:492] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Bootstrap complete.
I20250114 20:57:39.756091 8414 ts_tablet_manager.cc:1397] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Time spent bootstrapping tablet: real 0.022s user 0.017s sys 0.003s
I20250114 20:57:39.758936 8414 raft_consensus.cc:357] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.759614 8414 raft_consensus.cc:738] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7250be631884f68841025e323714dfe, State: Initialized, Role: FOLLOWER
I20250114 20:57:39.760413 8414 consensus_queue.cc:260] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.761190 8414 raft_consensus.cc:397] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:39.761497 8414 raft_consensus.cc:491] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:39.761843 8414 raft_consensus.cc:3054] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 1 FOLLOWER]: Advancing to term 2
I20250114 20:57:39.770340 8414 raft_consensus.cc:513] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.771241 8414 leader_election.cc:304] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7250be631884f68841025e323714dfe; no voters:
I20250114 20:57:39.771847 8414 leader_election.cc:290] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [CANDIDATE]: Term 2 election: Requested vote from peers
I20250114 20:57:39.771932 8446 raft_consensus.cc:2798] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 2 FOLLOWER]: Leader election won for term 2
I20250114 20:57:39.772432 8446 raft_consensus.cc:695] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 2 LEADER]: Becoming Leader. State: Replica: b7250be631884f68841025e323714dfe, State: Running, Role: LEADER
I20250114 20:57:39.772958 8446 consensus_queue.cc:237] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } }
I20250114 20:57:39.773833 8414 ts_tablet_manager.cc:1428] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20250114 20:57:39.792668 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:38641
I20250114 20:57:39.792757 8483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:38641 every 8 connection(s)
I20250114 20:57:39.796880 8484 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45801
I20250114 20:57:39.797133 8484 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:39.797691 8484 heartbeater.cc:510] Master 127.6.177.126:45801 requested a full tablet report, sending...
I20250114 20:57:39.800243 8230 ts_manager.cc:194] Re-registered known tserver with Master: b7250be631884f68841025e323714dfe (127.6.177.65:38641)
I20250114 20:57:39.801514 8230 catalog_manager.cc:5526] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b7250be631884f68841025e323714dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:39.802225 8230 catalog_manager.cc:5526] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b7250be631884f68841025e323714dfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7250be631884f68841025e323714dfe" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38641 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:39.810014 8230 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41654
I20250114 20:57:39.812371 8484 heartbeater.cc:502] Master 127.6.177.126:45801 was elected leader, sending a full tablet report...
I20250114 20:57:39.824400 6853 tablet_server.cc:178] TabletServer@127.6.177.65:38641 shutting down...
I20250114 20:57:39.848953 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:39.849646 6853 tablet_replica.cc:331] stopping tablet replica
I20250114 20:57:39.850158 6853 raft_consensus.cc:2238] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 2 LEADER]: Raft consensus shutting down.
I20250114 20:57:39.850602 6853 raft_consensus.cc:2267] T df2ae8eaa7234f3da70257ca6c10b11a P b7250be631884f68841025e323714dfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:39.852524 6853 tablet_replica.cc:331] stopping tablet replica
I20250114 20:57:39.852905 6853 raft_consensus.cc:2238] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 2 LEADER]: Raft consensus shutting down.
I20250114 20:57:39.853224 6853 raft_consensus.cc:2267] T a92b41749d0743a4b895ddca619a2dc0 P b7250be631884f68841025e323714dfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:39.863862 6853 tablet_server.cc:195] TabletServer@127.6.177.65:38641 shutdown complete.
I20250114 20:57:39.872758 6853 master.cc:537] Master@127.6.177.126:45801 shutting down...
I20250114 20:57:39.890336 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:39.890754 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:39.891017 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 23a8001530194e92b8e7164364e7b44b: stopping tablet replica
I20250114 20:57:39.908113 6853 master.cc:559] Master@127.6.177.126:45801 shutdown complete.
[ OK ] ClientTest.TestWriteWhileRestarting (929 ms)
[ RUN ] ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete
I20250114 20:57:39.928265 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:44637
I20250114 20:57:39.929044 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:39.934309 8488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.935480 8489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:39.937608 8491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:39.938416 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:39.939405 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:39.939584 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:39.939713 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888259939700 us; error 0 us; skew 500 ppm
I20250114 20:57:39.940168 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:39.942749 6853 webserver.cc:458] Webserver started at http://127.6.177.126:46529/ using document root <none> and password file <none>
I20250114 20:57:39.943169 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:39.943336 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:39.943581 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:39.944517 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "9b3e1db1863c43edbedd94f8f92e170e"
format_stamp: "Formatted at 2025-01-14 20:57:39 on dist-test-slave-26qh"
I20250114 20:57:39.948676 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250114 20:57:39.951772 8496 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:39.952533 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20250114 20:57:39.952823 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "9b3e1db1863c43edbedd94f8f92e170e"
format_stamp: "Formatted at 2025-01-14 20:57:39 on dist-test-slave-26qh"
I20250114 20:57:39.953162 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:39.965915 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:39.967170 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:40.020207 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:44637
I20250114 20:57:40.020259 8557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:44637 every 8 connection(s)
I20250114 20:57:40.024206 8558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:40.032548 8558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e: Bootstrap starting.
I20250114 20:57:40.035763 8558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:40.039239 8558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e: No bootstrap required, opened a new log
I20250114 20:57:40.040930 8558 raft_consensus.cc:357] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b3e1db1863c43edbedd94f8f92e170e" member_type: VOTER }
I20250114 20:57:40.041308 8558 raft_consensus.cc:383] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:40.041481 8558 raft_consensus.cc:738] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b3e1db1863c43edbedd94f8f92e170e, State: Initialized, Role: FOLLOWER
I20250114 20:57:40.041884 8558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b3e1db1863c43edbedd94f8f92e170e" member_type: VOTER }
I20250114 20:57:40.042243 8558 raft_consensus.cc:397] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:40.042426 8558 raft_consensus.cc:491] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:40.042627 8558 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:40.045806 8558 raft_consensus.cc:513] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b3e1db1863c43edbedd94f8f92e170e" member_type: VOTER }
I20250114 20:57:40.046197 8558 leader_election.cc:304] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b3e1db1863c43edbedd94f8f92e170e; no voters:
I20250114 20:57:40.047044 8558 leader_election.cc:290] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:40.047276 8561 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:40.048404 8561 raft_consensus.cc:695] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 1 LEADER]: Becoming Leader. State: Replica: 9b3e1db1863c43edbedd94f8f92e170e, State: Running, Role: LEADER
I20250114 20:57:40.048897 8561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b3e1db1863c43edbedd94f8f92e170e" member_type: VOTER }
I20250114 20:57:40.049396 8558 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:40.051570 8563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b3e1db1863c43edbedd94f8f92e170e. Latest consensus state: current_term: 1 leader_uuid: "9b3e1db1863c43edbedd94f8f92e170e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b3e1db1863c43edbedd94f8f92e170e" member_type: VOTER } }
I20250114 20:57:40.052018 8563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:40.052781 8562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b3e1db1863c43edbedd94f8f92e170e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b3e1db1863c43edbedd94f8f92e170e" member_type: VOTER } }
I20250114 20:57:40.053471 8562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:40.055974 8566 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:40.059962 8566 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:40.064291 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:40.066742 8566 catalog_manager.cc:1348] Generated new cluster ID: d7b193fd23654464b24dd92ee7f1b6c1
I20250114 20:57:40.066967 8566 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:40.084928 8566 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:40.086352 8566 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:40.096508 8566 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e: Generated new TSK 0
I20250114 20:57:40.096904 8566 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:40.129678 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:40.135321 8579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:40.136019 8580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:40.136797 8582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:40.138296 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:40.139250 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:40.139488 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:40.139612 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888260139601 us; error 0 us; skew 500 ppm
I20250114 20:57:40.140017 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:40.141959 6853 webserver.cc:458] Webserver started at http://127.6.177.65:34997/ using document root <none> and password file <none>
I20250114 20:57:40.142414 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:40.142566 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:40.142765 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:40.143653 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "86d7a0b20b3a4e9486905cec545883f0"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.147090 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:57:40.149607 8587 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:40.150353 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:40.150621 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "86d7a0b20b3a4e9486905cec545883f0"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.150914 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:40.165961 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:40.166684 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:40.170403 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:40.170657 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:40.170913 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:40.171187 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20250114 20:57:40.212002 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:42145
I20250114 20:57:40.212101 8657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:42145 every 8 connection(s)
I20250114 20:57:40.215520 8658 heartbeater.cc:346] Connected to a master server at 127.6.177.126:44637
I20250114 20:57:40.215835 8658 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:40.216404 8658 heartbeater.cc:510] Master 127.6.177.126:44637 requested a full tablet report, sending...
I20250114 20:57:40.217953 8513 ts_manager.cc:194] Registered new tserver with Master: 86d7a0b20b3a4e9486905cec545883f0 (127.6.177.65:42145)
I20250114 20:57:40.218173 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003555535s
I20250114 20:57:40.219555 8513 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57178
I20250114 20:57:40.231987 8658 heartbeater.cc:502] Master 127.6.177.126:44637 was elected leader, sending a full tablet report...
I20250114 20:57:40.236475 8512 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57192:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:40.263833 8623 tablet_service.cc:1467] Processing CreateTablet for tablet 331e9fed5e274e388d17834e8db5b34e (DEFAULT_TABLE table=client-testtb [id=46cab98b2939449e910cf70f12e10215]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:40.264007 8622 tablet_service.cc:1467] Processing CreateTablet for tablet 5fdfd07c323841c2a032d4402b349879 (DEFAULT_TABLE table=client-testtb [id=46cab98b2939449e910cf70f12e10215]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:40.264927 8623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331e9fed5e274e388d17834e8db5b34e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:40.265393 8622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fdfd07c323841c2a032d4402b349879. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:40.276327 8668 tablet_bootstrap.cc:492] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0: Bootstrap starting.
I20250114 20:57:40.279667 8668 tablet_bootstrap.cc:654] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:40.283109 8668 tablet_bootstrap.cc:492] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0: No bootstrap required, opened a new log
I20250114 20:57:40.283416 8668 ts_tablet_manager.cc:1397] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20250114 20:57:40.284900 8668 raft_consensus.cc:357] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.285224 8668 raft_consensus.cc:383] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:40.285410 8668 raft_consensus.cc:738] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d7a0b20b3a4e9486905cec545883f0, State: Initialized, Role: FOLLOWER
I20250114 20:57:40.285816 8668 consensus_queue.cc:260] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.286202 8668 raft_consensus.cc:397] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:40.286383 8668 raft_consensus.cc:491] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:40.286588 8668 raft_consensus.cc:3054] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:40.290601 8668 raft_consensus.cc:513] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.291095 8668 leader_election.cc:304] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86d7a0b20b3a4e9486905cec545883f0; no voters:
I20250114 20:57:40.292083 8668 leader_election.cc:290] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:40.292338 8670 raft_consensus.cc:2798] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:40.293716 8670 raft_consensus.cc:695] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 1 LEADER]: Becoming Leader. State: Replica: 86d7a0b20b3a4e9486905cec545883f0, State: Running, Role: LEADER
I20250114 20:57:40.293895 8668 ts_tablet_manager.cc:1428] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20250114 20:57:40.294152 8670 consensus_queue.cc:237] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.294417 8668 tablet_bootstrap.cc:492] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0: Bootstrap starting.
I20250114 20:57:40.298943 8668 tablet_bootstrap.cc:654] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:40.298832 8513 catalog_manager.cc:5526] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86d7a0b20b3a4e9486905cec545883f0 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "86d7a0b20b3a4e9486905cec545883f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:40.302789 8668 tablet_bootstrap.cc:492] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0: No bootstrap required, opened a new log
I20250114 20:57:40.303128 8668 ts_tablet_manager.cc:1397] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20250114 20:57:40.304665 8668 raft_consensus.cc:357] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.304972 8668 raft_consensus.cc:383] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:40.305158 8668 raft_consensus.cc:738] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86d7a0b20b3a4e9486905cec545883f0, State: Initialized, Role: FOLLOWER
I20250114 20:57:40.305608 8668 consensus_queue.cc:260] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.306121 8668 raft_consensus.cc:397] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:40.306382 8668 raft_consensus.cc:491] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:40.306663 8668 raft_consensus.cc:3054] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:40.310482 8668 raft_consensus.cc:513] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.311060 8668 leader_election.cc:304] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86d7a0b20b3a4e9486905cec545883f0; no voters:
I20250114 20:57:40.311558 8668 leader_election.cc:290] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:40.311674 8670 raft_consensus.cc:2798] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:40.312062 8670 raft_consensus.cc:695] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 1 LEADER]: Becoming Leader. State: Replica: 86d7a0b20b3a4e9486905cec545883f0, State: Running, Role: LEADER
I20250114 20:57:40.312599 8670 consensus_queue.cc:237] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } }
I20250114 20:57:40.313606 8668 ts_tablet_manager.cc:1428] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0: Time spent starting tablet: real 0.010s user 0.005s sys 0.004s
I20250114 20:57:40.316926 8513 catalog_manager.cc:5526] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86d7a0b20b3a4e9486905cec545883f0 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "86d7a0b20b3a4e9486905cec545883f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86d7a0b20b3a4e9486905cec545883f0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42145 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:40.383311 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:40.397146 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:40.397641 6853 tablet_replica.cc:331] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0: stopping tablet replica
I20250114 20:57:40.398075 6853 raft_consensus.cc:2238] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:40.398411 6853 raft_consensus.cc:2267] T 5fdfd07c323841c2a032d4402b349879 P 86d7a0b20b3a4e9486905cec545883f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:40.400120 6853 tablet_replica.cc:331] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0: stopping tablet replica
I20250114 20:57:40.400521 6853 raft_consensus.cc:2238] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:40.400862 6853 raft_consensus.cc:2267] T 331e9fed5e274e388d17834e8db5b34e P 86d7a0b20b3a4e9486905cec545883f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:40.421092 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:40.431357 6853 master.cc:537] Master@127.6.177.126:44637 shutting down...
I20250114 20:57:40.444563 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:40.444886 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:40.445216 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 9b3e1db1863c43edbedd94f8f92e170e: stopping tablet replica
I20250114 20:57:40.452831 6853 master.cc:559] Master@127.6.177.126:44637 shutdown complete.
[ OK ] ClientTest.TestBatchWithPartialErrorOfNonKeyColumnSpecifiedDelete (541 ms)
[ RUN ] ClientTest.TestCheckMutationBufferSpaceLimitInEffect
I20250114 20:57:40.469416 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:42277
I20250114 20:57:40.470186 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:40.474728 8679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:40.475669 8680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:40.476478 8682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:40.477262 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:40.477749 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:40.477891 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:40.478014 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888260478005 us; error 0 us; skew 500 ppm
I20250114 20:57:40.478420 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:40.480397 6853 webserver.cc:458] Webserver started at http://127.6.177.126:33761/ using document root <none> and password file <none>
I20250114 20:57:40.480767 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:40.480904 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:40.481091 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:40.481951 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "939654e4b0e44e9ca8699e6d16e14bd0"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.485644 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:40.488219 8687 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:40.488799 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:57:40.489051 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "939654e4b0e44e9ca8699e6d16e14bd0"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.489293 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:40.515245 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:40.516095 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:40.551595 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:42277
I20250114 20:57:40.551674 8748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:42277 every 8 connection(s)
I20250114 20:57:40.554750 8749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:40.564147 8749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0: Bootstrap starting.
I20250114 20:57:40.567466 8749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:40.570832 8749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0: No bootstrap required, opened a new log
I20250114 20:57:40.572396 8749 raft_consensus.cc:357] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" member_type: VOTER }
I20250114 20:57:40.572698 8749 raft_consensus.cc:383] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:40.572878 8749 raft_consensus.cc:738] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 939654e4b0e44e9ca8699e6d16e14bd0, State: Initialized, Role: FOLLOWER
I20250114 20:57:40.573554 8749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" member_type: VOTER }
I20250114 20:57:40.574000 8749 raft_consensus.cc:397] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:40.574232 8749 raft_consensus.cc:491] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:40.574481 8749 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:40.578128 8749 raft_consensus.cc:513] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" member_type: VOTER }
I20250114 20:57:40.578568 8749 leader_election.cc:304] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 939654e4b0e44e9ca8699e6d16e14bd0; no voters:
I20250114 20:57:40.579553 8749 leader_election.cc:290] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:40.579797 8752 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:40.581074 8752 raft_consensus.cc:695] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 1 LEADER]: Becoming Leader. State: Replica: 939654e4b0e44e9ca8699e6d16e14bd0, State: Running, Role: LEADER
I20250114 20:57:40.581607 8752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" member_type: VOTER }
I20250114 20:57:40.582089 8749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:40.584125 8754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 939654e4b0e44e9ca8699e6d16e14bd0. Latest consensus state: current_term: 1 leader_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" member_type: VOTER } }
I20250114 20:57:40.584097 8753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939654e4b0e44e9ca8699e6d16e14bd0" member_type: VOTER } }
I20250114 20:57:40.584676 8754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:40.584960 8753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:40.596515 8757 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:40.597322 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:40.600930 8757 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:40.607438 8757 catalog_manager.cc:1348] Generated new cluster ID: fb93daa22b5f4a05b0669d63f4cf9162
I20250114 20:57:40.607617 8757 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:40.619092 8757 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:40.620116 8757 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:40.637845 8757 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0: Generated new TSK 0
I20250114 20:57:40.638345 8757 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:40.662889 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:40.668830 8770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:40.669620 8771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:40.670691 6853 server_base.cc:1034] running on GCE node
W20250114 20:57:40.671469 8773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:40.672153 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:40.672327 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:40.672453 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888260672439 us; error 0 us; skew 500 ppm
I20250114 20:57:40.672837 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:40.674748 6853 webserver.cc:458] Webserver started at http://127.6.177.65:43575/ using document root <none> and password file <none>
I20250114 20:57:40.675179 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:40.675344 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:40.675566 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:40.676503 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "7c410de8dc784196a677a384581c1f3b"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.680277 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20250114 20:57:40.683014 8778 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:40.683768 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:40.683997 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "7c410de8dc784196a677a384581c1f3b"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.684203 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCheckMutationBufferSpaceLimitInEffect.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:40.702280 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:40.703104 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:40.706938 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:40.707221 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20250114 20:57:40.707480 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:40.707669 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:40.749887 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:43521
I20250114 20:57:40.749974 8848 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:43521 every 8 connection(s)
I20250114 20:57:40.753863 8849 heartbeater.cc:346] Connected to a master server at 127.6.177.126:42277
I20250114 20:57:40.754125 8849 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:40.754616 8849 heartbeater.cc:510] Master 127.6.177.126:42277 requested a full tablet report, sending...
I20250114 20:57:40.756070 8704 ts_manager.cc:194] Registered new tserver with Master: 7c410de8dc784196a677a384581c1f3b (127.6.177.65:43521)
I20250114 20:57:40.756301 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003524918s
I20250114 20:57:40.757514 8704 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35294
I20250114 20:57:40.769793 8849 heartbeater.cc:502] Master 127.6.177.126:42277 was elected leader, sending a full tablet report...
I20250114 20:57:40.773854 8704 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35304:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:40.799909 8814 tablet_service.cc:1467] Processing CreateTablet for tablet 37b8f6eb3b0a44d9b3a849d7e4a72207 (DEFAULT_TABLE table=client-testtb [id=e557e617029b4862b31396eb59f0c826]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:40.800197 8813 tablet_service.cc:1467] Processing CreateTablet for tablet b3bc29d321364aabbf080130c5a64a50 (DEFAULT_TABLE table=client-testtb [id=e557e617029b4862b31396eb59f0c826]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:40.801100 8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37b8f6eb3b0a44d9b3a849d7e4a72207. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:40.801672 8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bc29d321364aabbf080130c5a64a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:40.814940 8859 tablet_bootstrap.cc:492] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b: Bootstrap starting.
I20250114 20:57:40.818511 8859 tablet_bootstrap.cc:654] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:40.822001 8859 tablet_bootstrap.cc:492] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b: No bootstrap required, opened a new log
I20250114 20:57:40.822256 8859 ts_tablet_manager.cc:1397] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20250114 20:57:40.824031 8859 raft_consensus.cc:357] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.824368 8859 raft_consensus.cc:383] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:40.824548 8859 raft_consensus.cc:738] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c410de8dc784196a677a384581c1f3b, State: Initialized, Role: FOLLOWER
I20250114 20:57:40.824939 8859 consensus_queue.cc:260] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.825317 8859 raft_consensus.cc:397] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:40.825492 8859 raft_consensus.cc:491] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:40.825690 8859 raft_consensus.cc:3054] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:40.829198 8859 raft_consensus.cc:513] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.829658 8859 leader_election.cc:304] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c410de8dc784196a677a384581c1f3b; no voters:
I20250114 20:57:40.830623 8859 leader_election.cc:290] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:40.830883 8861 raft_consensus.cc:2798] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:40.832774 8859 ts_tablet_manager.cc:1428] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b: Time spent starting tablet: real 0.010s user 0.006s sys 0.005s
I20250114 20:57:40.833508 8859 tablet_bootstrap.cc:492] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b: Bootstrap starting.
I20250114 20:57:40.833653 8861 raft_consensus.cc:695] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 1 LEADER]: Becoming Leader. State: Replica: 7c410de8dc784196a677a384581c1f3b, State: Running, Role: LEADER
I20250114 20:57:40.834219 8861 consensus_queue.cc:237] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.837368 8859 tablet_bootstrap.cc:654] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:40.839836 8704 catalog_manager.cc:5526] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c410de8dc784196a677a384581c1f3b (127.6.177.65). New cstate: current_term: 1 leader_uuid: "7c410de8dc784196a677a384581c1f3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:40.841753 8859 tablet_bootstrap.cc:492] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b: No bootstrap required, opened a new log
I20250114 20:57:40.842027 8859 ts_tablet_manager.cc:1397] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20250114 20:57:40.843689 8859 raft_consensus.cc:357] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.845098 8859 raft_consensus.cc:383] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:40.845362 8859 raft_consensus.cc:738] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c410de8dc784196a677a384581c1f3b, State: Initialized, Role: FOLLOWER
I20250114 20:57:40.845860 8859 consensus_queue.cc:260] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.846230 8859 raft_consensus.cc:397] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:40.846486 8859 raft_consensus.cc:491] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:40.846768 8859 raft_consensus.cc:3054] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:40.851933 8859 raft_consensus.cc:513] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.852319 8859 leader_election.cc:304] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c410de8dc784196a677a384581c1f3b; no voters:
I20250114 20:57:40.852665 8859 leader_election.cc:290] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:40.852766 8861 raft_consensus.cc:2798] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:40.853297 8861 raft_consensus.cc:695] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 1 LEADER]: Becoming Leader. State: Replica: 7c410de8dc784196a677a384581c1f3b, State: Running, Role: LEADER
I20250114 20:57:40.853765 8859 ts_tablet_manager.cc:1428] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b: Time spent starting tablet: real 0.012s user 0.003s sys 0.007s
I20250114 20:57:40.853775 8861 consensus_queue.cc:237] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } }
I20250114 20:57:40.857702 8704 catalog_manager.cc:5526] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c410de8dc784196a677a384581c1f3b (127.6.177.65). New cstate: current_term: 1 leader_uuid: "7c410de8dc784196a677a384581c1f3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c410de8dc784196a677a384581c1f3b" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43521 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:40.881305 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:40.893319 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:40.893831 6853 tablet_replica.cc:331] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b: stopping tablet replica
I20250114 20:57:40.894261 6853 raft_consensus.cc:2238] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:40.894562 6853 raft_consensus.cc:2267] T 37b8f6eb3b0a44d9b3a849d7e4a72207 P 7c410de8dc784196a677a384581c1f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:40.896116 6853 tablet_replica.cc:331] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b: stopping tablet replica
I20250114 20:57:40.896473 6853 raft_consensus.cc:2238] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:40.896764 6853 raft_consensus.cc:2267] T b3bc29d321364aabbf080130c5a64a50 P 7c410de8dc784196a677a384581c1f3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:40.914126 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:40.922000 6853 master.cc:537] Master@127.6.177.126:42277 shutting down...
I20250114 20:57:40.934718 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:40.935045 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:40.935410 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 939654e4b0e44e9ca8699e6d16e14bd0: stopping tablet replica
I20250114 20:57:40.952376 6853 master.cc:559] Master@127.6.177.126:42277 shutdown complete.
[ OK ] ClientTest.TestCheckMutationBufferSpaceLimitInEffect (499 ms)
[ RUN ] ClientTest.TestAutoFlushBackgroundSmallOps
I20250114 20:57:40.969058 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:35425
I20250114 20:57:40.969930 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:40.974665 8868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:40.975514 8869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:40.976399 8871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:40.977038 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:40.977572 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:40.977721 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:40.977839 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888260977826 us; error 0 us; skew 500 ppm
I20250114 20:57:40.978322 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:40.980461 6853 webserver.cc:458] Webserver started at http://127.6.177.126:35169/ using document root <none> and password file <none>
I20250114 20:57:40.980867 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:40.981034 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:40.981284 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:40.982131 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "06f97210ecb444d69613b913fd214ce3"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.985678 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:40.988209 8876 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:40.988844 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:57:40.989058 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "06f97210ecb444d69613b913fd214ce3"
format_stamp: "Formatted at 2025-01-14 20:57:40 on dist-test-slave-26qh"
I20250114 20:57:40.989269 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:41.010385 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:41.011219 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:41.045802 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:35425
I20250114 20:57:41.045874 8937 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:35425 every 8 connection(s)
I20250114 20:57:41.048746 8938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:41.057166 8938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3: Bootstrap starting.
I20250114 20:57:41.060550 8938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:41.063603 8938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3: No bootstrap required, opened a new log
I20250114 20:57:41.065008 8938 raft_consensus.cc:357] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f97210ecb444d69613b913fd214ce3" member_type: VOTER }
I20250114 20:57:41.065307 8938 raft_consensus.cc:383] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:41.065490 8938 raft_consensus.cc:738] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f97210ecb444d69613b913fd214ce3, State: Initialized, Role: FOLLOWER
I20250114 20:57:41.065913 8938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f97210ecb444d69613b913fd214ce3" member_type: VOTER }
I20250114 20:57:41.066265 8938 raft_consensus.cc:397] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:41.066447 8938 raft_consensus.cc:491] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:41.066671 8938 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:41.070418 8938 raft_consensus.cc:513] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f97210ecb444d69613b913fd214ce3" member_type: VOTER }
I20250114 20:57:41.070860 8938 leader_election.cc:304] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06f97210ecb444d69613b913fd214ce3; no voters:
I20250114 20:57:41.071825 8938 leader_election.cc:290] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:41.072053 8941 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:41.073148 8941 raft_consensus.cc:695] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 1 LEADER]: Becoming Leader. State: Replica: 06f97210ecb444d69613b913fd214ce3, State: Running, Role: LEADER
I20250114 20:57:41.073673 8941 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f97210ecb444d69613b913fd214ce3" member_type: VOTER }
I20250114 20:57:41.074172 8938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:41.076058 8942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06f97210ecb444d69613b913fd214ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f97210ecb444d69613b913fd214ce3" member_type: VOTER } }
I20250114 20:57:41.076098 8943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06f97210ecb444d69613b913fd214ce3. Latest consensus state: current_term: 1 leader_uuid: "06f97210ecb444d69613b913fd214ce3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06f97210ecb444d69613b913fd214ce3" member_type: VOTER } }
I20250114 20:57:41.076674 8942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:41.076697 8943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:41.078696 8947 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:41.082772 8947 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:41.089808 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:41.090893 8947 catalog_manager.cc:1348] Generated new cluster ID: 53e0d977d327430aa97507569ef08978
I20250114 20:57:41.091203 8947 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:41.113380 8947 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:41.114280 8947 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:41.133478 8947 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3: Generated new TSK 0
I20250114 20:57:41.133934 8947 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:41.155495 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:41.161072 8959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:41.161914 8960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:41.162810 8962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:41.163627 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:41.164214 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:41.164371 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:41.164489 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888261164475 us; error 0 us; skew 500 ppm
I20250114 20:57:41.164880 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:41.166805 6853 webserver.cc:458] Webserver started at http://127.6.177.65:39125/ using document root <none> and password file <none>
I20250114 20:57:41.167227 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:41.167397 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:41.167613 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:41.168591 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "ee6affbe444e4815b59bf04cf9dc58bf"
format_stamp: "Formatted at 2025-01-14 20:57:41 on dist-test-slave-26qh"
I20250114 20:57:41.172561 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20250114 20:57:41.175750 8967 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:41.176419 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20250114 20:57:41.176630 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "ee6affbe444e4815b59bf04cf9dc58bf"
format_stamp: "Formatted at 2025-01-14 20:57:41 on dist-test-slave-26qh"
I20250114 20:57:41.176847 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestAutoFlushBackgroundSmallOps.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:41.203549 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:41.204371 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:41.208499 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:41.208669 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:41.208915 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:41.209115 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:41.253573 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:40215
I20250114 20:57:41.253647 9037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:40215 every 8 connection(s)
I20250114 20:57:41.257187 9038 heartbeater.cc:346] Connected to a master server at 127.6.177.126:35425
I20250114 20:57:41.257447 9038 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:41.258033 9038 heartbeater.cc:510] Master 127.6.177.126:35425 requested a full tablet report, sending...
I20250114 20:57:41.259644 8893 ts_manager.cc:194] Registered new tserver with Master: ee6affbe444e4815b59bf04cf9dc58bf (127.6.177.65:40215)
I20250114 20:57:41.259831 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003569991s
I20250114 20:57:41.261417 8893 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43422
I20250114 20:57:41.273775 9038 heartbeater.cc:502] Master 127.6.177.126:35425 was elected leader, sending a full tablet report...
I20250114 20:57:41.277700 8893 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43444:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:41.303633 9003 tablet_service.cc:1467] Processing CreateTablet for tablet 7867e6279bb84ebca1f36ba31ddb5f36 (DEFAULT_TABLE table=client-testtb [id=a62e75b7d40844aeaf88bcb2b985b4ac]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:41.303997 9002 tablet_service.cc:1467] Processing CreateTablet for tablet b02da418ebb8418a8524af98c7381af0 (DEFAULT_TABLE table=client-testtb [id=a62e75b7d40844aeaf88bcb2b985b4ac]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:41.304555 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7867e6279bb84ebca1f36ba31ddb5f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:41.304982 9002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02da418ebb8418a8524af98c7381af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:41.315991 9048 tablet_bootstrap.cc:492] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf: Bootstrap starting.
I20250114 20:57:41.319460 9048 tablet_bootstrap.cc:654] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:41.322831 9048 tablet_bootstrap.cc:492] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf: No bootstrap required, opened a new log
I20250114 20:57:41.323112 9048 ts_tablet_manager.cc:1397] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20250114 20:57:41.324707 9048 raft_consensus.cc:357] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.325066 9048 raft_consensus.cc:383] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:41.325299 9048 raft_consensus.cc:738] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6affbe444e4815b59bf04cf9dc58bf, State: Initialized, Role: FOLLOWER
I20250114 20:57:41.325800 9048 consensus_queue.cc:260] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.326344 9048 raft_consensus.cc:397] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:41.326610 9048 raft_consensus.cc:491] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:41.326849 9048 raft_consensus.cc:3054] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:41.331164 9048 raft_consensus.cc:513] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.331610 9048 leader_election.cc:304] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6affbe444e4815b59bf04cf9dc58bf; no voters:
I20250114 20:57:41.332494 9048 leader_election.cc:290] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:41.332713 9050 raft_consensus.cc:2798] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:41.333806 9050 raft_consensus.cc:695] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 LEADER]: Becoming Leader. State: Replica: ee6affbe444e4815b59bf04cf9dc58bf, State: Running, Role: LEADER
I20250114 20:57:41.334429 9048 ts_tablet_manager.cc:1428] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20250114 20:57:41.334319 9050 consensus_queue.cc:237] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.335005 9048 tablet_bootstrap.cc:492] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf: Bootstrap starting.
I20250114 20:57:41.339479 8893 catalog_manager.cc:5526] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6affbe444e4815b59bf04cf9dc58bf (127.6.177.65). New cstate: current_term: 1 leader_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:41.341131 9048 tablet_bootstrap.cc:654] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:41.345598 9048 tablet_bootstrap.cc:492] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf: No bootstrap required, opened a new log
I20250114 20:57:41.345863 9048 ts_tablet_manager.cc:1397] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20250114 20:57:41.347591 9048 raft_consensus.cc:357] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.347985 9048 raft_consensus.cc:383] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:41.348227 9048 raft_consensus.cc:738] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6affbe444e4815b59bf04cf9dc58bf, State: Initialized, Role: FOLLOWER
I20250114 20:57:41.348758 9048 consensus_queue.cc:260] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.349303 9048 raft_consensus.cc:397] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:41.349560 9048 raft_consensus.cc:491] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:41.349846 9048 raft_consensus.cc:3054] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:41.353958 9048 raft_consensus.cc:513] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.354360 9048 leader_election.cc:304] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6affbe444e4815b59bf04cf9dc58bf; no voters:
I20250114 20:57:41.354717 9048 leader_election.cc:290] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:41.354815 9050 raft_consensus.cc:2798] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:41.355181 9050 raft_consensus.cc:695] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 LEADER]: Becoming Leader. State: Replica: ee6affbe444e4815b59bf04cf9dc58bf, State: Running, Role: LEADER
I20250114 20:57:41.355723 9050 consensus_queue.cc:237] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } }
I20250114 20:57:41.355918 9048 ts_tablet_manager.cc:1428] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20250114 20:57:41.359722 8893 catalog_manager.cc:5526] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf reported cstate change: term changed from 0 to 1, leader changed from <none> to ee6affbe444e4815b59bf04cf9dc58bf (127.6.177.65). New cstate: current_term: 1 leader_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6affbe444e4815b59bf04cf9dc58bf" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 40215 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:46.067155 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:46.087744 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:46.088249 6853 tablet_replica.cc:331] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf: stopping tablet replica
I20250114 20:57:46.088683 6853 raft_consensus.cc:2238] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:46.089097 6853 raft_consensus.cc:2267] T b02da418ebb8418a8524af98c7381af0 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:46.105904 6853 tablet_replica.cc:331] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf: stopping tablet replica
I20250114 20:57:46.106420 6853 raft_consensus.cc:2238] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:46.106856 6853 raft_consensus.cc:2267] T 7867e6279bb84ebca1f36ba31ddb5f36 P ee6affbe444e4815b59bf04cf9dc58bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:46.125603 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:46.135469 6853 master.cc:537] Master@127.6.177.126:35425 shutting down...
I20250114 20:57:46.153270 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:46.153820 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:46.154152 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 06f97210ecb444d69613b913fd214ce3: stopping tablet replica
I20250114 20:57:46.169948 6853 master.cc:559] Master@127.6.177.126:35425 shutdown complete.
[ OK ] ClientTest.TestAutoFlushBackgroundSmallOps (5219 ms)
[ RUN ] ClientTest.TestMutateNonexistentRow
I20250114 20:57:46.189860 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:38833
I20250114 20:57:46.190719 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:46.195811 9062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.196635 9063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.197431 9065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:46.198300 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:46.198930 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:46.199182 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:46.199303 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888266199292 us; error 0 us; skew 500 ppm
I20250114 20:57:46.199748 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:46.205749 6853 webserver.cc:458] Webserver started at http://127.6.177.126:41605/ using document root <none> and password file <none>
I20250114 20:57:46.206115 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:46.206247 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:46.206506 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:46.207468 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "e931bb7ccde943e48b453c81119181a5"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.211198 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:57:46.213716 9070 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:46.214282 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:46.214521 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "e931bb7ccde943e48b453c81119181a5"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.214745 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:46.227854 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:46.228549 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:46.263120 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:38833
I20250114 20:57:46.263202 9131 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:38833 every 8 connection(s)
I20250114 20:57:46.266111 9132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:46.274672 9132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5: Bootstrap starting.
I20250114 20:57:46.277822 9132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:46.280851 9132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5: No bootstrap required, opened a new log
I20250114 20:57:46.282374 9132 raft_consensus.cc:357] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e931bb7ccde943e48b453c81119181a5" member_type: VOTER }
I20250114 20:57:46.282666 9132 raft_consensus.cc:383] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:46.282820 9132 raft_consensus.cc:738] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e931bb7ccde943e48b453c81119181a5, State: Initialized, Role: FOLLOWER
I20250114 20:57:46.283301 9132 consensus_queue.cc:260] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e931bb7ccde943e48b453c81119181a5" member_type: VOTER }
I20250114 20:57:46.283679 9132 raft_consensus.cc:397] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:46.283839 9132 raft_consensus.cc:491] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:46.284044 9132 raft_consensus.cc:3054] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:46.287250 9132 raft_consensus.cc:513] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e931bb7ccde943e48b453c81119181a5" member_type: VOTER }
I20250114 20:57:46.287626 9132 leader_election.cc:304] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e931bb7ccde943e48b453c81119181a5; no voters:
I20250114 20:57:46.288559 9132 leader_election.cc:290] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:46.288851 9135 raft_consensus.cc:2798] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:46.289927 9135 raft_consensus.cc:695] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 1 LEADER]: Becoming Leader. State: Replica: e931bb7ccde943e48b453c81119181a5, State: Running, Role: LEADER
I20250114 20:57:46.290467 9135 consensus_queue.cc:237] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e931bb7ccde943e48b453c81119181a5" member_type: VOTER }
I20250114 20:57:46.290999 9132 sys_catalog.cc:564] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:46.292937 9136 sys_catalog.cc:455] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e931bb7ccde943e48b453c81119181a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e931bb7ccde943e48b453c81119181a5" member_type: VOTER } }
I20250114 20:57:46.293139 9137 sys_catalog.cc:455] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e931bb7ccde943e48b453c81119181a5. Latest consensus state: current_term: 1 leader_uuid: "e931bb7ccde943e48b453c81119181a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e931bb7ccde943e48b453c81119181a5" member_type: VOTER } }
I20250114 20:57:46.293609 9137 sys_catalog.cc:458] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:46.293545 9136 sys_catalog.cc:458] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:46.296412 9141 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:46.300329 9141 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:46.303413 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:46.306916 9141 catalog_manager.cc:1348] Generated new cluster ID: 345dffb5f01c4044b963e47bcac4807a
I20250114 20:57:46.307205 9141 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:46.346773 9141 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:46.347805 9141 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:46.362797 9141 catalog_manager.cc:5899] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5: Generated new TSK 0
I20250114 20:57:46.363296 9141 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:46.369014 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:46.375427 9153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.375986 9154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.376778 9156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:46.377558 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:46.378269 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:46.378460 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:46.378607 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888266378590 us; error 0 us; skew 500 ppm
I20250114 20:57:46.379132 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:46.381162 6853 webserver.cc:458] Webserver started at http://127.6.177.65:46433/ using document root <none> and password file <none>
I20250114 20:57:46.381596 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:46.381749 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:46.381968 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:46.382917 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.386615 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:57:46.389320 9161 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:46.389880 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:46.390100 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.390378 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestMutateNonexistentRow.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:46.409535 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:46.410404 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:46.414925 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:46.415333 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20250114 20:57:46.415781 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:46.416000 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:46.464696 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:42063
I20250114 20:57:46.464781 9231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:42063 every 8 connection(s)
I20250114 20:57:46.468451 9232 heartbeater.cc:346] Connected to a master server at 127.6.177.126:38833
I20250114 20:57:46.468730 9232 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:46.469305 9232 heartbeater.cc:510] Master 127.6.177.126:38833 requested a full tablet report, sending...
I20250114 20:57:46.470806 9087 ts_manager.cc:194] Registered new tserver with Master: 57d37bcbf4dd4521b248ce9f7bdddc4d (127.6.177.65:42063)
I20250114 20:57:46.471042 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003622809s
I20250114 20:57:46.472365 9087 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42812
I20250114 20:57:46.484359 9232 heartbeater.cc:502] Master 127.6.177.126:38833 was elected leader, sending a full tablet report...
I20250114 20:57:46.488474 9087 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42826:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:46.514719 9197 tablet_service.cc:1467] Processing CreateTablet for tablet 6093baef34f3424496bb25d824ed2575 (DEFAULT_TABLE table=client-testtb [id=477c8ccb64c24570862ebe4a742db82a]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:46.514915 9196 tablet_service.cc:1467] Processing CreateTablet for tablet f664bba3000647e79b7d75d477b4a43e (DEFAULT_TABLE table=client-testtb [id=477c8ccb64c24570862ebe4a742db82a]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:46.516086 9197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6093baef34f3424496bb25d824ed2575. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:46.516585 9196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f664bba3000647e79b7d75d477b4a43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:46.528005 9242 tablet_bootstrap.cc:492] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d: Bootstrap starting.
I20250114 20:57:46.531641 9242 tablet_bootstrap.cc:654] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:46.535212 9242 tablet_bootstrap.cc:492] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d: No bootstrap required, opened a new log
I20250114 20:57:46.535497 9242 ts_tablet_manager.cc:1397] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20250114 20:57:46.537448 9242 raft_consensus.cc:357] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.537928 9242 raft_consensus.cc:383] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:46.538214 9242 raft_consensus.cc:738] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57d37bcbf4dd4521b248ce9f7bdddc4d, State: Initialized, Role: FOLLOWER
I20250114 20:57:46.538817 9242 consensus_queue.cc:260] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.539378 9242 raft_consensus.cc:397] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:46.539666 9242 raft_consensus.cc:491] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:46.539908 9242 raft_consensus.cc:3054] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:46.544274 9242 raft_consensus.cc:513] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.544739 9242 leader_election.cc:304] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57d37bcbf4dd4521b248ce9f7bdddc4d; no voters:
I20250114 20:57:46.545680 9242 leader_election.cc:290] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:46.545955 9244 raft_consensus.cc:2798] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:46.547261 9244 raft_consensus.cc:695] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 LEADER]: Becoming Leader. State: Replica: 57d37bcbf4dd4521b248ce9f7bdddc4d, State: Running, Role: LEADER
I20250114 20:57:46.547927 9242 ts_tablet_manager.cc:1428] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20250114 20:57:46.547881 9244 consensus_queue.cc:237] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.548517 9242 tablet_bootstrap.cc:492] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d: Bootstrap starting.
I20250114 20:57:46.552874 9242 tablet_bootstrap.cc:654] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:46.553598 9087 catalog_manager.cc:5526] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 57d37bcbf4dd4521b248ce9f7bdddc4d (127.6.177.65). New cstate: current_term: 1 leader_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:46.557005 9242 tablet_bootstrap.cc:492] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d: No bootstrap required, opened a new log
I20250114 20:57:46.557377 9242 ts_tablet_manager.cc:1397] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20250114 20:57:46.559262 9242 raft_consensus.cc:357] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.559792 9242 raft_consensus.cc:383] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:46.559998 9242 raft_consensus.cc:738] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57d37bcbf4dd4521b248ce9f7bdddc4d, State: Initialized, Role: FOLLOWER
I20250114 20:57:46.560513 9242 consensus_queue.cc:260] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.561043 9242 raft_consensus.cc:397] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:46.561347 9242 raft_consensus.cc:491] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:46.561681 9242 raft_consensus.cc:3054] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:46.566332 9242 raft_consensus.cc:513] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.566761 9242 leader_election.cc:304] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57d37bcbf4dd4521b248ce9f7bdddc4d; no voters:
I20250114 20:57:46.567159 9242 leader_election.cc:290] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:46.567277 9244 raft_consensus.cc:2798] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:46.567689 9244 raft_consensus.cc:695] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 LEADER]: Becoming Leader. State: Replica: 57d37bcbf4dd4521b248ce9f7bdddc4d, State: Running, Role: LEADER
I20250114 20:57:46.568179 9244 consensus_queue.cc:237] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } }
I20250114 20:57:46.568346 9242 ts_tablet_manager.cc:1428] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20250114 20:57:46.572651 9087 catalog_manager.cc:5526] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 57d37bcbf4dd4521b248ce9f7bdddc4d (127.6.177.65). New cstate: current_term: 1 leader_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57d37bcbf4dd4521b248ce9f7bdddc4d" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42063 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:46.623227 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:46.638887 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:46.639606 6853 tablet_replica.cc:331] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d: stopping tablet replica
I20250114 20:57:46.640064 6853 raft_consensus.cc:2238] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:46.640435 6853 raft_consensus.cc:2267] T f664bba3000647e79b7d75d477b4a43e P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:46.642134 6853 tablet_replica.cc:331] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d: stopping tablet replica
I20250114 20:57:46.642511 6853 raft_consensus.cc:2238] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:46.642849 6853 raft_consensus.cc:2267] T 6093baef34f3424496bb25d824ed2575 P 57d37bcbf4dd4521b248ce9f7bdddc4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:46.661379 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:46.669353 6853 master.cc:537] Master@127.6.177.126:38833 shutting down...
I20250114 20:57:46.682085 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:46.682435 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:46.682755 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P e931bb7ccde943e48b453c81119181a5: stopping tablet replica
I20250114 20:57:46.690156 6853 master.cc:559] Master@127.6.177.126:38833 shutdown complete.
[ OK ] ClientTest.TestMutateNonexistentRow (518 ms)
[ RUN ] ClientTest.TestSoftDeleteAndRecallTableWithNewTableName
I20250114 20:57:46.708132 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:43675
I20250114 20:57:46.708920 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:46.713768 9253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.714672 9254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.715518 9256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:46.716356 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:46.717065 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:46.717216 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:46.717320 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888266717310 us; error 0 us; skew 500 ppm
I20250114 20:57:46.717741 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:46.719744 6853 webserver.cc:458] Webserver started at http://127.6.177.126:40901/ using document root <none> and password file <none>
I20250114 20:57:46.720116 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:46.720252 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:46.720467 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:46.721369 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "89d30c1939294d4d8bf3521fdebb1658"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.724918 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:46.727422 9261 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:46.727994 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:46.728207 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "89d30c1939294d4d8bf3521fdebb1658"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.728403 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:46.746351 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:46.747110 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:46.781910 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:43675
I20250114 20:57:46.781981 9322 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:43675 every 8 connection(s)
I20250114 20:57:46.785048 9323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:46.793815 9323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658: Bootstrap starting.
I20250114 20:57:46.797128 9323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:46.800335 9323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658: No bootstrap required, opened a new log
I20250114 20:57:46.801939 9323 raft_consensus.cc:357] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d30c1939294d4d8bf3521fdebb1658" member_type: VOTER }
I20250114 20:57:46.802246 9323 raft_consensus.cc:383] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:46.802460 9323 raft_consensus.cc:738] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d30c1939294d4d8bf3521fdebb1658, State: Initialized, Role: FOLLOWER
I20250114 20:57:46.802964 9323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d30c1939294d4d8bf3521fdebb1658" member_type: VOTER }
I20250114 20:57:46.803421 9323 raft_consensus.cc:397] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:46.803663 9323 raft_consensus.cc:491] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:46.803916 9323 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:46.807297 9323 raft_consensus.cc:513] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d30c1939294d4d8bf3521fdebb1658" member_type: VOTER }
I20250114 20:57:46.807749 9323 leader_election.cc:304] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89d30c1939294d4d8bf3521fdebb1658; no voters:
I20250114 20:57:46.808650 9323 leader_election.cc:290] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:46.808892 9326 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:46.810097 9326 raft_consensus.cc:695] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 1 LEADER]: Becoming Leader. State: Replica: 89d30c1939294d4d8bf3521fdebb1658, State: Running, Role: LEADER
I20250114 20:57:46.810724 9326 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d30c1939294d4d8bf3521fdebb1658" member_type: VOTER }
I20250114 20:57:46.811082 9323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:46.813158 9327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89d30c1939294d4d8bf3521fdebb1658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d30c1939294d4d8bf3521fdebb1658" member_type: VOTER } }
I20250114 20:57:46.813235 9328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89d30c1939294d4d8bf3521fdebb1658. Latest consensus state: current_term: 1 leader_uuid: "89d30c1939294d4d8bf3521fdebb1658" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d30c1939294d4d8bf3521fdebb1658" member_type: VOTER } }
I20250114 20:57:46.813868 9328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:46.814950 9327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:46.816377 9332 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:46.823397 9332 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:46.824661 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:46.830144 9332 catalog_manager.cc:1348] Generated new cluster ID: 4c4c5da1ed7a4a12b8e5c8783f696290
I20250114 20:57:46.830420 9332 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:46.856469 9332 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:46.857470 9332 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:46.874619 9332 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658: Generated new TSK 0
I20250114 20:57:46.875133 9332 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:46.891264 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:46.897065 9344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.897966 9345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:46.899091 9347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:46.899895 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:46.900560 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:46.900733 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:46.900892 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888266900873 us; error 0 us; skew 500 ppm
I20250114 20:57:46.901352 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:46.903357 6853 webserver.cc:458] Webserver started at http://127.6.177.65:45257/ using document root <none> and password file <none>
I20250114 20:57:46.903743 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:46.903911 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:46.904127 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:46.905041 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "76e8904435664969b67056daa8548ed1"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.908802 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20250114 20:57:46.911597 9352 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:46.912211 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20250114 20:57:46.912465 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "76e8904435664969b67056daa8548ed1"
format_stamp: "Formatted at 2025-01-14 20:57:46 on dist-test-slave-26qh"
I20250114 20:57:46.912707 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestSoftDeleteAndRecallTableWithNewTableName.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:46.924590 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:46.925331 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:46.930913 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:46.931206 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20250114 20:57:46.931483 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:46.931715 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:46.976639 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:42555
I20250114 20:57:46.976714 9422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:42555 every 8 connection(s)
I20250114 20:57:46.980167 9423 heartbeater.cc:346] Connected to a master server at 127.6.177.126:43675
I20250114 20:57:46.980460 9423 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:46.981077 9423 heartbeater.cc:510] Master 127.6.177.126:43675 requested a full tablet report, sending...
I20250114 20:57:46.982522 9278 ts_manager.cc:194] Registered new tserver with Master: 76e8904435664969b67056daa8548ed1 (127.6.177.65:42555)
I20250114 20:57:46.982947 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00363402s
I20250114 20:57:46.983939 9278 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60968
I20250114 20:57:46.995731 9423 heartbeater.cc:502] Master 127.6.177.126:43675 was elected leader, sending a full tablet report...
I20250114 20:57:46.999589 9278 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60996:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:47.025888 9388 tablet_service.cc:1467] Processing CreateTablet for tablet 431a8bb677d14457b431864158c03012 (DEFAULT_TABLE table=client-testtb [id=7820a1d9fcf1447583f770460baade0a]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:47.026337 9387 tablet_service.cc:1467] Processing CreateTablet for tablet 000f01f757b4430d9c79980ab8644d48 (DEFAULT_TABLE table=client-testtb [id=7820a1d9fcf1447583f770460baade0a]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:47.026921 9388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431a8bb677d14457b431864158c03012. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:47.027341 9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 000f01f757b4430d9c79980ab8644d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:47.038708 9433 tablet_bootstrap.cc:492] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: Bootstrap starting.
I20250114 20:57:47.042176 9433 tablet_bootstrap.cc:654] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:47.045658 9433 tablet_bootstrap.cc:492] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: No bootstrap required, opened a new log
I20250114 20:57:47.045953 9433 ts_tablet_manager.cc:1397] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20250114 20:57:47.047878 9433 raft_consensus.cc:357] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.048309 9433 raft_consensus.cc:383] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:47.048554 9433 raft_consensus.cc:738] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76e8904435664969b67056daa8548ed1, State: Initialized, Role: FOLLOWER
I20250114 20:57:47.049103 9433 consensus_queue.cc:260] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.049585 9433 raft_consensus.cc:397] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:47.049764 9433 raft_consensus.cc:491] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:47.049943 9433 raft_consensus.cc:3054] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:47.053932 9433 raft_consensus.cc:513] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.054383 9433 leader_election.cc:304] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76e8904435664969b67056daa8548ed1; no voters:
I20250114 20:57:47.055361 9433 leader_election.cc:290] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:47.055627 9435 raft_consensus.cc:2798] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:47.056702 9435 raft_consensus.cc:695] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 1 LEADER]: Becoming Leader. State: Replica: 76e8904435664969b67056daa8548ed1, State: Running, Role: LEADER
I20250114 20:57:47.057422 9433 ts_tablet_manager.cc:1428] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20250114 20:57:47.057256 9435 consensus_queue.cc:237] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.058023 9433 tablet_bootstrap.cc:492] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: Bootstrap starting.
I20250114 20:57:47.063192 9433 tablet_bootstrap.cc:654] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:47.062935 9278 catalog_manager.cc:5526] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76e8904435664969b67056daa8548ed1 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "76e8904435664969b67056daa8548ed1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:47.067298 9433 tablet_bootstrap.cc:492] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: No bootstrap required, opened a new log
I20250114 20:57:47.067615 9433 ts_tablet_manager.cc:1397] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20250114 20:57:47.069226 9433 raft_consensus.cc:357] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.069676 9433 raft_consensus.cc:383] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:47.069867 9433 raft_consensus.cc:738] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76e8904435664969b67056daa8548ed1, State: Initialized, Role: FOLLOWER
I20250114 20:57:47.070343 9433 consensus_queue.cc:260] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.070797 9433 raft_consensus.cc:397] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:47.071115 9433 raft_consensus.cc:491] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:47.071420 9433 raft_consensus.cc:3054] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:47.075734 9433 raft_consensus.cc:513] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.076179 9433 leader_election.cc:304] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76e8904435664969b67056daa8548ed1; no voters:
I20250114 20:57:47.076532 9433 leader_election.cc:290] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:47.076633 9435 raft_consensus.cc:2798] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:47.077183 9435 raft_consensus.cc:695] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 1 LEADER]: Becoming Leader. State: Replica: 76e8904435664969b67056daa8548ed1, State: Running, Role: LEADER
I20250114 20:57:47.077723 9433 ts_tablet_manager.cc:1428] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250114 20:57:47.077710 9435 consensus_queue.cc:237] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } }
I20250114 20:57:47.082247 9277 catalog_manager.cc:5526] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76e8904435664969b67056daa8548ed1 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "76e8904435664969b67056daa8548ed1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76e8904435664969b67056daa8548ed1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 42555 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:47.155500 9275 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60996:
table { table_name: "client-testtb" } modify_external_catalogs: true reserve_seconds: 600
I20250114 20:57:47.163587 9275 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60996:
table { table_name: "client-testtb" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20250114 20:57:47.175806 9444 tablet.cc:1721] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250114 20:57:47.176355 9445 tablet.cc:1721] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250114 20:57:47.178639 9275 catalog_manager.cc:2832] Servicing RecallDeletedTableRpc request from {username='slave'} at 127.0.0.1:60996:
table { table_id: "7820a1d9fcf1447583f770460baade0a" } new_table_name: "test-new-table"
I20250114 20:57:47.188377 9275 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60996:
table { table_id: "7820a1d9fcf1447583f770460baade0a" } new_table_name: "test-new-table"
I20250114 20:57:47.197081 9275 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60996:
table { table_id: "7820a1d9fcf1447583f770460baade0a" } new_extra_configs { key: "kudu.table.disable_compaction" value: "false" }
I20250114 20:57:47.199846 9445 tablet.cc:1721] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250114 20:57:47.200248 9444 tablet.cc:1721] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250114 20:57:47.210417 9278 catalog_manager.cc:5618] TS 76e8904435664969b67056daa8548ed1 (127.6.177.65:42555) does not have the latest schema for tablet 431a8bb677d14457b431864158c03012 (table test-new-table [id=7820a1d9fcf1447583f770460baade0a]). Expected version 3 got 2
I20250114 20:57:47.212568 9444 tablet.cc:1721] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250114 20:57:47.214438 9445 tablet.cc:1721] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250114 20:57:47.217283 9275 catalog_manager.cc:5618] TS 76e8904435664969b67056daa8548ed1 (127.6.177.65:42555) does not have the latest schema for tablet 000f01f757b4430d9c79980ab8644d48 (table test-new-table [id=7820a1d9fcf1447583f770460baade0a]). Expected version 3 got 2
I20250114 20:57:47.234872 9275 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658: test-new-table [id=7820a1d9fcf1447583f770460baade0a] alter complete (version 3)
I20250114 20:57:47.236222 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:47.250414 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:47.251117 6853 tablet_replica.cc:331] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1: stopping tablet replica
I20250114 20:57:47.251754 6853 raft_consensus.cc:2238] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:47.252168 6853 raft_consensus.cc:2267] T 000f01f757b4430d9c79980ab8644d48 P 76e8904435664969b67056daa8548ed1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:47.253854 6853 tablet_replica.cc:331] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1: stopping tablet replica
I20250114 20:57:47.254210 6853 raft_consensus.cc:2238] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:47.254547 6853 raft_consensus.cc:2267] T 431a8bb677d14457b431864158c03012 P 76e8904435664969b67056daa8548ed1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:47.272943 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:47.282032 6853 master.cc:537] Master@127.6.177.126:43675 shutting down...
I20250114 20:57:47.294453 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:47.294777 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:47.295051 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 89d30c1939294d4d8bf3521fdebb1658: stopping tablet replica
I20250114 20:57:47.313354 6853 master.cc:559] Master@127.6.177.126:43675 shutdown complete.
[ OK ] ClientTest.TestSoftDeleteAndRecallTableWithNewTableName (623 ms)
[ RUN ] ClientTest.TestReplicatedMultiTabletTableFailover
I20250114 20:57:47.331799 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:42971
I20250114 20:57:47.332590 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:47.337301 9446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:47.338243 9447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:47.339162 9449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:47.339983 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:47.340896 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:47.341082 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:47.341198 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888267341187 us; error 0 us; skew 500 ppm
I20250114 20:57:47.341602 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:47.343537 6853 webserver.cc:458] Webserver started at http://127.6.177.126:43095/ using document root <none> and password file <none>
I20250114 20:57:47.343897 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:47.344033 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:47.344236 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:47.345074 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "dd80832178e14554a5b6020cfc93df0d"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.348541 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:47.351125 9454 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.351752 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:47.351960 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "dd80832178e14554a5b6020cfc93df0d"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.352195 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:47.370452 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:47.371333 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:47.406081 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:42971
I20250114 20:57:47.406147 9515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:42971 every 8 connection(s)
I20250114 20:57:47.409272 9516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:47.418084 9516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d: Bootstrap starting.
I20250114 20:57:47.421813 9516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:47.424928 9516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d: No bootstrap required, opened a new log
I20250114 20:57:47.426591 9516 raft_consensus.cc:357] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd80832178e14554a5b6020cfc93df0d" member_type: VOTER }
I20250114 20:57:47.426925 9516 raft_consensus.cc:383] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:47.427140 9516 raft_consensus.cc:738] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd80832178e14554a5b6020cfc93df0d, State: Initialized, Role: FOLLOWER
I20250114 20:57:47.427608 9516 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd80832178e14554a5b6020cfc93df0d" member_type: VOTER }
I20250114 20:57:47.427979 9516 raft_consensus.cc:397] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:47.428150 9516 raft_consensus.cc:491] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:47.428340 9516 raft_consensus.cc:3054] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:47.432071 9516 raft_consensus.cc:513] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd80832178e14554a5b6020cfc93df0d" member_type: VOTER }
I20250114 20:57:47.432435 9516 leader_election.cc:304] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd80832178e14554a5b6020cfc93df0d; no voters:
I20250114 20:57:47.433295 9516 leader_election.cc:290] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:47.433528 9519 raft_consensus.cc:2798] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:47.434659 9519 raft_consensus.cc:695] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 1 LEADER]: Becoming Leader. State: Replica: dd80832178e14554a5b6020cfc93df0d, State: Running, Role: LEADER
I20250114 20:57:47.435246 9519 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd80832178e14554a5b6020cfc93df0d" member_type: VOTER }
I20250114 20:57:47.435784 9516 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:47.437573 9521 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd80832178e14554a5b6020cfc93df0d. Latest consensus state: current_term: 1 leader_uuid: "dd80832178e14554a5b6020cfc93df0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd80832178e14554a5b6020cfc93df0d" member_type: VOTER } }
I20250114 20:57:47.437682 9520 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd80832178e14554a5b6020cfc93df0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd80832178e14554a5b6020cfc93df0d" member_type: VOTER } }
I20250114 20:57:47.438378 9520 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:47.438326 9521 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:47.441677 9525 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:47.447885 9525 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:47.448750 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:47.454538 9525 catalog_manager.cc:1348] Generated new cluster ID: 3e435ffdcbfa4411931f3b7891db4d1f
I20250114 20:57:47.454764 9525 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:47.470137 9525 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:47.471272 9525 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:47.481526 9525 catalog_manager.cc:5899] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d: Generated new TSK 0
I20250114 20:57:47.482002 9525 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:47.514446 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:47.520511 9537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:47.521375 9538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:47.522169 6853 server_base.cc:1034] running on GCE node
W20250114 20:57:47.522976 9540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:47.523721 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:47.523877 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:47.524040 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888267524021 us; error 0 us; skew 500 ppm
I20250114 20:57:47.524442 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:47.526300 6853 webserver.cc:458] Webserver started at http://127.6.177.65:38619/ using document root <none> and password file <none>
I20250114 20:57:47.526710 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:47.526881 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:47.527143 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:47.528079 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "edc651f54a1b46abadfa249908724219"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.531713 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20250114 20:57:47.534159 9545 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.534777 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:47.535004 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "edc651f54a1b46abadfa249908724219"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.535320 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:47.556241 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:47.556984 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:47.560984 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:47.561292 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.561631 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:47.561862 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.602174 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:45919
I20250114 20:57:47.602241 9615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:45919 every 8 connection(s)
I20250114 20:57:47.605849 9616 heartbeater.cc:346] Connected to a master server at 127.6.177.126:42971
I20250114 20:57:47.606109 9616 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:47.606698 9616 heartbeater.cc:510] Master 127.6.177.126:42971 requested a full tablet report, sending...
I20250114 20:57:47.608347 9471 ts_manager.cc:194] Registered new tserver with Master: edc651f54a1b46abadfa249908724219 (127.6.177.65:45919)
I20250114 20:57:47.608470 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003745282s
I20250114 20:57:47.610330 9471 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58512
I20250114 20:57:47.622807 9616 heartbeater.cc:502] Master 127.6.177.126:42971 was elected leader, sending a full tablet report...
I20250114 20:57:47.626973 9471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58530:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:47.652647 9581 tablet_service.cc:1467] Processing CreateTablet for tablet 163e0e6e61544fbfbcffe8eb285cf214 (DEFAULT_TABLE table=client-testtb [id=79e9099108ec4f6a80cca117ece0c331]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:47.652842 9580 tablet_service.cc:1467] Processing CreateTablet for tablet 9715fc1de41c46519f6c113d29ba1eae (DEFAULT_TABLE table=client-testtb [id=79e9099108ec4f6a80cca117ece0c331]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:47.653734 9581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 163e0e6e61544fbfbcffe8eb285cf214. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:47.654219 9580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9715fc1de41c46519f6c113d29ba1eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:47.667982 9626 tablet_bootstrap.cc:492] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219: Bootstrap starting.
I20250114 20:57:47.671597 9626 tablet_bootstrap.cc:654] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:47.674922 9626 tablet_bootstrap.cc:492] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219: No bootstrap required, opened a new log
I20250114 20:57:47.675230 9626 ts_tablet_manager.cc:1397] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20250114 20:57:47.676708 9626 raft_consensus.cc:357] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.677093 9626 raft_consensus.cc:383] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:47.677273 9626 raft_consensus.cc:738] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc651f54a1b46abadfa249908724219, State: Initialized, Role: FOLLOWER
I20250114 20:57:47.677713 9626 consensus_queue.cc:260] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.678164 9626 raft_consensus.cc:397] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:47.678380 9626 raft_consensus.cc:491] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:47.678617 9626 raft_consensus.cc:3054] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:47.682623 9626 raft_consensus.cc:513] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.683166 9626 leader_election.cc:304] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edc651f54a1b46abadfa249908724219; no voters:
I20250114 20:57:47.684180 9626 leader_election.cc:290] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:47.684422 9628 raft_consensus.cc:2798] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:47.685971 9628 raft_consensus.cc:695] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Becoming Leader. State: Replica: edc651f54a1b46abadfa249908724219, State: Running, Role: LEADER
I20250114 20:57:47.686391 9626 ts_tablet_manager.cc:1428] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20250114 20:57:47.686623 9628 consensus_queue.cc:237] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.687196 9626 tablet_bootstrap.cc:492] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219: Bootstrap starting.
I20250114 20:57:47.692448 9626 tablet_bootstrap.cc:654] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:47.692694 9471 catalog_manager.cc:5526] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 reported cstate change: term changed from 0 to 1, leader changed from <none> to edc651f54a1b46abadfa249908724219 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "edc651f54a1b46abadfa249908724219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:47.696081 9626 tablet_bootstrap.cc:492] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219: No bootstrap required, opened a new log
I20250114 20:57:47.696353 9626 ts_tablet_manager.cc:1397] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20250114 20:57:47.698060 9626 raft_consensus.cc:357] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.698598 9626 raft_consensus.cc:383] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:47.698899 9626 raft_consensus.cc:738] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc651f54a1b46abadfa249908724219, State: Initialized, Role: FOLLOWER
I20250114 20:57:47.699451 9626 consensus_queue.cc:260] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.699831 9626 raft_consensus.cc:397] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:47.700014 9626 raft_consensus.cc:491] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:47.700218 9626 raft_consensus.cc:3054] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:47.704231 9626 raft_consensus.cc:513] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.704658 9626 leader_election.cc:304] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edc651f54a1b46abadfa249908724219; no voters:
I20250114 20:57:47.705065 9626 leader_election.cc:290] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:47.705196 9628 raft_consensus.cc:2798] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:47.705618 9628 raft_consensus.cc:695] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Becoming Leader. State: Replica: edc651f54a1b46abadfa249908724219, State: Running, Role: LEADER
I20250114 20:57:47.706154 9628 consensus_queue.cc:237] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:47.706372 9626 ts_tablet_manager.cc:1428] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250114 20:57:47.710546 9471 catalog_manager.cc:5526] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 reported cstate change: term changed from 0 to 1, leader changed from <none> to edc651f54a1b46abadfa249908724219 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "edc651f54a1b46abadfa249908724219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:47.735615 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:47.741757 9635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:47.742509 9636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:47.743432 9638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:47.744192 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:47.744889 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:47.745038 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:47.745184 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888267745160 us; error 0 us; skew 500 ppm
I20250114 20:57:47.745674 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:47.747656 6853 webserver.cc:458] Webserver started at http://127.6.177.66:42435/ using document root <none> and password file <none>
I20250114 20:57:47.748044 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:47.748203 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:47.748406 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:47.749352 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-1-root/instance:
uuid: "447a15383f2c4d6cbf886e27398e14c5"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.753391 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250114 20:57:47.756047 9643 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.756736 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:57:47.756979 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-1-root
uuid: "447a15383f2c4d6cbf886e27398e14c5"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.757277 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:47.768899 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:47.769907 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:47.777221 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:47.777391 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.777647 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:47.777825 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.856321 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.66:41245
I20250114 20:57:47.856454 9712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.66:41245 every 8 connection(s)
I20250114 20:57:47.892860 9714 heartbeater.cc:346] Connected to a master server at 127.6.177.126:42971
I20250114 20:57:47.893522 9714 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:47.893591 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250114 20:57:47.894531 9714 heartbeater.cc:510] Master 127.6.177.126:42971 requested a full tablet report, sending...
I20250114 20:57:47.896576 9471 ts_manager.cc:194] Registered new tserver with Master: 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66:41245)
I20250114 20:57:47.898299 9471 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58546
W20250114 20:57:47.903192 9716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:47.904181 9717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:47.907809 9719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:47.908591 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:47.909343 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:47.909528 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:47.909672 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888267909657 us; error 0 us; skew 500 ppm
I20250114 20:57:47.910125 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:47.912046 9714 heartbeater.cc:502] Master 127.6.177.126:42971 was elected leader, sending a full tablet report...
I20250114 20:57:47.913002 6853 webserver.cc:458] Webserver started at http://127.6.177.67:40127/ using document root <none> and password file <none>
I20250114 20:57:47.913602 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:47.913825 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:47.914117 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:47.915627 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-2-root/instance:
uuid: "a9bb7da46d7243619da94ff625f30a38"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.920449 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20250114 20:57:47.923573 9724 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.924377 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20250114 20:57:47.924639 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-2-root
uuid: "a9bb7da46d7243619da94ff625f30a38"
format_stamp: "Formatted at 2025-01-14 20:57:47 on dist-test-slave-26qh"
I20250114 20:57:47.924887 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReplicatedMultiTabletTableFailover.1736888227440588-6853-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:47.946089 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:47.947436 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:47.953572 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:47.953923 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:47.954241 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:47.954401 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:48.049116 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.67:42025
I20250114 20:57:48.049259 9793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.67:42025 every 8 connection(s)
I20250114 20:57:48.053690 9794 heartbeater.cc:346] Connected to a master server at 127.6.177.126:42971
I20250114 20:57:48.053993 9794 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:48.054723 9794 heartbeater.cc:510] Master 127.6.177.126:42971 requested a full tablet report, sending...
I20250114 20:57:48.056340 9471 ts_manager.cc:194] Registered new tserver with Master: a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025)
I20250114 20:57:48.057279 6853 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003956108s
I20250114 20:57:48.058086 9471 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47690
I20250114 20:57:48.060506 9471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58530:
name: "replicated_failover_on_reads"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250114 20:57:48.062816 9471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table replicated_failover_on_reads in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250114 20:57:48.070807 9794 heartbeater.cc:502] Master 127.6.177.126:42971 was elected leader, sending a full tablet report...
I20250114 20:57:48.094560 9581 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd9daba286143f5907a31745a4752c1 (DEFAULT_TABLE table=replicated_failover_on_reads [id=79f1b419160843469713b1df11c5d751]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:48.096448 9581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd9daba286143f5907a31745a4752c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:48.110881 9678 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd9daba286143f5907a31745a4752c1 (DEFAULT_TABLE table=replicated_failover_on_reads [id=79f1b419160843469713b1df11c5d751]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:48.112365 9678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd9daba286143f5907a31745a4752c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:48.114931 9580 tablet_service.cc:1467] Processing CreateTablet for tablet e0098eb92f744d569eba19170c4d93ee (DEFAULT_TABLE table=replicated_failover_on_reads [id=79f1b419160843469713b1df11c5d751]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:48.116782 9580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0098eb92f744d569eba19170c4d93ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:48.116622 9677 tablet_service.cc:1467] Processing CreateTablet for tablet e0098eb92f744d569eba19170c4d93ee (DEFAULT_TABLE table=replicated_failover_on_reads [id=79f1b419160843469713b1df11c5d751]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:48.117834 9677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0098eb92f744d569eba19170c4d93ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:48.125988 9626 tablet_bootstrap.cc:492] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219: Bootstrap starting.
I20250114 20:57:48.135222 9626 tablet_bootstrap.cc:654] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:48.143990 9626 tablet_bootstrap.cc:492] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219: No bootstrap required, opened a new log
I20250114 20:57:48.144510 9626 ts_tablet_manager.cc:1397] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.008s
I20250114 20:57:48.144807 9799 tablet_bootstrap.cc:492] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5: Bootstrap starting.
I20250114 20:57:48.149937 9626 raft_consensus.cc:357] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.151268 9626 raft_consensus.cc:383] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:48.151808 9626 raft_consensus.cc:738] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc651f54a1b46abadfa249908724219, State: Initialized, Role: FOLLOWER
I20250114 20:57:48.151356 9799 tablet_bootstrap.cc:654] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:48.152810 9759 tablet_service.cc:1467] Processing CreateTablet for tablet 0bd9daba286143f5907a31745a4752c1 (DEFAULT_TABLE table=replicated_failover_on_reads [id=79f1b419160843469713b1df11c5d751]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:48.153882 9759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd9daba286143f5907a31745a4752c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:48.154826 9626 consensus_queue.cc:260] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.156410 9758 tablet_service.cc:1467] Processing CreateTablet for tablet e0098eb92f744d569eba19170c4d93ee (DEFAULT_TABLE table=replicated_failover_on_reads [id=79f1b419160843469713b1df11c5d751]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:48.157531 9758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0098eb92f744d569eba19170c4d93ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:48.160563 9626 ts_tablet_manager.cc:1428] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20250114 20:57:48.161999 9626 tablet_bootstrap.cc:492] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219: Bootstrap starting.
I20250114 20:57:48.171161 9626 tablet_bootstrap.cc:654] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:48.171675 9799 tablet_bootstrap.cc:492] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5: No bootstrap required, opened a new log
I20250114 20:57:48.172161 9799 ts_tablet_manager.cc:1397] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.019s
I20250114 20:57:48.176460 9799 raft_consensus.cc:357] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.177114 9799 raft_consensus.cc:383] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:48.177397 9799 raft_consensus.cc:738] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447a15383f2c4d6cbf886e27398e14c5, State: Initialized, Role: FOLLOWER
I20250114 20:57:48.178081 9799 consensus_queue.cc:260] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.185005 9626 tablet_bootstrap.cc:492] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219: No bootstrap required, opened a new log
I20250114 20:57:48.185505 9626 ts_tablet_manager.cc:1397] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.012s
I20250114 20:57:48.187963 9626 raft_consensus.cc:357] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.188524 9626 raft_consensus.cc:383] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:48.188717 9626 raft_consensus.cc:738] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc651f54a1b46abadfa249908724219, State: Initialized, Role: FOLLOWER
I20250114 20:57:48.189203 9626 consensus_queue.cc:260] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.190932 9799 ts_tablet_manager.cc:1428] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5: Time spent starting tablet: real 0.018s user 0.005s sys 0.008s
I20250114 20:57:48.191423 9626 ts_tablet_manager.cc:1428] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250114 20:57:48.193037 9804 tablet_bootstrap.cc:492] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38: Bootstrap starting.
I20250114 20:57:48.193480 9799 tablet_bootstrap.cc:492] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5: Bootstrap starting.
I20250114 20:57:48.199422 9804 tablet_bootstrap.cc:654] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:48.200064 9799 tablet_bootstrap.cc:654] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:48.205508 9799 tablet_bootstrap.cc:492] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5: No bootstrap required, opened a new log
I20250114 20:57:48.205826 9799 ts_tablet_manager.cc:1397] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.002s
I20250114 20:57:48.206131 9629 raft_consensus.cc:491] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250114 20:57:48.206681 9629 raft_consensus.cc:513] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.208573 9799 raft_consensus.cc:357] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.209229 9799 raft_consensus.cc:383] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:48.209506 9799 raft_consensus.cc:738] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447a15383f2c4d6cbf886e27398e14c5, State: Initialized, Role: FOLLOWER
I20250114 20:57:48.210867 9804 tablet_bootstrap.cc:492] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38: No bootstrap required, opened a new log
I20250114 20:57:48.211360 9804 ts_tablet_manager.cc:1397] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.014s
I20250114 20:57:48.215955 9629 leader_election.cc:290] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66:41245), a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025)
I20250114 20:57:48.219580 9799 consensus_queue.cc:260] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.222047 9799 ts_tablet_manager.cc:1428] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5: Time spent starting tablet: real 0.016s user 0.004s sys 0.001s
I20250114 20:57:48.224603 9804 raft_consensus.cc:357] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.227092 9804 raft_consensus.cc:383] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:48.227429 9804 raft_consensus.cc:738] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9bb7da46d7243619da94ff625f30a38, State: Initialized, Role: FOLLOWER
I20250114 20:57:48.228104 9804 consensus_queue.cc:260] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.236830 9804 ts_tablet_manager.cc:1428] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38: Time spent starting tablet: real 0.025s user 0.007s sys 0.005s
I20250114 20:57:48.237694 9804 tablet_bootstrap.cc:492] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38: Bootstrap starting.
I20250114 20:57:48.241811 9688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bd9daba286143f5907a31745a4752c1" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447a15383f2c4d6cbf886e27398e14c5" is_pre_election: true
I20250114 20:57:48.243654 9804 tablet_bootstrap.cc:654] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:48.243446 9769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bd9daba286143f5907a31745a4752c1" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38" is_pre_election: true
I20250114 20:57:48.244426 9769 raft_consensus.cc:2463] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 0.
I20250114 20:57:48.245770 9547 leader_election.cc:304] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9bb7da46d7243619da94ff625f30a38, edc651f54a1b46abadfa249908724219; no voters:
I20250114 20:57:48.246626 9629 raft_consensus.cc:2798] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250114 20:57:48.246918 9629 raft_consensus.cc:491] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250114 20:57:48.247380 9629 raft_consensus.cc:3054] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:48.249274 9804 tablet_bootstrap.cc:492] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38: No bootstrap required, opened a new log
I20250114 20:57:48.249634 9804 ts_tablet_manager.cc:1397] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20250114 20:57:48.242798 9688 raft_consensus.cc:2463] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 0.
I20250114 20:57:48.252211 9804 raft_consensus.cc:357] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.252816 9804 raft_consensus.cc:383] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:48.252741 9629 raft_consensus.cc:513] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.254208 9629 leader_election.cc:290] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Requested vote from peers 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66:41245), a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025)
I20250114 20:57:48.253079 9804 raft_consensus.cc:738] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9bb7da46d7243619da94ff625f30a38, State: Initialized, Role: FOLLOWER
I20250114 20:57:48.254922 9688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bd9daba286143f5907a31745a4752c1" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447a15383f2c4d6cbf886e27398e14c5"
I20250114 20:57:48.255360 9688 raft_consensus.cc:3054] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:48.255113 9769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bd9daba286143f5907a31745a4752c1" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38"
I20250114 20:57:48.255812 9769 raft_consensus.cc:3054] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:48.255131 9804 consensus_queue.cc:260] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.257916 9804 ts_tablet_manager.cc:1428] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250114 20:57:48.265075 9688 raft_consensus.cc:2463] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 1.
I20250114 20:57:48.266163 9546 leader_election.cc:304] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447a15383f2c4d6cbf886e27398e14c5, edc651f54a1b46abadfa249908724219; no voters:
I20250114 20:57:48.266938 9629 raft_consensus.cc:2798] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:48.267210 9769 raft_consensus.cc:2463] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 1.
I20250114 20:57:48.267438 9629 raft_consensus.cc:695] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Becoming Leader. State: Replica: edc651f54a1b46abadfa249908724219, State: Running, Role: LEADER
I20250114 20:57:48.268798 9629 consensus_queue.cc:237] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:48.275357 9469 catalog_manager.cc:5526] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 reported cstate change: term changed from 0 to 1, leader changed from <none> to edc651f54a1b46abadfa249908724219 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "edc651f54a1b46abadfa249908724219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } health_report { overall_health: HEALTHY } } }
W20250114 20:57:48.304019 9795 tablet.cc:2367] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250114 20:57:48.373468 9629 raft_consensus.cc:491] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250114 20:57:48.373836 9629 raft_consensus.cc:513] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.375437 9629 leader_election.cc:290] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66:41245), a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025)
I20250114 20:57:48.375702 9688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0098eb92f744d569eba19170c4d93ee" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447a15383f2c4d6cbf886e27398e14c5" is_pre_election: true
I20250114 20:57:48.375936 9769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0098eb92f744d569eba19170c4d93ee" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38" is_pre_election: true
I20250114 20:57:48.376295 9688 raft_consensus.cc:2463] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 0.
I20250114 20:57:48.376434 9769 raft_consensus.cc:2463] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 0.
I20250114 20:57:48.377146 9546 leader_election.cc:304] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447a15383f2c4d6cbf886e27398e14c5, edc651f54a1b46abadfa249908724219; no voters:
I20250114 20:57:48.377686 9629 raft_consensus.cc:2798] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250114 20:57:48.377923 9629 raft_consensus.cc:491] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250114 20:57:48.378170 9629 raft_consensus.cc:3054] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:48.383057 9629 raft_consensus.cc:513] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.384745 9629 leader_election.cc:290] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Requested vote from peers 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66:41245), a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025)
I20250114 20:57:48.385270 9688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0098eb92f744d569eba19170c4d93ee" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447a15383f2c4d6cbf886e27398e14c5"
I20250114 20:57:48.385481 9769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0098eb92f744d569eba19170c4d93ee" candidate_uuid: "edc651f54a1b46abadfa249908724219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38"
I20250114 20:57:48.385725 9688 raft_consensus.cc:3054] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:48.385970 9769 raft_consensus.cc:3054] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:48.389796 9688 raft_consensus.cc:2463] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 1.
I20250114 20:57:48.390583 9546 leader_election.cc:304] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447a15383f2c4d6cbf886e27398e14c5, edc651f54a1b46abadfa249908724219; no voters:
I20250114 20:57:48.390697 9769 raft_consensus.cc:2463] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc651f54a1b46abadfa249908724219 in term 1.
I20250114 20:57:48.391561 9629 raft_consensus.cc:2798] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:48.392797 9629 raft_consensus.cc:695] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Becoming Leader. State: Replica: edc651f54a1b46abadfa249908724219, State: Running, Role: LEADER
I20250114 20:57:48.393391 9629 consensus_queue.cc:237] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:48.398288 9469 catalog_manager.cc:5526] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 reported cstate change: term changed from 0 to 1, leader changed from <none> to edc651f54a1b46abadfa249908724219 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "edc651f54a1b46abadfa249908724219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } health_report { overall_health: UNKNOWN } } }
I20250114 20:57:48.493033 9769 raft_consensus.cc:1270] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Refusing update from remote peer edc651f54a1b46abadfa249908724219: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250114 20:57:48.493849 9688 raft_consensus.cc:1270] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Refusing update from remote peer edc651f54a1b46abadfa249908724219: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250114 20:57:48.495371 9628 consensus_queue.cc:1035] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250114 20:57:48.503149 9769 raft_consensus.cc:1270] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Refusing update from remote peer edc651f54a1b46abadfa249908724219: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250114 20:57:48.502344 9629 consensus_queue.cc:1035] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250114 20:57:48.504549 9629 consensus_queue.cc:1035] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250114 20:57:48.585613 9820 mvcc.cc:204] Tried to move back new op lower bound from 7114294347760881664 to 7114294347344695296. Current Snapshot: MvccSnapshot[applied={T|T < 7114294347760881664}]
I20250114 20:57:48.604648 9688 raft_consensus.cc:1270] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Refusing update from remote peer edc651f54a1b46abadfa249908724219: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250114 20:57:48.606763 9628 consensus_queue.cc:1035] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250114 20:57:48.625267 6853 client-test.cc:916] Killing TS edc651f54a1b46abadfa249908724219 at 127.6.177.65:45919
I20250114 20:57:48.625697 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:48.670611 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:48.671346 6853 tablet_replica.cc:331] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219: stopping tablet replica
I20250114 20:57:48.671862 6853 raft_consensus.cc:2238] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:48.672621 6853 raft_consensus.cc:2267] T e0098eb92f744d569eba19170c4d93ee P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:48.674468 6853 tablet_replica.cc:331] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219: stopping tablet replica
I20250114 20:57:48.674875 6853 raft_consensus.cc:2238] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:48.675449 6853 raft_consensus.cc:2267] T 0bd9daba286143f5907a31745a4752c1 P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:48.676990 6853 tablet_replica.cc:331] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219: stopping tablet replica
I20250114 20:57:48.677333 6853 raft_consensus.cc:2238] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:48.677750 6853 raft_consensus.cc:2267] T 9715fc1de41c46519f6c113d29ba1eae P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:48.679976 6853 tablet_replica.cc:331] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219: stopping tablet replica
I20250114 20:57:48.680634 6853 raft_consensus.cc:2238] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:48.681284 6853 raft_consensus.cc:2267] T 163e0e6e61544fbfbcffe8eb285cf214 P edc651f54a1b46abadfa249908724219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:48.702275 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:48.718473 6853 meta_cache.cc:1510] marking tablet server edc651f54a1b46abadfa249908724219 (127.6.177.65:45919) as failed
W20250114 20:57:48.718799 6853 meta_cache.cc:302] tablet e0098eb92f744d569eba19170c4d93ee: replica edc651f54a1b46abadfa249908724219 (127.6.177.65:45919) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:48.924607 6853 meta_cache.cc:1510] marking tablet server edc651f54a1b46abadfa249908724219 (127.6.177.65:45919) as failed
I20250114 20:57:49.329577 6853 meta_cache.cc:1510] marking tablet server edc651f54a1b46abadfa249908724219 (127.6.177.65:45919) as failed
I20250114 20:57:49.935564 6853 meta_cache.cc:1510] marking tablet server edc651f54a1b46abadfa249908724219 (127.6.177.65:45919) as failed
W20250114 20:57:49.935835 6853 meta_cache.cc:302] tablet e0098eb92f744d569eba19170c4d93ee: replica edc651f54a1b46abadfa249908724219 (127.6.177.65:45919) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:50.030680 9832 raft_consensus.cc:491] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edc651f54a1b46abadfa249908724219)
I20250114 20:57:50.031137 9832 raft_consensus.cc:513] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:50.032701 9832 leader_election.cc:290] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66:41245), edc651f54a1b46abadfa249908724219 (127.6.177.65:45919)
W20250114 20:57:50.036794 9727 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
W20250114 20:57:50.040086 9727 leader_election.cc:336] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:50.044668 9688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bd9daba286143f5907a31745a4752c1" candidate_uuid: "a9bb7da46d7243619da94ff625f30a38" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "447a15383f2c4d6cbf886e27398e14c5" is_pre_election: true
I20250114 20:57:50.045689 9725 leader_election.cc:304] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9bb7da46d7243619da94ff625f30a38; no voters: 447a15383f2c4d6cbf886e27398e14c5, edc651f54a1b46abadfa249908724219
I20250114 20:57:50.046202 9832 raft_consensus.cc:2743] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250114 20:57:50.084735 9832 raft_consensus.cc:491] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edc651f54a1b46abadfa249908724219)
I20250114 20:57:50.085050 9832 raft_consensus.cc:513] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:50.086565 9832 leader_election.cc:290] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edc651f54a1b46abadfa249908724219 (127.6.177.65:45919), 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66:41245)
I20250114 20:57:50.087424 9688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0098eb92f744d569eba19170c4d93ee" candidate_uuid: "a9bb7da46d7243619da94ff625f30a38" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "447a15383f2c4d6cbf886e27398e14c5" is_pre_election: true
W20250114 20:57:50.089679 9727 leader_election.cc:336] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:50.089695 9837 raft_consensus.cc:491] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edc651f54a1b46abadfa249908724219)
I20250114 20:57:50.090005 9727 leader_election.cc:304] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9bb7da46d7243619da94ff625f30a38; no voters: 447a15383f2c4d6cbf886e27398e14c5, edc651f54a1b46abadfa249908724219
I20250114 20:57:50.090142 9837 raft_consensus.cc:513] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:50.090608 9832 raft_consensus.cc:2743] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250114 20:57:50.092078 9837 leader_election.cc:290] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025), edc651f54a1b46abadfa249908724219 (127.6.177.65:45919)
W20250114 20:57:50.098049 9646 leader_election.cc:336] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:50.102823 9768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bd9daba286143f5907a31745a4752c1" candidate_uuid: "447a15383f2c4d6cbf886e27398e14c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38" is_pre_election: true
I20250114 20:57:50.103260 9768 raft_consensus.cc:2463] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 447a15383f2c4d6cbf886e27398e14c5 in term 1.
I20250114 20:57:50.103915 9645 leader_election.cc:304] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 447a15383f2c4d6cbf886e27398e14c5, a9bb7da46d7243619da94ff625f30a38; no voters: edc651f54a1b46abadfa249908724219
I20250114 20:57:50.104387 9837 raft_consensus.cc:2798] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250114 20:57:50.104600 9837 raft_consensus.cc:491] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edc651f54a1b46abadfa249908724219)
I20250114 20:57:50.104807 9837 raft_consensus.cc:3054] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Advancing to term 2
I20250114 20:57:50.108906 9837 raft_consensus.cc:513] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:50.110163 9837 leader_election.cc:290] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 election: Requested vote from peers a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025), edc651f54a1b46abadfa249908724219 (127.6.177.65:45919)
I20250114 20:57:50.110673 9837 raft_consensus.cc:491] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edc651f54a1b46abadfa249908724219)
I20250114 20:57:50.111174 9837 raft_consensus.cc:513] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:50.113004 9768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bd9daba286143f5907a31745a4752c1" candidate_uuid: "447a15383f2c4d6cbf886e27398e14c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38"
I20250114 20:57:50.113512 9768 raft_consensus.cc:3054] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Advancing to term 2
I20250114 20:57:50.114006 9837 leader_election.cc:290] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edc651f54a1b46abadfa249908724219 (127.6.177.65:45919), a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025)
I20250114 20:57:50.115185 9767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0098eb92f744d569eba19170c4d93ee" candidate_uuid: "447a15383f2c4d6cbf886e27398e14c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38" is_pre_election: true
I20250114 20:57:50.115809 9767 raft_consensus.cc:2463] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 447a15383f2c4d6cbf886e27398e14c5 in term 1.
I20250114 20:57:50.116703 9645 leader_election.cc:304] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447a15383f2c4d6cbf886e27398e14c5, a9bb7da46d7243619da94ff625f30a38; no voters:
I20250114 20:57:50.117419 9837 raft_consensus.cc:2798] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250114 20:57:50.117789 9837 raft_consensus.cc:491] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader edc651f54a1b46abadfa249908724219)
W20250114 20:57:50.118117 9646 leader_election.cc:336] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:50.118184 9837 raft_consensus.cc:3054] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 1 FOLLOWER]: Advancing to term 2
W20250114 20:57:50.118880 9646 leader_election.cc:336] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:50.121446 9768 raft_consensus.cc:2463] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 447a15383f2c4d6cbf886e27398e14c5 in term 2.
I20250114 20:57:50.122387 9645 leader_election.cc:304] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 447a15383f2c4d6cbf886e27398e14c5, a9bb7da46d7243619da94ff625f30a38; no voters: edc651f54a1b46abadfa249908724219
I20250114 20:57:50.123013 9842 raft_consensus.cc:2798] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250114 20:57:50.124105 9842 raft_consensus.cc:695] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 2 LEADER]: Becoming Leader. State: Replica: 447a15383f2c4d6cbf886e27398e14c5, State: Running, Role: LEADER
I20250114 20:57:50.124233 9837 raft_consensus.cc:513] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:50.124830 9842 consensus_queue.cc:237] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } }
I20250114 20:57:50.125875 9837 leader_election.cc:290] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 election: Requested vote from peers edc651f54a1b46abadfa249908724219 (127.6.177.65:45919), a9bb7da46d7243619da94ff625f30a38 (127.6.177.67:42025)
I20250114 20:57:50.127022 9768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0098eb92f744d569eba19170c4d93ee" candidate_uuid: "447a15383f2c4d6cbf886e27398e14c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9bb7da46d7243619da94ff625f30a38"
I20250114 20:57:50.127606 9768 raft_consensus.cc:3054] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 1 FOLLOWER]: Advancing to term 2
W20250114 20:57:50.129638 9646 leader_election.cc:336] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111)
I20250114 20:57:50.131995 9468 catalog_manager.cc:5526] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 reported cstate change: term changed from 1 to 2, leader changed from edc651f54a1b46abadfa249908724219 (127.6.177.65) to 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66). New cstate: current_term: 2 leader_uuid: "447a15383f2c4d6cbf886e27398e14c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } health_report { overall_health: UNKNOWN } } }
I20250114 20:57:50.132385 9768 raft_consensus.cc:2463] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 447a15383f2c4d6cbf886e27398e14c5 in term 2.
I20250114 20:57:50.133116 9645 leader_election.cc:304] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 447a15383f2c4d6cbf886e27398e14c5, a9bb7da46d7243619da94ff625f30a38; no voters: edc651f54a1b46abadfa249908724219
I20250114 20:57:50.133709 9842 raft_consensus.cc:2798] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 2 FOLLOWER]: Leader election won for term 2
I20250114 20:57:50.134011 9842 raft_consensus.cc:695] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 2 LEADER]: Becoming Leader. State: Replica: 447a15383f2c4d6cbf886e27398e14c5, State: Running, Role: LEADER
I20250114 20:57:50.134575 9842 consensus_queue.cc:237] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } }
I20250114 20:57:50.144824 9468 catalog_manager.cc:5526] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 reported cstate change: term changed from 1 to 2, leader changed from edc651f54a1b46abadfa249908724219 (127.6.177.65) to 447a15383f2c4d6cbf886e27398e14c5 (127.6.177.66). New cstate: current_term: 2 leader_uuid: "447a15383f2c4d6cbf886e27398e14c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edc651f54a1b46abadfa249908724219" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "447a15383f2c4d6cbf886e27398e14c5" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 41245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 } health_report { overall_health: UNKNOWN } } }
I20250114 20:57:50.556432 9768 raft_consensus.cc:1270] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Refusing update from remote peer 447a15383f2c4d6cbf886e27398e14c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250114 20:57:50.557376 9842 consensus_queue.cc:1035] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20250114 20:57:50.567833 9646 consensus_peers.cc:487] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 -> Peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Couldn't send request to peer edc651f54a1b46abadfa249908724219. Status: Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250114 20:57:50.630539 9768 raft_consensus.cc:1270] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Refusing update from remote peer 447a15383f2c4d6cbf886e27398e14c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250114 20:57:50.631682 9837 consensus_queue.cc:1035] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9bb7da46d7243619da94ff625f30a38" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20250114 20:57:50.641646 9646 consensus_peers.cc:487] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 -> Peer edc651f54a1b46abadfa249908724219 (127.6.177.65:45919): Couldn't send request to peer edc651f54a1b46abadfa249908724219. Status: Network error: Client connection negotiation failed: client connection to 127.6.177.65:45919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250114 20:57:50.741959 6853 meta_cache.cc:1510] marking tablet server edc651f54a1b46abadfa249908724219 (127.6.177.65:45919) as failed
W20250114 20:57:50.757972 6853 scanner-internal.cc:458] Time spent opening tablet: real 2.041s user 0.009s sys 0.000s
I20250114 20:57:50.763813 6853 client-test.cc:5875] Found expected number of rows: 100
I20250114 20:57:50.765143 6853 tablet_server.cc:178] TabletServer@127.6.177.66:0 shutting down...
I20250114 20:57:50.786969 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:50.787451 6853 tablet_replica.cc:331] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5: stopping tablet replica
I20250114 20:57:50.787884 6853 raft_consensus.cc:2238] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 2 LEADER]: Raft consensus shutting down.
I20250114 20:57:50.788517 6853 raft_consensus.cc:2267] T e0098eb92f744d569eba19170c4d93ee P 447a15383f2c4d6cbf886e27398e14c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:50.790100 6853 tablet_replica.cc:331] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5: stopping tablet replica
I20250114 20:57:50.790511 6853 raft_consensus.cc:2238] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 2 LEADER]: Raft consensus shutting down.
I20250114 20:57:50.791235 6853 raft_consensus.cc:2267] T 0bd9daba286143f5907a31745a4752c1 P 447a15383f2c4d6cbf886e27398e14c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:50.801440 6853 tablet_server.cc:195] TabletServer@127.6.177.66:0 shutdown complete.
I20250114 20:57:50.813311 6853 tablet_server.cc:178] TabletServer@127.6.177.67:0 shutting down...
I20250114 20:57:50.827232 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:50.827679 6853 tablet_replica.cc:331] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38: stopping tablet replica
I20250114 20:57:50.828096 6853 raft_consensus.cc:2238] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250114 20:57:50.828462 6853 raft_consensus.cc:2267] T e0098eb92f744d569eba19170c4d93ee P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:50.830372 6853 tablet_replica.cc:331] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38: stopping tablet replica
I20250114 20:57:50.830783 6853 raft_consensus.cc:2238] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250114 20:57:50.831207 6853 raft_consensus.cc:2267] T 0bd9daba286143f5907a31745a4752c1 P a9bb7da46d7243619da94ff625f30a38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:50.848505 6853 tablet_server.cc:195] TabletServer@127.6.177.67:0 shutdown complete.
I20250114 20:57:50.857869 6853 master.cc:537] Master@127.6.177.126:42971 shutting down...
I20250114 20:57:50.874532 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:50.874861 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:50.875124 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P dd80832178e14554a5b6020cfc93df0d: stopping tablet replica
I20250114 20:57:50.892757 6853 master.cc:559] Master@127.6.177.126:42971 shutdown complete.
[ OK ] ClientTest.TestReplicatedMultiTabletTableFailover (3587 ms)
[ RUN ] ClientTest.TestCreateTableWithInvalidEncodings
I20250114 20:57:50.919883 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:43347
I20250114 20:57:50.920718 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:50.925855 9857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:50.926600 9858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:50.927444 9860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:50.928306 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:50.928817 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:50.928961 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:50.929057 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888270929048 us; error 0 us; skew 500 ppm
I20250114 20:57:50.929399 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:50.931419 6853 webserver.cc:458] Webserver started at http://127.6.177.126:45993/ using document root <none> and password file <none>
I20250114 20:57:50.931813 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:50.931938 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:50.932106 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:50.932996 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "902ccf0f5ae04debacf87b0d5e6fba19"
format_stamp: "Formatted at 2025-01-14 20:57:50 on dist-test-slave-26qh"
I20250114 20:57:50.936740 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20250114 20:57:50.939431 9865 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:50.940016 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20250114 20:57:50.940235 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "902ccf0f5ae04debacf87b0d5e6fba19"
format_stamp: "Formatted at 2025-01-14 20:57:50 on dist-test-slave-26qh"
I20250114 20:57:50.940461 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:50.948773 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:50.949635 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:50.987083 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:43347
I20250114 20:57:50.987171 9926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:43347 every 8 connection(s)
I20250114 20:57:50.990341 9927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:50.999574 9927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19: Bootstrap starting.
I20250114 20:57:51.003507 9927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.006933 9927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19: No bootstrap required, opened a new log
I20250114 20:57:51.008647 9927 raft_consensus.cc:357] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" member_type: VOTER }
I20250114 20:57:51.009006 9927 raft_consensus.cc:383] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.009160 9927 raft_consensus.cc:738] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902ccf0f5ae04debacf87b0d5e6fba19, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.009557 9927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" member_type: VOTER }
I20250114 20:57:51.009898 9927 raft_consensus.cc:397] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.010079 9927 raft_consensus.cc:491] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.010278 9927 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.013752 9927 raft_consensus.cc:513] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" member_type: VOTER }
I20250114 20:57:51.014122 9927 leader_election.cc:304] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 902ccf0f5ae04debacf87b0d5e6fba19; no voters:
I20250114 20:57:51.015022 9927 leader_election.cc:290] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.015302 9930 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.016516 9930 raft_consensus.cc:695] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 1 LEADER]: Becoming Leader. State: Replica: 902ccf0f5ae04debacf87b0d5e6fba19, State: Running, Role: LEADER
I20250114 20:57:51.017040 9930 consensus_queue.cc:237] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" member_type: VOTER }
I20250114 20:57:51.017503 9927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:51.021654 9932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 902ccf0f5ae04debacf87b0d5e6fba19. Latest consensus state: current_term: 1 leader_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" member_type: VOTER } }
I20250114 20:57:51.021960 9931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902ccf0f5ae04debacf87b0d5e6fba19" member_type: VOTER } }
I20250114 20:57:51.022296 9932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:51.022544 9931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:51.024511 9938 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:51.031188 9938 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:51.032092 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:51.038069 9938 catalog_manager.cc:1348] Generated new cluster ID: a178172de2ef4ff4b404a3fc85414335
I20250114 20:57:51.038321 9938 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:51.056573 9938 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:51.057652 9938 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:51.079802 9938 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19: Generated new TSK 0
I20250114 20:57:51.080274 9938 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:51.097697 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:51.103679 9948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:51.104735 9949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:51.105628 9951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:51.106424 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:51.107213 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:51.107388 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:51.107546 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888271107530 us; error 0 us; skew 500 ppm
I20250114 20:57:51.107995 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:51.109937 6853 webserver.cc:458] Webserver started at http://127.6.177.65:32909/ using document root <none> and password file <none>
I20250114 20:57:51.110334 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:51.110493 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:51.110742 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:51.111804 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "4e042e13c88f4b47afcbcf77d4bae493"
format_stamp: "Formatted at 2025-01-14 20:57:51 on dist-test-slave-26qh"
I20250114 20:57:51.115485 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:57:51.118316 9956 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:51.119009 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:57:51.119339 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "4e042e13c88f4b47afcbcf77d4bae493"
format_stamp: "Formatted at 2025-01-14 20:57:51 on dist-test-slave-26qh"
I20250114 20:57:51.119668 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestCreateTableWithInvalidEncodings.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:51.149456 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:51.150318 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:51.154556 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:51.154865 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:51.155213 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:51.155458 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:51.202358 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:33685
I20250114 20:57:51.202409 10026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:33685 every 8 connection(s)
I20250114 20:57:51.206257 10027 heartbeater.cc:346] Connected to a master server at 127.6.177.126:43347
I20250114 20:57:51.206568 10027 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:51.207257 10027 heartbeater.cc:510] Master 127.6.177.126:43347 requested a full tablet report, sending...
I20250114 20:57:51.208854 9882 ts_manager.cc:194] Registered new tserver with Master: 4e042e13c88f4b47afcbcf77d4bae493 (127.6.177.65:33685)
I20250114 20:57:51.208941 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003680161s
I20250114 20:57:51.210542 9882 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38266
I20250114 20:57:51.223094 10027 heartbeater.cc:502] Master 127.6.177.126:43347 was elected leader, sending a full tablet report...
I20250114 20:57:51.232692 9882 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38282:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:51.261507 9992 tablet_service.cc:1467] Processing CreateTablet for tablet 2b6dff5a57bd494089014215480aec3c (DEFAULT_TABLE table=client-testtb [id=e592b111cdd04b1bbee626cfecdf08a4]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:51.261710 9991 tablet_service.cc:1467] Processing CreateTablet for tablet 4a6baac171da46259eb57750ce004278 (DEFAULT_TABLE table=client-testtb [id=e592b111cdd04b1bbee626cfecdf08a4]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:51.262766 9992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b6dff5a57bd494089014215480aec3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.263346 9991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6baac171da46259eb57750ce004278. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.277344 10037 tablet_bootstrap.cc:492] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493: Bootstrap starting.
I20250114 20:57:51.281090 10037 tablet_bootstrap.cc:654] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.284622 10037 tablet_bootstrap.cc:492] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493: No bootstrap required, opened a new log
I20250114 20:57:51.284920 10037 ts_tablet_manager.cc:1397] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20250114 20:57:51.286696 10037 raft_consensus.cc:357] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.287258 10037 raft_consensus.cc:383] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.287575 10037 raft_consensus.cc:738] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e042e13c88f4b47afcbcf77d4bae493, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.288097 10037 consensus_queue.cc:260] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.288559 10037 raft_consensus.cc:397] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.288760 10037 raft_consensus.cc:491] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.288940 10037 raft_consensus.cc:3054] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.293015 10037 raft_consensus.cc:513] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.293450 10037 leader_election.cc:304] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e042e13c88f4b47afcbcf77d4bae493; no voters:
I20250114 20:57:51.294387 10037 leader_election.cc:290] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.294687 10039 raft_consensus.cc:2798] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.296518 10039 raft_consensus.cc:695] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 LEADER]: Becoming Leader. State: Replica: 4e042e13c88f4b47afcbcf77d4bae493, State: Running, Role: LEADER
I20250114 20:57:51.296586 10037 ts_tablet_manager.cc:1428] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20250114 20:57:51.297202 10039 consensus_queue.cc:237] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.297444 10037 tablet_bootstrap.cc:492] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493: Bootstrap starting.
I20250114 20:57:51.303251 10037 tablet_bootstrap.cc:654] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.305068 9881 catalog_manager.cc:5526] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e042e13c88f4b47afcbcf77d4bae493 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "4e042e13c88f4b47afcbcf77d4bae493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:51.308022 10037 tablet_bootstrap.cc:492] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493: No bootstrap required, opened a new log
I20250114 20:57:51.308458 10037 ts_tablet_manager.cc:1397] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20250114 20:57:51.310753 10037 raft_consensus.cc:357] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.311167 10037 raft_consensus.cc:383] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.311363 10037 raft_consensus.cc:738] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e042e13c88f4b47afcbcf77d4bae493, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.311890 10037 consensus_queue.cc:260] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.312290 10037 raft_consensus.cc:397] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.312541 10037 raft_consensus.cc:491] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.312773 10037 raft_consensus.cc:3054] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.316756 10037 raft_consensus.cc:513] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.317258 10037 leader_election.cc:304] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e042e13c88f4b47afcbcf77d4bae493; no voters:
I20250114 20:57:51.317653 10037 leader_election.cc:290] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.317775 10039 raft_consensus.cc:2798] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.318241 10039 raft_consensus.cc:695] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 LEADER]: Becoming Leader. State: Replica: 4e042e13c88f4b47afcbcf77d4bae493, State: Running, Role: LEADER
I20250114 20:57:51.318828 10039 consensus_queue.cc:237] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } }
I20250114 20:57:51.319082 10037 ts_tablet_manager.cc:1428] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493: Time spent starting tablet: real 0.010s user 0.004s sys 0.003s
I20250114 20:57:51.323483 9881 catalog_manager.cc:5526] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e042e13c88f4b47afcbcf77d4bae493 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "4e042e13c88f4b47afcbcf77d4bae493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e042e13c88f4b47afcbcf77d4bae493" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 33685 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:51.342969 9881 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38282:
name: "foobar"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: DICT_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:51.345767 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:51.361387 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:51.362022 6853 tablet_replica.cc:331] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493: stopping tablet replica
I20250114 20:57:51.362600 6853 raft_consensus.cc:2238] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:51.362915 6853 raft_consensus.cc:2267] T 2b6dff5a57bd494089014215480aec3c P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:51.364511 6853 tablet_replica.cc:331] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493: stopping tablet replica
I20250114 20:57:51.364930 6853 raft_consensus.cc:2238] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:51.365262 6853 raft_consensus.cc:2267] T 4a6baac171da46259eb57750ce004278 P 4e042e13c88f4b47afcbcf77d4bae493 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:51.383175 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:51.391559 6853 master.cc:537] Master@127.6.177.126:43347 shutting down...
I20250114 20:57:51.404786 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:51.405165 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:51.405510 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 902ccf0f5ae04debacf87b0d5e6fba19: stopping tablet replica
I20250114 20:57:51.423722 6853 master.cc:559] Master@127.6.177.126:43347 shutdown complete.
[ OK ] ClientTest.TestCreateTableWithInvalidEncodings (522 ms)
[ RUN ] ClientTest.TestReadAtSnapshotNoTimestampSet
I20250114 20:57:51.441988 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:33341
I20250114 20:57:51.442754 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:51.447610 10046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:51.448434 10047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:51.449211 10049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:51.449990 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:51.450479 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:51.450659 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:51.450778 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888271450767 us; error 0 us; skew 500 ppm
I20250114 20:57:51.451248 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:51.453100 6853 webserver.cc:458] Webserver started at http://127.6.177.126:35049/ using document root <none> and password file <none>
I20250114 20:57:51.453433 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:51.453552 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:51.453712 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:51.454485 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "7d38cad5da744ace91ca2cfab61b8b08"
format_stamp: "Formatted at 2025-01-14 20:57:51 on dist-test-slave-26qh"
I20250114 20:57:51.457851 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:57:51.460475 10054 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:51.461143 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:57:51.461381 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "7d38cad5da744ace91ca2cfab61b8b08"
format_stamp: "Formatted at 2025-01-14 20:57:51 on dist-test-slave-26qh"
I20250114 20:57:51.461632 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:51.481003 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:51.481853 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:51.516767 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:33341
I20250114 20:57:51.516852 10115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:33341 every 8 connection(s)
I20250114 20:57:51.520067 10116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.528942 10116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08: Bootstrap starting.
I20250114 20:57:51.532647 10116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.535984 10116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08: No bootstrap required, opened a new log
I20250114 20:57:51.537637 10116 raft_consensus.cc:357] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d38cad5da744ace91ca2cfab61b8b08" member_type: VOTER }
I20250114 20:57:51.537984 10116 raft_consensus.cc:383] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.538203 10116 raft_consensus.cc:738] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d38cad5da744ace91ca2cfab61b8b08, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.538717 10116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d38cad5da744ace91ca2cfab61b8b08" member_type: VOTER }
I20250114 20:57:51.539142 10116 raft_consensus.cc:397] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.539341 10116 raft_consensus.cc:491] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.539587 10116 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.543540 10116 raft_consensus.cc:513] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d38cad5da744ace91ca2cfab61b8b08" member_type: VOTER }
I20250114 20:57:51.543944 10116 leader_election.cc:304] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d38cad5da744ace91ca2cfab61b8b08; no voters:
I20250114 20:57:51.544811 10116 leader_election.cc:290] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.545044 10119 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.546128 10119 raft_consensus.cc:695] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 1 LEADER]: Becoming Leader. State: Replica: 7d38cad5da744ace91ca2cfab61b8b08, State: Running, Role: LEADER
I20250114 20:57:51.546730 10119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d38cad5da744ace91ca2cfab61b8b08" member_type: VOTER }
I20250114 20:57:51.547289 10116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:51.549149 10120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d38cad5da744ace91ca2cfab61b8b08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d38cad5da744ace91ca2cfab61b8b08" member_type: VOTER } }
I20250114 20:57:51.549186 10121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d38cad5da744ace91ca2cfab61b8b08. Latest consensus state: current_term: 1 leader_uuid: "7d38cad5da744ace91ca2cfab61b8b08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d38cad5da744ace91ca2cfab61b8b08" member_type: VOTER } }
I20250114 20:57:51.549878 10120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:51.549867 10121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:51.552402 10126 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:51.559449 10126 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:51.560279 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:51.566593 10126 catalog_manager.cc:1348] Generated new cluster ID: b11d6c303b214b1aa96a8fa320e18583
I20250114 20:57:51.566777 10126 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:51.578658 10126 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:51.579736 10126 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:51.593595 10126 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08: Generated new TSK 0
I20250114 20:57:51.594089 10126 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:51.626197 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:51.631592 10137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:51.632469 10138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:51.633443 6853 server_base.cc:1034] running on GCE node
W20250114 20:57:51.634167 10140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:51.634837 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:51.635020 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:51.635192 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888271635176 us; error 0 us; skew 500 ppm
I20250114 20:57:51.635627 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:51.637428 6853 webserver.cc:458] Webserver started at http://127.6.177.65:38781/ using document root <none> and password file <none>
I20250114 20:57:51.637864 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:51.638044 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:51.638270 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:51.639292 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "5c1bd788cdb244dfa8af39c6c1345ac1"
format_stamp: "Formatted at 2025-01-14 20:57:51 on dist-test-slave-26qh"
I20250114 20:57:51.642966 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:57:51.645537 10145 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:51.646100 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20250114 20:57:51.646313 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "5c1bd788cdb244dfa8af39c6c1345ac1"
format_stamp: "Formatted at 2025-01-14 20:57:51 on dist-test-slave-26qh"
I20250114 20:57:51.646526 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestReadAtSnapshotNoTimestampSet.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:51.661871 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:51.662621 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:51.666539 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:51.666847 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:51.667178 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:51.667416 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:51.708148 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:38977
I20250114 20:57:51.708222 10215 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:38977 every 8 connection(s)
I20250114 20:57:51.711771 10216 heartbeater.cc:346] Connected to a master server at 127.6.177.126:33341
I20250114 20:57:51.712103 10216 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:51.712633 10216 heartbeater.cc:510] Master 127.6.177.126:33341 requested a full tablet report, sending...
I20250114 20:57:51.714125 10071 ts_manager.cc:194] Registered new tserver with Master: 5c1bd788cdb244dfa8af39c6c1345ac1 (127.6.177.65:38977)
I20250114 20:57:51.714442 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003588762s
I20250114 20:57:51.715591 10071 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59156
I20250114 20:57:51.727478 10216 heartbeater.cc:502] Master 127.6.177.126:33341 was elected leader, sending a full tablet report...
I20250114 20:57:51.731781 10071 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59174:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:51.759485 10181 tablet_service.cc:1467] Processing CreateTablet for tablet 0ed9382b3d9e4ebc9428e54f8685e6e7 (DEFAULT_TABLE table=client-testtb [id=d50462f271cf4d6eae5309031bb18ebd]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:51.759660 10180 tablet_service.cc:1467] Processing CreateTablet for tablet fced29a154d94bee922d360c9dc2f7db (DEFAULT_TABLE table=client-testtb [id=d50462f271cf4d6eae5309031bb18ebd]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:51.760288 10181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed9382b3d9e4ebc9428e54f8685e6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.760797 10180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fced29a154d94bee922d360c9dc2f7db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.771432 10226 tablet_bootstrap.cc:492] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1: Bootstrap starting.
I20250114 20:57:51.774664 10226 tablet_bootstrap.cc:654] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.777820 10226 tablet_bootstrap.cc:492] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1: No bootstrap required, opened a new log
I20250114 20:57:51.778110 10226 ts_tablet_manager.cc:1397] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20250114 20:57:51.779731 10226 raft_consensus.cc:357] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.780084 10226 raft_consensus.cc:383] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.780278 10226 raft_consensus.cc:738] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.780778 10226 consensus_queue.cc:260] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.781236 10226 raft_consensus.cc:397] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.781450 10226 raft_consensus.cc:491] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.781687 10226 raft_consensus.cc:3054] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.785308 10226 raft_consensus.cc:513] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.785801 10226 leader_election.cc:304] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c1bd788cdb244dfa8af39c6c1345ac1; no voters:
I20250114 20:57:51.786768 10226 leader_election.cc:290] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.787022 10228 raft_consensus.cc:2798] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.788553 10228 raft_consensus.cc:695] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Running, Role: LEADER
I20250114 20:57:51.788862 10226 ts_tablet_manager.cc:1428] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20250114 20:57:51.788986 10228 consensus_queue.cc:237] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.789461 10226 tablet_bootstrap.cc:492] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1: Bootstrap starting.
I20250114 20:57:51.794556 10226 tablet_bootstrap.cc:654] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.794178 10071 catalog_manager.cc:5526] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c1bd788cdb244dfa8af39c6c1345ac1 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:51.798857 10226 tablet_bootstrap.cc:492] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1: No bootstrap required, opened a new log
I20250114 20:57:51.799188 10226 ts_tablet_manager.cc:1397] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20250114 20:57:51.801106 10226 raft_consensus.cc:357] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.801509 10226 raft_consensus.cc:383] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.801743 10226 raft_consensus.cc:738] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.802238 10226 consensus_queue.cc:260] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.802727 10226 raft_consensus.cc:397] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.802994 10226 raft_consensus.cc:491] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.803294 10226 raft_consensus.cc:3054] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.807224 10226 raft_consensus.cc:513] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.807744 10226 leader_election.cc:304] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c1bd788cdb244dfa8af39c6c1345ac1; no voters:
I20250114 20:57:51.808198 10226 leader_election.cc:290] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.808326 10228 raft_consensus.cc:2798] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.808738 10228 raft_consensus.cc:695] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Running, Role: LEADER
I20250114 20:57:51.809350 10228 consensus_queue.cc:237] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.809813 10226 ts_tablet_manager.cc:1428] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent starting tablet: real 0.010s user 0.005s sys 0.003s
I20250114 20:57:51.814121 10071 catalog_manager.cc:5526] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c1bd788cdb244dfa8af39c6c1345ac1 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:51.839504 10071 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59174:
name: "test_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\002\000\000\000\004\001\000\004\000\000\000""\004\001\000\002\000\000\000\004\001\000\004\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:51.858611 10181 tablet_service.cc:1467] Processing CreateTablet for tablet 75c18c9b406f4bb8b10f017b992ad740 (DEFAULT_TABLE table=test_table [id=b8e55cc9ae824053bc57cbe1d6560841]), partition=RANGE (key) PARTITION VALUES < 2
I20250114 20:57:51.859513 10181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c18c9b406f4bb8b10f017b992ad740. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.859906 10180 tablet_service.cc:1467] Processing CreateTablet for tablet 52070cb0a586441fbc54dba89eb90e0d (DEFAULT_TABLE table=test_table [id=b8e55cc9ae824053bc57cbe1d6560841]), partition=RANGE (key) PARTITION 2 <= VALUES < 4
I20250114 20:57:51.860466 10179 tablet_service.cc:1467] Processing CreateTablet for tablet 2c56df8a5ab645ddbb9f8c58cd0534c1 (DEFAULT_TABLE table=test_table [id=b8e55cc9ae824053bc57cbe1d6560841]), partition=RANGE (key) PARTITION 4 <= VALUES
I20250114 20:57:51.860949 10180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52070cb0a586441fbc54dba89eb90e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.861625 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c56df8a5ab645ddbb9f8c58cd0534c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:51.873106 10226 tablet_bootstrap.cc:492] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1: Bootstrap starting.
I20250114 20:57:51.877601 10226 tablet_bootstrap.cc:654] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.881843 10226 tablet_bootstrap.cc:492] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1: No bootstrap required, opened a new log
I20250114 20:57:51.882162 10226 ts_tablet_manager.cc:1397] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20250114 20:57:51.883965 10226 raft_consensus.cc:357] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.884316 10226 raft_consensus.cc:383] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.884501 10226 raft_consensus.cc:738] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.884984 10226 consensus_queue.cc:260] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.885480 10226 raft_consensus.cc:397] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.885704 10226 raft_consensus.cc:491] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.886003 10226 raft_consensus.cc:3054] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.889608 10226 raft_consensus.cc:513] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.890110 10226 leader_election.cc:304] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c1bd788cdb244dfa8af39c6c1345ac1; no voters:
I20250114 20:57:51.890570 10226 leader_election.cc:290] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.890713 10228 raft_consensus.cc:2798] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.891194 10228 raft_consensus.cc:695] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Running, Role: LEADER
I20250114 20:57:51.891880 10228 consensus_queue.cc:237] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.892347 10226 ts_tablet_manager.cc:1428] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20250114 20:57:51.893072 10226 tablet_bootstrap.cc:492] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1: Bootstrap starting.
I20250114 20:57:51.897812 10226 tablet_bootstrap.cc:654] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.897552 10070 catalog_manager.cc:5526] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c1bd788cdb244dfa8af39c6c1345ac1 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:51.901918 10226 tablet_bootstrap.cc:492] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1: No bootstrap required, opened a new log
I20250114 20:57:51.902297 10226 ts_tablet_manager.cc:1397] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20250114 20:57:51.904206 10226 raft_consensus.cc:357] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.904549 10226 raft_consensus.cc:383] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.904752 10226 raft_consensus.cc:738] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.905138 10226 consensus_queue.cc:260] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.905510 10226 raft_consensus.cc:397] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.905699 10226 raft_consensus.cc:491] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.905911 10226 raft_consensus.cc:3054] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.909915 10226 raft_consensus.cc:513] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.910346 10226 leader_election.cc:304] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c1bd788cdb244dfa8af39c6c1345ac1; no voters:
I20250114 20:57:51.910751 10226 leader_election.cc:290] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.910907 10228 raft_consensus.cc:2798] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.911621 10228 raft_consensus.cc:695] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Running, Role: LEADER
I20250114 20:57:51.912250 10228 consensus_queue.cc:237] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.912549 10226 ts_tablet_manager.cc:1428] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20250114 20:57:51.913347 10226 tablet_bootstrap.cc:492] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1: Bootstrap starting.
I20250114 20:57:51.918303 10070 catalog_manager.cc:5526] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c1bd788cdb244dfa8af39c6c1345ac1 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:51.918879 10226 tablet_bootstrap.cc:654] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:51.923406 10226 tablet_bootstrap.cc:492] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1: No bootstrap required, opened a new log
I20250114 20:57:51.923705 10226 ts_tablet_manager.cc:1397] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20250114 20:57:51.925534 10226 raft_consensus.cc:357] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.925899 10226 raft_consensus.cc:383] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:51.926107 10226 raft_consensus.cc:738] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Initialized, Role: FOLLOWER
I20250114 20:57:51.926611 10226 consensus_queue.cc:260] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.927212 10226 raft_consensus.cc:397] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:51.927518 10226 raft_consensus.cc:491] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:51.927838 10226 raft_consensus.cc:3054] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:51.932143 10226 raft_consensus.cc:513] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.932557 10226 leader_election.cc:304] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c1bd788cdb244dfa8af39c6c1345ac1; no voters:
I20250114 20:57:51.932914 10226 leader_election.cc:290] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:51.933079 10228 raft_consensus.cc:2798] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:51.933737 10228 raft_consensus.cc:695] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 5c1bd788cdb244dfa8af39c6c1345ac1, State: Running, Role: LEADER
I20250114 20:57:51.934600 10226 ts_tablet_manager.cc:1428] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1: Time spent starting tablet: real 0.011s user 0.001s sys 0.007s
I20250114 20:57:51.934362 10228 consensus_queue.cc:237] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } }
I20250114 20:57:51.939467 10071 catalog_manager.cc:5526] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c1bd788cdb244dfa8af39c6c1345ac1 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c1bd788cdb244dfa8af39c6c1345ac1" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38977 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:52.020426 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:52.038637 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:52.039367 6853 tablet_replica.cc:331] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1: stopping tablet replica
I20250114 20:57:52.039844 6853 raft_consensus.cc:2238] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.040184 6853 raft_consensus.cc:2267] T 2c56df8a5ab645ddbb9f8c58cd0534c1 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.042174 6853 tablet_replica.cc:331] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1: stopping tablet replica
I20250114 20:57:52.042659 6853 raft_consensus.cc:2238] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.042990 6853 raft_consensus.cc:2267] T 75c18c9b406f4bb8b10f017b992ad740 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.044886 6853 tablet_replica.cc:331] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1: stopping tablet replica
I20250114 20:57:52.045377 6853 raft_consensus.cc:2238] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.045655 6853 raft_consensus.cc:2267] T fced29a154d94bee922d360c9dc2f7db P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.047260 6853 tablet_replica.cc:331] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1: stopping tablet replica
I20250114 20:57:52.047672 6853 raft_consensus.cc:2238] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.047981 6853 raft_consensus.cc:2267] T 52070cb0a586441fbc54dba89eb90e0d P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.049628 6853 tablet_replica.cc:331] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1: stopping tablet replica
I20250114 20:57:52.049964 6853 raft_consensus.cc:2238] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.050251 6853 raft_consensus.cc:2267] T 0ed9382b3d9e4ebc9428e54f8685e6e7 P 5c1bd788cdb244dfa8af39c6c1345ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.072824 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:52.084117 6853 master.cc:537] Master@127.6.177.126:33341 shutting down...
I20250114 20:57:52.098351 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.098773 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.098984 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 7d38cad5da744ace91ca2cfab61b8b08: stopping tablet replica
I20250114 20:57:52.115939 6853 master.cc:559] Master@127.6.177.126:33341 shutdown complete.
[ OK ] ClientTest.TestReadAtSnapshotNoTimestampSet (693 ms)
[ RUN ] ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus
I20250114 20:57:52.135425 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:40385
I20250114 20:57:52.136251 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:52.141171 10247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:52.142130 10248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:52.143044 10250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:52.143843 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:52.144731 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:52.144886 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:52.145009 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888272144995 us; error 0 us; skew 500 ppm
I20250114 20:57:52.145392 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:52.147275 6853 webserver.cc:458] Webserver started at http://127.6.177.126:46877/ using document root <none> and password file <none>
I20250114 20:57:52.147634 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:52.147786 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:52.147989 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:52.148835 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "8b6eb10dfe3d4fed8417095aa6b7227f"
format_stamp: "Formatted at 2025-01-14 20:57:52 on dist-test-slave-26qh"
I20250114 20:57:52.152392 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20250114 20:57:52.154757 10255 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:52.155393 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:52.155602 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "8b6eb10dfe3d4fed8417095aa6b7227f"
format_stamp: "Formatted at 2025-01-14 20:57:52 on dist-test-slave-26qh"
I20250114 20:57:52.155817 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:52.172190 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:52.172914 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:52.207508 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:40385
I20250114 20:57:52.207592 10316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:40385 every 8 connection(s)
I20250114 20:57:52.210752 10317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:52.219610 10317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f: Bootstrap starting.
I20250114 20:57:52.223232 10317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:52.226438 10317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f: No bootstrap required, opened a new log
I20250114 20:57:52.228082 10317 raft_consensus.cc:357] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" member_type: VOTER }
I20250114 20:57:52.228435 10317 raft_consensus.cc:383] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:52.228637 10317 raft_consensus.cc:738] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6eb10dfe3d4fed8417095aa6b7227f, State: Initialized, Role: FOLLOWER
I20250114 20:57:52.229102 10317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" member_type: VOTER }
I20250114 20:57:52.229485 10317 raft_consensus.cc:397] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:52.229683 10317 raft_consensus.cc:491] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:52.229928 10317 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:52.233489 10317 raft_consensus.cc:513] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" member_type: VOTER }
I20250114 20:57:52.233906 10317 leader_election.cc:304] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b6eb10dfe3d4fed8417095aa6b7227f; no voters:
I20250114 20:57:52.234804 10317 leader_election.cc:290] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:52.235045 10320 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:52.236249 10320 raft_consensus.cc:695] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 1 LEADER]: Becoming Leader. State: Replica: 8b6eb10dfe3d4fed8417095aa6b7227f, State: Running, Role: LEADER
I20250114 20:57:52.236783 10320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" member_type: VOTER }
I20250114 20:57:52.237304 10317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:52.239280 10321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" member_type: VOTER } }
I20250114 20:57:52.239367 10322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b6eb10dfe3d4fed8417095aa6b7227f. Latest consensus state: current_term: 1 leader_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b6eb10dfe3d4fed8417095aa6b7227f" member_type: VOTER } }
I20250114 20:57:52.240013 10322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:52.240056 10321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:52.243122 10326 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:52.246858 10326 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:52.250783 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:52.254834 10326 catalog_manager.cc:1348] Generated new cluster ID: 1be4f306a92d4755ae10ea7bbf627815
I20250114 20:57:52.255095 10326 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:52.281639 10326 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:52.282666 10326 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:52.293666 10326 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f: Generated new TSK 0
I20250114 20:57:52.294126 10326 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:52.319464 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:52.325232 10338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:52.326069 10339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:52.327046 10341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:52.327778 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:52.328442 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:52.328608 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:52.328740 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888272328728 us; error 0 us; skew 500 ppm
I20250114 20:57:52.329159 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:52.331339 6853 webserver.cc:458] Webserver started at http://127.6.177.65:38215/ using document root <none> and password file <none>
I20250114 20:57:52.331765 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:52.331966 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:52.332175 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:52.333096 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "91e1589521c84711b05eab8485dceb88"
format_stamp: "Formatted at 2025-01-14 20:57:52 on dist-test-slave-26qh"
I20250114 20:57:52.336916 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20250114 20:57:52.339977 10346 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:52.340603 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:52.340873 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "91e1589521c84711b05eab8485dceb88"
format_stamp: "Formatted at 2025-01-14 20:57:52 on dist-test-slave-26qh"
I20250114 20:57:52.341125 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:52.354570 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:52.355453 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:52.360435 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:52.360718 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:52.360975 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:52.361122 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:52.402633 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:43017
I20250114 20:57:52.402709 10416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:43017 every 8 connection(s)
I20250114 20:57:52.406194 10417 heartbeater.cc:346] Connected to a master server at 127.6.177.126:40385
I20250114 20:57:52.406513 10417 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:52.407217 10417 heartbeater.cc:510] Master 127.6.177.126:40385 requested a full tablet report, sending...
I20250114 20:57:52.408785 10272 ts_manager.cc:194] Registered new tserver with Master: 91e1589521c84711b05eab8485dceb88 (127.6.177.65:43017)
I20250114 20:57:52.408926 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00359564s
I20250114 20:57:52.410328 10272 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37472
I20250114 20:57:52.422665 10417 heartbeater.cc:502] Master 127.6.177.126:40385 was elected leader, sending a full tablet report...
I20250114 20:57:52.429145 10272 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37500:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:52.455345 10382 tablet_service.cc:1467] Processing CreateTablet for tablet fbaf42d771224311a5f20496e2f43978 (DEFAULT_TABLE table=client-testtb [id=3cafe3e77ae84b8f9ac7c765bab77d8c]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:52.455593 10381 tablet_service.cc:1467] Processing CreateTablet for tablet c27fb17944014c14980021ef0f889458 (DEFAULT_TABLE table=client-testtb [id=3cafe3e77ae84b8f9ac7c765bab77d8c]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:52.456449 10382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbaf42d771224311a5f20496e2f43978. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:52.457042 10381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27fb17944014c14980021ef0f889458. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:52.468086 10427 tablet_bootstrap.cc:492] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88: Bootstrap starting.
I20250114 20:57:52.471736 10427 tablet_bootstrap.cc:654] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:52.475174 10427 tablet_bootstrap.cc:492] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88: No bootstrap required, opened a new log
I20250114 20:57:52.475509 10427 ts_tablet_manager.cc:1397] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20250114 20:57:52.477159 10427 raft_consensus.cc:357] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.477509 10427 raft_consensus.cc:383] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:52.477741 10427 raft_consensus.cc:738] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e1589521c84711b05eab8485dceb88, State: Initialized, Role: FOLLOWER
I20250114 20:57:52.478204 10427 consensus_queue.cc:260] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.478643 10427 raft_consensus.cc:397] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:52.478875 10427 raft_consensus.cc:491] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:52.479125 10427 raft_consensus.cc:3054] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:52.482988 10427 raft_consensus.cc:513] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.483497 10427 leader_election.cc:304] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91e1589521c84711b05eab8485dceb88; no voters:
I20250114 20:57:52.484395 10427 leader_election.cc:290] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:52.484642 10429 raft_consensus.cc:2798] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:52.486215 10427 ts_tablet_manager.cc:1428] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20250114 20:57:52.486318 10429 raft_consensus.cc:695] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 1 LEADER]: Becoming Leader. State: Replica: 91e1589521c84711b05eab8485dceb88, State: Running, Role: LEADER
I20250114 20:57:52.486802 10427 tablet_bootstrap.cc:492] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Bootstrap starting.
I20250114 20:57:52.486840 10429 consensus_queue.cc:237] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.491271 10427 tablet_bootstrap.cc:654] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:52.492321 10271 catalog_manager.cc:5526] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e1589521c84711b05eab8485dceb88 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "91e1589521c84711b05eab8485dceb88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:52.495023 10427 tablet_bootstrap.cc:492] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: No bootstrap required, opened a new log
I20250114 20:57:52.495357 10427 ts_tablet_manager.cc:1397] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20250114 20:57:52.496943 10427 raft_consensus.cc:357] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.497270 10427 raft_consensus.cc:383] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:52.497496 10427 raft_consensus.cc:738] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e1589521c84711b05eab8485dceb88, State: Initialized, Role: FOLLOWER
I20250114 20:57:52.498114 10427 consensus_queue.cc:260] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.498670 10427 raft_consensus.cc:397] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:52.498903 10427 raft_consensus.cc:491] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:52.499140 10427 raft_consensus.cc:3054] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:52.504419 10427 raft_consensus.cc:513] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.504833 10427 leader_election.cc:304] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91e1589521c84711b05eab8485dceb88; no voters:
I20250114 20:57:52.505214 10427 leader_election.cc:290] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:52.505328 10429 raft_consensus.cc:2798] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:52.505721 10429 raft_consensus.cc:695] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 LEADER]: Becoming Leader. State: Replica: 91e1589521c84711b05eab8485dceb88, State: Running, Role: LEADER
I20250114 20:57:52.506323 10429 consensus_queue.cc:237] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:52.506842 10427 ts_tablet_manager.cc:1428] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20250114 20:57:52.511358 10271 catalog_manager.cc:5526] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91e1589521c84711b05eab8485dceb88 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "91e1589521c84711b05eab8485dceb88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:52.521186 6853 test_util.cc:274] Using random seed: -796948534
I20250114 20:57:52.853927 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:52.876617 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:52.877171 6853 tablet_replica.cc:331] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: stopping tablet replica
I20250114 20:57:52.877600 6853 raft_consensus.cc:2238] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.877966 6853 raft_consensus.cc:2267] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.880023 6853 tablet_replica.cc:331] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88: stopping tablet replica
I20250114 20:57:52.880374 6853 raft_consensus.cc:2238] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:52.880702 6853 raft_consensus.cc:2267] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:52.899752 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:52.910562 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:52.916059 10439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:52.916705 10440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:52.917588 10442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:52.918444 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:52.919278 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:52.919441 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:52.919571 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888272919555 us; error 0 us; skew 500 ppm
I20250114 20:57:52.920059 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:52.922124 6853 webserver.cc:458] Webserver started at http://127.6.177.65:38215/ using document root <none> and password file <none>
I20250114 20:57:52.922508 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:52.922650 6853 fs_manager.cc:365] Using existing metadata directory in first data directory
I20250114 20:57:52.925702 6853 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:57:52.928386 10447 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:52.928987 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:57:52.929226 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "91e1589521c84711b05eab8485dceb88"
format_stamp: "Formatted at 2025-01-14 20:57:52 on dist-test-slave-26qh"
I20250114 20:57:52.929464 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:52.960227 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:52.961045 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:52.966369 10457 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20250114 20:57:52.978269 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (2 total tablets, 2 live tablets)
I20250114 20:57:52.978544 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.014s user 0.002s sys 0.000s
I20250114 20:57:52.978825 6853 ts_tablet_manager.cc:594] Registering tablets (0/2 complete)
I20250114 20:57:52.984040 10457 tablet_bootstrap.cc:492] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Bootstrap starting.
I20250114 20:57:52.988376 6853 ts_tablet_manager.cc:610] Registered 2 tablets
I20250114 20:57:52.988565 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.010s user 0.008s sys 0.000s
I20250114 20:57:53.002012 10457 tablet_bootstrap.cc:492] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=9 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250114 20:57:53.002660 10457 tablet_bootstrap.cc:492] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Bootstrap complete.
W20250114 20:57:53.002943 10457 log.cc:510] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Injecting 3000ms of latency in SegmentAllocator::Sync()
I20250114 20:57:53.027603 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:43017
I20250114 20:57:53.027683 10519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:43017 every 8 connection(s)
I20250114 20:57:53.031752 10520 heartbeater.cc:346] Connected to a master server at 127.6.177.126:40385
I20250114 20:57:53.032099 10520 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:53.032841 10520 heartbeater.cc:510] Master 127.6.177.126:40385 requested a full tablet report, sending...
I20250114 20:57:53.035454 10271 ts_manager.cc:194] Re-registered known tserver with Master: 91e1589521c84711b05eab8485dceb88 (127.6.177.65:43017)
I20250114 20:57:53.038060 10271 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37512
I20250114 20:57:53.050344 10520 heartbeater.cc:502] Master 127.6.177.126:40385 was elected leader, sending a full tablet report...
I20250114 20:57:54.247745 6853 scanner-internal.cc:172] Scan of tablet fbaf42d771224311a5f20496e2f43978 at 91e1589521c84711b05eab8485dceb88 (127.6.177.65:43017) deadline exceeded after 1.000s
W20250114 20:57:54.248220 6853 scanner-internal.cc:458] Time spent opening tablet: real 1.217s user 0.003s sys 0.000s
I20250114 20:57:54.255648 6853 tablet_server.cc:178] TabletServer@127.6.177.65:43017 shutting down...
I20250114 20:57:54.274166 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:56.003825 10457 ts_tablet_manager.cc:1397] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Time spent bootstrapping tablet: real 3.020s user 0.015s sys 0.004s
I20250114 20:57:56.005628 10457 raft_consensus.cc:357] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:56.006016 10457 raft_consensus.cc:738] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91e1589521c84711b05eab8485dceb88, State: Initialized, Role: FOLLOWER
I20250114 20:57:56.006544 10457 consensus_queue.cc:260] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:56.007011 10457 raft_consensus.cc:397] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:56.007241 10457 raft_consensus.cc:491] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:56.007457 10457 raft_consensus.cc:3054] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Advancing to term 2
I20250114 20:57:56.011713 10457 raft_consensus.cc:513] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:56.012195 10457 leader_election.cc:304] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91e1589521c84711b05eab8485dceb88; no voters:
I20250114 20:57:56.012926 10457 leader_election.cc:290] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [CANDIDATE]: Term 2 election: Requested vote from peers
I20250114 20:57:56.013185 10523 raft_consensus.cc:2798] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 2 FOLLOWER]: Leader election won for term 2
I20250114 20:57:56.014134 10523 raft_consensus.cc:695] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 2 LEADER]: Becoming Leader. State: Replica: 91e1589521c84711b05eab8485dceb88, State: Running, Role: LEADER
I20250114 20:57:56.014724 10457 ts_tablet_manager.cc:1428] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20250114 20:57:56.014715 10523 consensus_queue.cc:237] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91e1589521c84711b05eab8485dceb88" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43017 } }
I20250114 20:57:56.015873 6853 tablet_replica.cc:331] stopping tablet replica
I20250114 20:57:56.016140 6853 raft_consensus.cc:2238] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:57:56.016450 6853 raft_consensus.cc:2267] T c27fb17944014c14980021ef0f889458 P 91e1589521c84711b05eab8485dceb88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:56.016803 6853 tablet_replica.cc:331] stopping tablet replica
I20250114 20:57:56.017352 6853 raft_consensus.cc:2238] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 2 LEADER]: Raft consensus shutting down.
I20250114 20:57:56.018530 6853 raft_consensus.cc:2267] T fbaf42d771224311a5f20496e2f43978 P 91e1589521c84711b05eab8485dceb88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:56.035605 6853 tablet_server.cc:195] TabletServer@127.6.177.65:43017 shutdown complete.
I20250114 20:57:56.044981 6853 master.cc:537] Master@127.6.177.126:40385 shutting down...
I20250114 20:57:56.060256 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:56.060606 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:56.060833 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 8b6eb10dfe3d4fed8417095aa6b7227f: stopping tablet replica
I20250114 20:57:56.076530 6853 master.cc:559] Master@127.6.177.126:40385 shutdown complete.
[ OK ] ClientTest.TestLastErrorEmbeddedInScanTimeoutStatus (3958 ms)
[ RUN ] ClientTest.TestGetSecurityInfoFromMaster
I20250114 20:57:56.094189 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:38951
I20250114 20:57:56.094987 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:56.099941 10528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.100814 10529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.101647 10531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:56.102519 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:56.103314 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:56.103484 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:56.103611 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888276103597 us; error 0 us; skew 500 ppm
I20250114 20:57:56.104028 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:56.105954 6853 webserver.cc:458] Webserver started at http://127.6.177.126:44079/ using document root <none> and password file <none>
I20250114 20:57:56.106341 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:56.106483 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:56.106714 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:56.107750 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "ad63776f8dca44788587b291d6220758"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.111295 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:57:56.114054 10536 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:56.114683 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:56.115087 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "ad63776f8dca44788587b291d6220758"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.115377 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:56.126360 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:56.127244 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:56.163838 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:38951
I20250114 20:57:56.163929 10597 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:38951 every 8 connection(s)
I20250114 20:57:56.167109 10598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:56.175874 10598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758: Bootstrap starting.
I20250114 20:57:56.179553 10598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:56.182917 10598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758: No bootstrap required, opened a new log
I20250114 20:57:56.184476 10598 raft_consensus.cc:357] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad63776f8dca44788587b291d6220758" member_type: VOTER }
I20250114 20:57:56.184782 10598 raft_consensus.cc:383] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:56.184980 10598 raft_consensus.cc:738] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad63776f8dca44788587b291d6220758, State: Initialized, Role: FOLLOWER
I20250114 20:57:56.185424 10598 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad63776f8dca44788587b291d6220758" member_type: VOTER }
I20250114 20:57:56.185786 10598 raft_consensus.cc:397] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:56.185966 10598 raft_consensus.cc:491] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:56.186177 10598 raft_consensus.cc:3054] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:56.189574 10598 raft_consensus.cc:513] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad63776f8dca44788587b291d6220758" member_type: VOTER }
I20250114 20:57:56.190001 10598 leader_election.cc:304] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad63776f8dca44788587b291d6220758; no voters:
I20250114 20:57:56.190992 10598 leader_election.cc:290] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:56.191334 10601 raft_consensus.cc:2798] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:56.192575 10601 raft_consensus.cc:695] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 1 LEADER]: Becoming Leader. State: Replica: ad63776f8dca44788587b291d6220758, State: Running, Role: LEADER
I20250114 20:57:56.193084 10601 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad63776f8dca44788587b291d6220758" member_type: VOTER }
I20250114 20:57:56.193584 10598 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:56.195475 10603 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad63776f8dca44788587b291d6220758. Latest consensus state: current_term: 1 leader_uuid: "ad63776f8dca44788587b291d6220758" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad63776f8dca44788587b291d6220758" member_type: VOTER } }
I20250114 20:57:56.195561 10602 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad63776f8dca44788587b291d6220758" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad63776f8dca44788587b291d6220758" member_type: VOTER } }
I20250114 20:57:56.196146 10603 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:56.196843 10602 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:56.199133 10608 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:56.203179 10608 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:56.206802 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:56.210247 10608 catalog_manager.cc:1348] Generated new cluster ID: f0266e4527d040bbbf18a11e10a8869a
I20250114 20:57:56.210498 10608 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:56.222220 10608 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:56.223321 10608 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:56.234532 10608 catalog_manager.cc:5899] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758: Generated new TSK 0
I20250114 20:57:56.234997 10608 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:56.240769 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:56.246500 10619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.247300 10620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.248008 10622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:56.248783 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:56.249356 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:56.249521 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:56.249660 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888276249643 us; error 0 us; skew 500 ppm
I20250114 20:57:56.250118 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:56.256333 6853 webserver.cc:458] Webserver started at http://127.6.177.65:41985/ using document root <none> and password file <none>
I20250114 20:57:56.256712 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:56.256865 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:56.257095 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:56.258076 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "61ecc12ecdc44153b99d17525c506bcc"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.262074 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20250114 20:57:56.264911 10627 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:56.265542 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20250114 20:57:56.265770 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "61ecc12ecdc44153b99d17525c506bcc"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.266012 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestGetSecurityInfoFromMaster.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:56.276643 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:56.277462 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:56.281713 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:56.282043 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20250114 20:57:56.282385 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:56.282641 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:56.327311 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:46335
I20250114 20:57:56.327381 10697 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:46335 every 8 connection(s)
I20250114 20:57:56.331192 10698 heartbeater.cc:346] Connected to a master server at 127.6.177.126:38951
I20250114 20:57:56.331491 10698 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:56.332129 10698 heartbeater.cc:510] Master 127.6.177.126:38951 requested a full tablet report, sending...
I20250114 20:57:56.333607 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003679827s
I20250114 20:57:56.333626 10553 ts_manager.cc:194] Registered new tserver with Master: 61ecc12ecdc44153b99d17525c506bcc (127.6.177.65:46335)
I20250114 20:57:56.335372 10553 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50452
I20250114 20:57:56.347311 10698 heartbeater.cc:502] Master 127.6.177.126:38951 was elected leader, sending a full tablet report...
I20250114 20:57:56.351688 10553 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50462:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:56.379674 10663 tablet_service.cc:1467] Processing CreateTablet for tablet 449a809a0e0b49e0a70a93bd83d711bd (DEFAULT_TABLE table=client-testtb [id=56bf744caffd40979f60825b3b6de954]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:56.380015 10662 tablet_service.cc:1467] Processing CreateTablet for tablet 956d61feda064af9b484c6b47396a2b1 (DEFAULT_TABLE table=client-testtb [id=56bf744caffd40979f60825b3b6de954]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:56.380919 10663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449a809a0e0b49e0a70a93bd83d711bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:56.381588 10662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956d61feda064af9b484c6b47396a2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:56.395851 10708 tablet_bootstrap.cc:492] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc: Bootstrap starting.
I20250114 20:57:56.399642 10708 tablet_bootstrap.cc:654] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:56.403298 10708 tablet_bootstrap.cc:492] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc: No bootstrap required, opened a new log
I20250114 20:57:56.403599 10708 ts_tablet_manager.cc:1397] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20250114 20:57:56.405059 10708 raft_consensus.cc:357] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.405403 10708 raft_consensus.cc:383] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:56.405586 10708 raft_consensus.cc:738] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61ecc12ecdc44153b99d17525c506bcc, State: Initialized, Role: FOLLOWER
I20250114 20:57:56.405997 10708 consensus_queue.cc:260] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.406415 10708 raft_consensus.cc:397] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:56.406603 10708 raft_consensus.cc:491] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:56.406849 10708 raft_consensus.cc:3054] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:56.410494 10708 raft_consensus.cc:513] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.411075 10708 leader_election.cc:304] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61ecc12ecdc44153b99d17525c506bcc; no voters:
I20250114 20:57:56.412590 10708 leader_election.cc:290] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:56.412919 10710 raft_consensus.cc:2798] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:56.414638 10708 ts_tablet_manager.cc:1428] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20250114 20:57:56.414682 10710 raft_consensus.cc:695] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 1 LEADER]: Becoming Leader. State: Replica: 61ecc12ecdc44153b99d17525c506bcc, State: Running, Role: LEADER
I20250114 20:57:56.415299 10708 tablet_bootstrap.cc:492] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc: Bootstrap starting.
I20250114 20:57:56.415259 10710 consensus_queue.cc:237] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.420277 10708 tablet_bootstrap.cc:654] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:56.422502 10552 catalog_manager.cc:5526] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 61ecc12ecdc44153b99d17525c506bcc (127.6.177.65). New cstate: current_term: 1 leader_uuid: "61ecc12ecdc44153b99d17525c506bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:56.424942 10708 tablet_bootstrap.cc:492] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc: No bootstrap required, opened a new log
I20250114 20:57:56.425313 10708 ts_tablet_manager.cc:1397] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20250114 20:57:56.428277 10708 raft_consensus.cc:357] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.428632 10708 raft_consensus.cc:383] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:56.428912 10708 raft_consensus.cc:738] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61ecc12ecdc44153b99d17525c506bcc, State: Initialized, Role: FOLLOWER
I20250114 20:57:56.429330 10708 consensus_queue.cc:260] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.429718 10708 raft_consensus.cc:397] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:56.429904 10708 raft_consensus.cc:491] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:56.430145 10708 raft_consensus.cc:3054] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:56.434203 10708 raft_consensus.cc:513] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.434659 10708 leader_election.cc:304] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61ecc12ecdc44153b99d17525c506bcc; no voters:
I20250114 20:57:56.435060 10708 leader_election.cc:290] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:56.435197 10710 raft_consensus.cc:2798] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:56.435695 10710 raft_consensus.cc:695] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 1 LEADER]: Becoming Leader. State: Replica: 61ecc12ecdc44153b99d17525c506bcc, State: Running, Role: LEADER
I20250114 20:57:56.436159 10710 consensus_queue.cc:237] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } }
I20250114 20:57:56.436422 10708 ts_tablet_manager.cc:1428] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc: Time spent starting tablet: real 0.011s user 0.008s sys 0.001s
I20250114 20:57:56.440791 10552 catalog_manager.cc:5526] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc reported cstate change: term changed from 0 to 1, leader changed from <none> to 61ecc12ecdc44153b99d17525c506bcc (127.6.177.65). New cstate: current_term: 1 leader_uuid: "61ecc12ecdc44153b99d17525c506bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ecc12ecdc44153b99d17525c506bcc" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 46335 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:56.477984 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:56.495901 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:56.496474 6853 tablet_replica.cc:331] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc: stopping tablet replica
I20250114 20:57:56.497025 6853 raft_consensus.cc:2238] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:56.497383 6853 raft_consensus.cc:2267] T 449a809a0e0b49e0a70a93bd83d711bd P 61ecc12ecdc44153b99d17525c506bcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:56.499388 6853 tablet_replica.cc:331] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc: stopping tablet replica
I20250114 20:57:56.499799 6853 raft_consensus.cc:2238] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:56.500124 6853 raft_consensus.cc:2267] T 956d61feda064af9b484c6b47396a2b1 P 61ecc12ecdc44153b99d17525c506bcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:56.509347 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:56.518925 6853 master.cc:537] Master@127.6.177.126:38951 shutting down...
I20250114 20:57:56.533162 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:56.533519 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:56.533885 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P ad63776f8dca44788587b291d6220758: stopping tablet replica
I20250114 20:57:56.542433 6853 master.cc:559] Master@127.6.177.126:38951 shutdown complete.
[ OK ] ClientTest.TestGetSecurityInfoFromMaster (466 ms)
[ RUN ] ClientTest.TestRetrieveAuthzTokenInParallel
I20250114 20:57:56.560463 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:39881
I20250114 20:57:56.561280 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:56.565941 10722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.566836 10723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.567750 10725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:56.568491 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:56.569191 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:56.569329 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:56.569424 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888276569416 us; error 0 us; skew 500 ppm
I20250114 20:57:56.569788 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:56.571787 6853 webserver.cc:458] Webserver started at http://127.6.177.126:46827/ using document root <none> and password file <none>
I20250114 20:57:56.572173 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:56.572335 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:56.572497 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:56.573312 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "2d76da3ce9364333af8c2344f10adf6e"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.576880 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:56.579516 10730 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:56.580130 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:56.580354 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "2d76da3ce9364333af8c2344f10adf6e"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.580574 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:56.610651 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:56.611558 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:56.646054 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:39881
I20250114 20:57:56.646138 10791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:39881 every 8 connection(s)
I20250114 20:57:56.649087 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:56.658249 10792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e: Bootstrap starting.
I20250114 20:57:56.662050 10792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:56.665391 10792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e: No bootstrap required, opened a new log
I20250114 20:57:56.666999 10792 raft_consensus.cc:357] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d76da3ce9364333af8c2344f10adf6e" member_type: VOTER }
I20250114 20:57:56.667380 10792 raft_consensus.cc:383] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:56.667590 10792 raft_consensus.cc:738] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d76da3ce9364333af8c2344f10adf6e, State: Initialized, Role: FOLLOWER
I20250114 20:57:56.668150 10792 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d76da3ce9364333af8c2344f10adf6e" member_type: VOTER }
I20250114 20:57:56.668524 10792 raft_consensus.cc:397] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:56.668697 10792 raft_consensus.cc:491] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:56.668932 10792 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:56.672765 10792 raft_consensus.cc:513] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d76da3ce9364333af8c2344f10adf6e" member_type: VOTER }
I20250114 20:57:56.673168 10792 leader_election.cc:304] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d76da3ce9364333af8c2344f10adf6e; no voters:
I20250114 20:57:56.674085 10792 leader_election.cc:290] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:56.674358 10795 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:56.675526 10795 raft_consensus.cc:695] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 1 LEADER]: Becoming Leader. State: Replica: 2d76da3ce9364333af8c2344f10adf6e, State: Running, Role: LEADER
I20250114 20:57:56.676051 10795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d76da3ce9364333af8c2344f10adf6e" member_type: VOTER }
I20250114 20:57:56.676561 10792 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:56.678619 10797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d76da3ce9364333af8c2344f10adf6e. Latest consensus state: current_term: 1 leader_uuid: "2d76da3ce9364333af8c2344f10adf6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d76da3ce9364333af8c2344f10adf6e" member_type: VOTER } }
I20250114 20:57:56.679232 10797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:56.678557 10796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d76da3ce9364333af8c2344f10adf6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d76da3ce9364333af8c2344f10adf6e" member_type: VOTER } }
I20250114 20:57:56.680156 10796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:56.685250 10802 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:56.689359 10802 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:56.690236 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:56.695952 10802 catalog_manager.cc:1348] Generated new cluster ID: a7dbe53846b643b6bd5f30b1828cb76a
I20250114 20:57:56.696178 10802 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:56.705870 10802 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:56.706951 10802 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:56.719954 10802 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e: Generated new TSK 0
I20250114 20:57:56.720463 10802 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:56.755815 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:56.761507 10813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.762355 10814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:56.763307 10816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:56.764142 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:56.764680 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:56.764878 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:56.765003 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888276764991 us; error 0 us; skew 500 ppm
I20250114 20:57:56.765374 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:56.767294 6853 webserver.cc:458] Webserver started at http://127.6.177.65:42997/ using document root <none> and password file <none>
I20250114 20:57:56.767649 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:56.767787 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:56.767956 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:56.768783 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "7aa4e4a777a346248bfac2b69d53d710"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.772512 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20250114 20:57:56.775216 10821 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:56.775862 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:56.776091 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "7aa4e4a777a346248bfac2b69d53d710"
format_stamp: "Formatted at 2025-01-14 20:57:56 on dist-test-slave-26qh"
I20250114 20:57:56.776341 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.TestRetrieveAuthzTokenInParallel.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:56.807825 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:56.808647 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:56.813184 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:56.814318 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.001s sys 0.000s
I20250114 20:57:56.814543 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:56.814673 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:56.859514 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:37933
I20250114 20:57:56.859601 10891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:37933 every 8 connection(s)
I20250114 20:57:56.863293 10892 heartbeater.cc:346] Connected to a master server at 127.6.177.126:39881
I20250114 20:57:56.863636 10892 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:56.864217 10892 heartbeater.cc:510] Master 127.6.177.126:39881 requested a full tablet report, sending...
I20250114 20:57:56.865634 10747 ts_manager.cc:194] Registered new tserver with Master: 7aa4e4a777a346248bfac2b69d53d710 (127.6.177.65:37933)
I20250114 20:57:56.865963 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00365609s
I20250114 20:57:56.867211 10747 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36774
I20250114 20:57:56.879140 10892 heartbeater.cc:502] Master 127.6.177.126:39881 was elected leader, sending a full tablet report...
I20250114 20:57:56.883380 10747 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36790:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:56.909181 10857 tablet_service.cc:1467] Processing CreateTablet for tablet 315432c0b85a444481b11d07e7648e71 (DEFAULT_TABLE table=client-testtb [id=60e45b77cfa64b8a89c80322bceb09db]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:56.909469 10856 tablet_service.cc:1467] Processing CreateTablet for tablet 72d87acdd55d4d2eada66511bdd0031b (DEFAULT_TABLE table=client-testtb [id=60e45b77cfa64b8a89c80322bceb09db]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:56.910005 10857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315432c0b85a444481b11d07e7648e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:56.910398 10856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d87acdd55d4d2eada66511bdd0031b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:56.921731 10902 tablet_bootstrap.cc:492] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710: Bootstrap starting.
I20250114 20:57:56.925014 10902 tablet_bootstrap.cc:654] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:56.928095 10902 tablet_bootstrap.cc:492] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710: No bootstrap required, opened a new log
I20250114 20:57:56.928371 10902 ts_tablet_manager.cc:1397] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20250114 20:57:56.929764 10902 raft_consensus.cc:357] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.930174 10902 raft_consensus.cc:383] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:56.930399 10902 raft_consensus.cc:738] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa4e4a777a346248bfac2b69d53d710, State: Initialized, Role: FOLLOWER
I20250114 20:57:56.930855 10902 consensus_queue.cc:260] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.931370 10902 raft_consensus.cc:397] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:56.931632 10902 raft_consensus.cc:491] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:56.931881 10902 raft_consensus.cc:3054] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:56.935186 10902 raft_consensus.cc:513] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.935595 10902 leader_election.cc:304] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aa4e4a777a346248bfac2b69d53d710; no voters:
I20250114 20:57:56.936451 10902 leader_election.cc:290] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:56.936681 10904 raft_consensus.cc:2798] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:56.938385 10902 ts_tablet_manager.cc:1428] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710: Time spent starting tablet: real 0.010s user 0.005s sys 0.005s
I20250114 20:57:56.938452 10904 raft_consensus.cc:695] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa4e4a777a346248bfac2b69d53d710, State: Running, Role: LEADER
I20250114 20:57:56.939019 10902 tablet_bootstrap.cc:492] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710: Bootstrap starting.
I20250114 20:57:56.939041 10904 consensus_queue.cc:237] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.943998 10902 tablet_bootstrap.cc:654] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:56.944470 10747 catalog_manager.cc:5526] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aa4e4a777a346248bfac2b69d53d710 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "7aa4e4a777a346248bfac2b69d53d710" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:56.947551 10902 tablet_bootstrap.cc:492] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710: No bootstrap required, opened a new log
I20250114 20:57:56.947830 10902 ts_tablet_manager.cc:1397] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20250114 20:57:56.949362 10902 raft_consensus.cc:357] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.949838 10902 raft_consensus.cc:383] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:56.950037 10902 raft_consensus.cc:738] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa4e4a777a346248bfac2b69d53d710, State: Initialized, Role: FOLLOWER
I20250114 20:57:56.950459 10902 consensus_queue.cc:260] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.950980 10902 raft_consensus.cc:397] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:56.951282 10902 raft_consensus.cc:491] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:56.951542 10902 raft_consensus.cc:3054] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:56.955835 10902 raft_consensus.cc:513] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.956250 10902 leader_election.cc:304] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aa4e4a777a346248bfac2b69d53d710; no voters:
I20250114 20:57:56.956631 10902 leader_election.cc:290] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:56.956740 10904 raft_consensus.cc:2798] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:56.957118 10904 raft_consensus.cc:695] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa4e4a777a346248bfac2b69d53d710, State: Running, Role: LEADER
I20250114 20:57:56.957618 10904 consensus_queue.cc:237] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } }
I20250114 20:57:56.957932 10902 ts_tablet_manager.cc:1428] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250114 20:57:56.962239 10746 catalog_manager.cc:5526] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aa4e4a777a346248bfac2b69d53d710 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "7aa4e4a777a346248bfac2b69d53d710" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa4e4a777a346248bfac2b69d53d710" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 37933 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:56.976574 6853 client-test.cc:7932] 4 concurrent threads sent 2 RPC(s) to get authz tokens
I20250114 20:57:56.978724 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:57:56.992251 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:57:56.992877 6853 tablet_replica.cc:331] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710: stopping tablet replica
I20250114 20:57:56.993381 6853 raft_consensus.cc:2238] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:56.993721 6853 raft_consensus.cc:2267] T 72d87acdd55d4d2eada66511bdd0031b P 7aa4e4a777a346248bfac2b69d53d710 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:56.995731 6853 tablet_replica.cc:331] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710: stopping tablet replica
I20250114 20:57:56.996215 6853 raft_consensus.cc:2238] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:56.996522 6853 raft_consensus.cc:2267] T 315432c0b85a444481b11d07e7648e71 P 7aa4e4a777a346248bfac2b69d53d710 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:57.014621 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:57:57.023648 6853 master.cc:537] Master@127.6.177.126:39881 shutting down...
I20250114 20:57:57.036439 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:57:57.036792 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:57:57.037111 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 2d76da3ce9364333af8c2344f10adf6e: stopping tablet replica
I20250114 20:57:57.054566 6853 master.cc:559] Master@127.6.177.126:39881 shutdown complete.
[ OK ] ClientTest.TestRetrieveAuthzTokenInParallel (511 ms)
[ RUN ] ClientTest.StartCommitWithFlushedTxnSessions
I20250114 20:57:57.072176 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:38861
I20250114 20:57:57.072973 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:57.077649 10915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:57.078501 10916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:57.079526 10918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:57.080379 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:57.081063 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:57.081234 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:57.081342 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888277081332 us; error 0 us; skew 500 ppm
I20250114 20:57:57.081754 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:57.083729 6853 webserver.cc:458] Webserver started at http://127.6.177.126:42233/ using document root <none> and password file <none>
I20250114 20:57:57.084053 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:57.084173 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:57.084335 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:57.085132 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "74462d4e1a074e94affff3b3ea377f22"
format_stamp: "Formatted at 2025-01-14 20:57:57 on dist-test-slave-26qh"
I20250114 20:57:57.088791 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:57:57.091611 10923 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:57.092321 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:57.092543 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "74462d4e1a074e94affff3b3ea377f22"
format_stamp: "Formatted at 2025-01-14 20:57:57 on dist-test-slave-26qh"
I20250114 20:57:57.092772 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:57.103602 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:57.104327 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:57.141237 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:38861
I20250114 20:57:57.141341 10984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:38861 every 8 connection(s)
I20250114 20:57:57.144469 10985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:57.153218 10985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22: Bootstrap starting.
I20250114 20:57:57.156757 10985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:57.160195 10985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22: No bootstrap required, opened a new log
I20250114 20:57:57.161852 10985 raft_consensus.cc:357] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74462d4e1a074e94affff3b3ea377f22" member_type: VOTER }
I20250114 20:57:57.162214 10985 raft_consensus.cc:383] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:57.162475 10985 raft_consensus.cc:738] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74462d4e1a074e94affff3b3ea377f22, State: Initialized, Role: FOLLOWER
I20250114 20:57:57.162926 10985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74462d4e1a074e94affff3b3ea377f22" member_type: VOTER }
I20250114 20:57:57.163328 10985 raft_consensus.cc:397] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:57.163516 10985 raft_consensus.cc:491] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:57.163734 10985 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:57.167217 10985 raft_consensus.cc:513] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74462d4e1a074e94affff3b3ea377f22" member_type: VOTER }
I20250114 20:57:57.167632 10985 leader_election.cc:304] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74462d4e1a074e94affff3b3ea377f22; no voters:
I20250114 20:57:57.168545 10985 leader_election.cc:290] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:57.168793 10988 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:57.169929 10988 raft_consensus.cc:695] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 1 LEADER]: Becoming Leader. State: Replica: 74462d4e1a074e94affff3b3ea377f22, State: Running, Role: LEADER
I20250114 20:57:57.170485 10988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74462d4e1a074e94affff3b3ea377f22" member_type: VOTER }
I20250114 20:57:57.171098 10985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:57:57.173168 10990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74462d4e1a074e94affff3b3ea377f22. Latest consensus state: current_term: 1 leader_uuid: "74462d4e1a074e94affff3b3ea377f22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74462d4e1a074e94affff3b3ea377f22" member_type: VOTER } }
I20250114 20:57:57.173146 10989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74462d4e1a074e94affff3b3ea377f22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74462d4e1a074e94affff3b3ea377f22" member_type: VOTER } }
I20250114 20:57:57.173797 10990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:57.173872 10989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [sys.catalog]: This master's current role is: LEADER
I20250114 20:57:57.176188 10994 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:57:57.181552 10994 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:57:57.183822 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:57:57.188943 10994 catalog_manager.cc:1348] Generated new cluster ID: 10a7e75f073d4b958963310c477ea6cf
I20250114 20:57:57.189203 10994 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:57:57.210758 10994 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:57:57.211877 10994 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:57:57.227355 10994 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22: Generated new TSK 0
I20250114 20:57:57.227835 10994 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:57:57.249742 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:57:57.255651 11006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:57.256531 11007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:57:57.257375 11009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:57:57.258247 6853 server_base.cc:1034] running on GCE node
I20250114 20:57:57.258950 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:57:57.259160 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:57:57.259302 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888277259284 us; error 0 us; skew 500 ppm
I20250114 20:57:57.259766 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:57:57.261857 6853 webserver.cc:458] Webserver started at http://127.6.177.65:39307/ using document root <none> and password file <none>
I20250114 20:57:57.262257 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:57:57.262439 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:57:57.262665 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:57:57.263669 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "e77048e8a3384efda35787245d8c05b0"
format_stamp: "Formatted at 2025-01-14 20:57:57 on dist-test-slave-26qh"
I20250114 20:57:57.267403 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20250114 20:57:57.270020 11014 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:57.270645 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:57:57.270877 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "e77048e8a3384efda35787245d8c05b0"
format_stamp: "Formatted at 2025-01-14 20:57:57 on dist-test-slave-26qh"
I20250114 20:57:57.271148 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.StartCommitWithFlushedTxnSessions.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:57:57.284997 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:57:57.285748 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:57:57.289772 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:57:57.289952 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:57.290235 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:57:57.290482 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:57:57.334517 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:45745
I20250114 20:57:57.334612 11084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:45745 every 8 connection(s)
I20250114 20:57:57.338212 11085 heartbeater.cc:346] Connected to a master server at 127.6.177.126:38861
I20250114 20:57:57.338531 11085 heartbeater.cc:463] Registering TS with master...
I20250114 20:57:57.339169 11085 heartbeater.cc:510] Master 127.6.177.126:38861 requested a full tablet report, sending...
I20250114 20:57:57.340687 10940 ts_manager.cc:194] Registered new tserver with Master: e77048e8a3384efda35787245d8c05b0 (127.6.177.65:45745)
I20250114 20:57:57.340823 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.0037111s
I20250114 20:57:57.342890 10940 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56640
I20250114 20:57:57.355391 11085 heartbeater.cc:502] Master 127.6.177.126:38861 was elected leader, sending a full tablet report...
I20250114 20:57:57.359160 10940 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56656:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:57:57.384946 11050 tablet_service.cc:1467] Processing CreateTablet for tablet 9579253134d342239e79f073b2258020 (DEFAULT_TABLE table=client-testtb [id=55ea0f2e8e4f441ba798a4e629468437]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:57:57.385176 11049 tablet_service.cc:1467] Processing CreateTablet for tablet 6aedfe227d7b40efa92d4f08ac227930 (DEFAULT_TABLE table=client-testtb [id=55ea0f2e8e4f441ba798a4e629468437]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:57:57.386013 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9579253134d342239e79f073b2258020. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:57.386397 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aedfe227d7b40efa92d4f08ac227930. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:57.397951 11095 tablet_bootstrap.cc:492] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0: Bootstrap starting.
I20250114 20:57:57.401481 11095 tablet_bootstrap.cc:654] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:57.405094 11095 tablet_bootstrap.cc:492] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0: No bootstrap required, opened a new log
I20250114 20:57:57.405356 11095 ts_tablet_manager.cc:1397] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20250114 20:57:57.407290 11095 raft_consensus.cc:357] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.407681 11095 raft_consensus.cc:383] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:57.407868 11095 raft_consensus.cc:738] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e77048e8a3384efda35787245d8c05b0, State: Initialized, Role: FOLLOWER
I20250114 20:57:57.408344 11095 consensus_queue.cc:260] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.408845 11095 raft_consensus.cc:397] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:57.409049 11095 raft_consensus.cc:491] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:57.409264 11095 raft_consensus.cc:3054] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:57.413267 11095 raft_consensus.cc:513] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.413662 11095 leader_election.cc:304] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e77048e8a3384efda35787245d8c05b0; no voters:
I20250114 20:57:57.414582 11095 leader_election.cc:290] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:57.414842 11097 raft_consensus.cc:2798] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:57.416532 11095 ts_tablet_manager.cc:1428] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0: Time spent starting tablet: real 0.011s user 0.009s sys 0.002s
I20250114 20:57:57.416671 11097 raft_consensus.cc:695] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 1 LEADER]: Becoming Leader. State: Replica: e77048e8a3384efda35787245d8c05b0, State: Running, Role: LEADER
I20250114 20:57:57.417191 11095 tablet_bootstrap.cc:492] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0: Bootstrap starting.
I20250114 20:57:57.417191 11097 consensus_queue.cc:237] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.421942 11095 tablet_bootstrap.cc:654] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:57.423035 10939 catalog_manager.cc:5526] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e77048e8a3384efda35787245d8c05b0 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "e77048e8a3384efda35787245d8c05b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:57.425314 11095 tablet_bootstrap.cc:492] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0: No bootstrap required, opened a new log
I20250114 20:57:57.425611 11095 ts_tablet_manager.cc:1397] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20250114 20:57:57.427260 11095 raft_consensus.cc:357] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.427744 11095 raft_consensus.cc:383] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:57.428048 11095 raft_consensus.cc:738] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e77048e8a3384efda35787245d8c05b0, State: Initialized, Role: FOLLOWER
I20250114 20:57:57.428535 11095 consensus_queue.cc:260] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.428929 11095 raft_consensus.cc:397] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:57.429123 11095 raft_consensus.cc:491] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:57.429327 11095 raft_consensus.cc:3054] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:57.433712 11095 raft_consensus.cc:513] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.434129 11095 leader_election.cc:304] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e77048e8a3384efda35787245d8c05b0; no voters:
I20250114 20:57:57.434501 11095 leader_election.cc:290] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:57.434607 11097 raft_consensus.cc:2798] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:57.435262 11097 raft_consensus.cc:695] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 1 LEADER]: Becoming Leader. State: Replica: e77048e8a3384efda35787245d8c05b0, State: Running, Role: LEADER
I20250114 20:57:57.435802 11095 ts_tablet_manager.cc:1428] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20250114 20:57:57.435822 11097 consensus_queue.cc:237] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.440079 10939 catalog_manager.cc:5526] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e77048e8a3384efda35787245d8c05b0 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "e77048e8a3384efda35787245d8c05b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } health_report { overall_health: HEALTHY } } }
I20250114 20:57:57.468348 10940 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56670:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
I20250114 20:57:57.482607 11049 tablet_service.cc:1467] Processing CreateTablet for tablet 0709b76a21ff4236833e77251a21cf84 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=831f694a4f21440daa7ac654f8179487]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20250114 20:57:57.483533 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0709b76a21ff4236833e77251a21cf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:57:57.493880 11095 tablet_bootstrap.cc:492] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: Bootstrap starting.
I20250114 20:57:57.497910 11095 tablet_bootstrap.cc:654] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: Neither blocks nor log segments found. Creating new log.
I20250114 20:57:57.501967 11095 tablet_bootstrap.cc:492] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: No bootstrap required, opened a new log
I20250114 20:57:57.502368 11095 ts_tablet_manager.cc:1397] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20250114 20:57:57.504144 11095 raft_consensus.cc:357] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.504482 11095 raft_consensus.cc:383] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:57:57.504667 11095 raft_consensus.cc:738] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e77048e8a3384efda35787245d8c05b0, State: Initialized, Role: FOLLOWER
I20250114 20:57:57.505111 11095 consensus_queue.cc:260] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.505502 11095 raft_consensus.cc:397] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:57:57.505682 11095 raft_consensus.cc:491] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:57:57.505889 11095 raft_consensus.cc:3054] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:57:57.510205 11095 raft_consensus.cc:513] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.510704 11095 leader_election.cc:304] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e77048e8a3384efda35787245d8c05b0; no voters:
I20250114 20:57:57.511173 11095 leader_election.cc:290] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:57:57.511351 11097 raft_consensus.cc:2798] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:57:57.511838 11097 raft_consensus.cc:695] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 1 LEADER]: Becoming Leader. State: Replica: e77048e8a3384efda35787245d8c05b0, State: Running, Role: LEADER
I20250114 20:57:57.512668 11095 ts_tablet_manager.cc:1428] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20250114 20:57:57.512497 11097 consensus_queue.cc:237] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } }
I20250114 20:57:57.516145 11098 tablet_replica.cc:440] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e77048e8a3384efda35787245d8c05b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } } }
I20250114 20:57:57.516667 11098 tablet_replica.cc:443] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: This TxnStatusTablet replica's current role is: LEADER
I20250114 20:57:57.516449 11099 tablet_replica.cc:440] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: TxnStatusTablet state changed. Reason: New leader e77048e8a3384efda35787245d8c05b0. Latest consensus state: current_term: 1 leader_uuid: "e77048e8a3384efda35787245d8c05b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } } }
I20250114 20:57:57.517057 11099 tablet_replica.cc:443] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: This TxnStatusTablet replica's current role is: LEADER
I20250114 20:57:57.518252 11111 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20250114 20:57:57.518772 11111 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20250114 20:57:57.518561 10939 catalog_manager.cc:5526] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e77048e8a3384efda35787245d8c05b0 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "e77048e8a3384efda35787245d8c05b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e77048e8a3384efda35787245d8c05b0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45745 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:04.848914 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:04.883450 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:04.884065 6853 tablet_replica.cc:331] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0: stopping tablet replica
I20250114 20:58:04.884541 6853 raft_consensus.cc:2238] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:04.884976 6853 raft_consensus.cc:2267] T 0709b76a21ff4236833e77251a21cf84 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:04.886933 6853 tablet_replica.cc:331] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0: stopping tablet replica
I20250114 20:58:04.887372 6853 raft_consensus.cc:2238] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:04.887663 6853 raft_consensus.cc:2267] T 9579253134d342239e79f073b2258020 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:04.889092 6853 tablet_replica.cc:331] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0: stopping tablet replica
I20250114 20:58:04.889464 6853 raft_consensus.cc:2238] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:04.889757 6853 raft_consensus.cc:2267] T 6aedfe227d7b40efa92d4f08ac227930 P e77048e8a3384efda35787245d8c05b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:04.913890 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:04.927613 6853 master.cc:537] Master@127.6.177.126:38861 shutting down...
I20250114 20:58:04.948199 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:04.948551 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:04.948786 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 74462d4e1a074e94affff3b3ea377f22: stopping tablet replica
I20250114 20:58:04.966024 6853 master.cc:559] Master@127.6.177.126:38861 shutdown complete.
[ OK ] ClientTest.StartCommitWithFlushedTxnSessions (7920 ms)
[ RUN ] ClientTest.AttemptToControlTxnByOtherUser
I20250114 20:58:04.992949 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:38669
I20250114 20:58:04.993813 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:04.999004 11127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:04.999823 11128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:05.000646 11130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:05.001446 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:05.002257 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:05.002431 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:05.002549 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888285002539 us; error 0 us; skew 500 ppm
I20250114 20:58:05.002947 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:05.005085 6853 webserver.cc:458] Webserver started at http://127.6.177.126:45983/ using document root <none> and password file <none>
I20250114 20:58:05.005440 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:05.005569 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:05.005754 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:05.006705 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "9648c12004814b3aa10655fd50cf43a2"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.010546 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:58:05.013362 11135 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.013954 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:05.014154 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "9648c12004814b3aa10655fd50cf43a2"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.014350 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:05.025055 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:05.025962 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:05.065456 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:38669
I20250114 20:58:05.065538 11196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:38669 every 8 connection(s)
I20250114 20:58:05.068585 11197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:05.077977 11197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2: Bootstrap starting.
I20250114 20:58:05.081770 11197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:05.085194 11197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2: No bootstrap required, opened a new log
I20250114 20:58:05.086817 11197 raft_consensus.cc:357] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648c12004814b3aa10655fd50cf43a2" member_type: VOTER }
I20250114 20:58:05.087234 11197 raft_consensus.cc:383] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:05.087424 11197 raft_consensus.cc:738] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9648c12004814b3aa10655fd50cf43a2, State: Initialized, Role: FOLLOWER
I20250114 20:58:05.087929 11197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648c12004814b3aa10655fd50cf43a2" member_type: VOTER }
I20250114 20:58:05.088310 11197 raft_consensus.cc:397] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:05.088497 11197 raft_consensus.cc:491] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:05.088728 11197 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:05.092312 11197 raft_consensus.cc:513] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648c12004814b3aa10655fd50cf43a2" member_type: VOTER }
I20250114 20:58:05.092767 11197 leader_election.cc:304] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9648c12004814b3aa10655fd50cf43a2; no voters:
I20250114 20:58:05.093798 11197 leader_election.cc:290] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:05.094112 11200 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:05.095281 11200 raft_consensus.cc:695] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 1 LEADER]: Becoming Leader. State: Replica: 9648c12004814b3aa10655fd50cf43a2, State: Running, Role: LEADER
I20250114 20:58:05.095748 11200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648c12004814b3aa10655fd50cf43a2" member_type: VOTER }
I20250114 20:58:05.096271 11197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:05.099970 11201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9648c12004814b3aa10655fd50cf43a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648c12004814b3aa10655fd50cf43a2" member_type: VOTER } }
I20250114 20:58:05.100714 11201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:05.100566 11202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9648c12004814b3aa10655fd50cf43a2. Latest consensus state: current_term: 1 leader_uuid: "9648c12004814b3aa10655fd50cf43a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9648c12004814b3aa10655fd50cf43a2" member_type: VOTER } }
I20250114 20:58:05.101306 11202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:05.103924 11207 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:05.108708 11207 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:05.110280 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:05.116158 11207 catalog_manager.cc:1348] Generated new cluster ID: 7bdd5d09937b4044b5df8da18bb3e2ba
I20250114 20:58:05.116369 11207 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:05.151404 11207 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:05.152472 11207 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:05.160976 11207 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2: Generated new TSK 0
I20250114 20:58:05.161382 11207 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:05.175894 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:05.181447 11218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:05.182318 11219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:05.183401 6853 server_base.cc:1034] running on GCE node
W20250114 20:58:05.184082 11221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:05.184753 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:05.184903 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:05.185004 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888285184994 us; error 0 us; skew 500 ppm
I20250114 20:58:05.185372 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:05.187192 6853 webserver.cc:458] Webserver started at http://127.6.177.65:36525/ using document root <none> and password file <none>
I20250114 20:58:05.187525 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:05.187645 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:05.187819 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:05.188689 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "8972204ef81e4f9686c39e34788d1cef"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.192096 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:58:05.194736 11226 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.195358 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:58:05.195590 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "8972204ef81e4f9686c39e34788d1cef"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.195797 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTest.AttemptToControlTxnByOtherUser.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:05.237068 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:05.237990 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:05.242090 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:05.242411 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.242763 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:05.243042 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.288419 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:43109
I20250114 20:58:05.288511 11296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:43109 every 8 connection(s)
I20250114 20:58:05.292310 11297 heartbeater.cc:346] Connected to a master server at 127.6.177.126:38669
I20250114 20:58:05.292649 11297 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:05.293267 11297 heartbeater.cc:510] Master 127.6.177.126:38669 requested a full tablet report, sending...
I20250114 20:58:05.294919 11152 ts_manager.cc:194] Registered new tserver with Master: 8972204ef81e4f9686c39e34788d1cef (127.6.177.65:43109)
I20250114 20:58:05.294994 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003766233s
I20250114 20:58:05.296433 11152 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42408
I20250114 20:58:05.308719 11297 heartbeater.cc:502] Master 127.6.177.126:38669 was elected leader, sending a full tablet report...
I20250114 20:58:05.313041 11151 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42428:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:05.341106 11262 tablet_service.cc:1467] Processing CreateTablet for tablet 399b08fa78034df98d7b2c899e82edc9 (DEFAULT_TABLE table=client-testtb [id=d28b87f2c731467a83c6d034a6a4d455]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:58:05.341382 11261 tablet_service.cc:1467] Processing CreateTablet for tablet 04a8a99948e4459d9855e4cc95029cea (DEFAULT_TABLE table=client-testtb [id=d28b87f2c731467a83c6d034a6a4d455]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:58:05.342270 11262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399b08fa78034df98d7b2c899e82edc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:05.342849 11261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a8a99948e4459d9855e4cc95029cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:05.356243 11307 tablet_bootstrap.cc:492] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef: Bootstrap starting.
I20250114 20:58:05.361166 11307 tablet_bootstrap.cc:654] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:05.364964 11307 tablet_bootstrap.cc:492] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef: No bootstrap required, opened a new log
I20250114 20:58:05.365324 11307 ts_tablet_manager.cc:1397] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20250114 20:58:05.366923 11307 raft_consensus.cc:357] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.367376 11307 raft_consensus.cc:383] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:05.367574 11307 raft_consensus.cc:738] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8972204ef81e4f9686c39e34788d1cef, State: Initialized, Role: FOLLOWER
I20250114 20:58:05.367990 11307 consensus_queue.cc:260] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.368374 11307 raft_consensus.cc:397] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:05.368557 11307 raft_consensus.cc:491] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:05.368765 11307 raft_consensus.cc:3054] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:05.373270 11307 raft_consensus.cc:513] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.373818 11307 leader_election.cc:304] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8972204ef81e4f9686c39e34788d1cef; no voters:
I20250114 20:58:05.374917 11307 leader_election.cc:290] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:05.375293 11309 raft_consensus.cc:2798] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:05.376344 11309 raft_consensus.cc:695] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 1 LEADER]: Becoming Leader. State: Replica: 8972204ef81e4f9686c39e34788d1cef, State: Running, Role: LEADER
I20250114 20:58:05.376994 11307 ts_tablet_manager.cc:1428] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20250114 20:58:05.376909 11309 consensus_queue.cc:237] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.377594 11307 tablet_bootstrap.cc:492] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef: Bootstrap starting.
I20250114 20:58:05.383050 11307 tablet_bootstrap.cc:654] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:05.384657 11151 catalog_manager.cc:5526] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8972204ef81e4f9686c39e34788d1cef (127.6.177.65). New cstate: current_term: 1 leader_uuid: "8972204ef81e4f9686c39e34788d1cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:05.387473 11307 tablet_bootstrap.cc:492] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef: No bootstrap required, opened a new log
I20250114 20:58:05.387830 11307 ts_tablet_manager.cc:1397] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20250114 20:58:05.389621 11307 raft_consensus.cc:357] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.390066 11307 raft_consensus.cc:383] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:05.390293 11307 raft_consensus.cc:738] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8972204ef81e4f9686c39e34788d1cef, State: Initialized, Role: FOLLOWER
I20250114 20:58:05.390820 11307 consensus_queue.cc:260] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.391389 11307 raft_consensus.cc:397] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:05.391613 11307 raft_consensus.cc:491] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:05.391861 11307 raft_consensus.cc:3054] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:05.396034 11307 raft_consensus.cc:513] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.396486 11307 leader_election.cc:304] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8972204ef81e4f9686c39e34788d1cef; no voters:
I20250114 20:58:05.396869 11307 leader_election.cc:290] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:05.396994 11309 raft_consensus.cc:2798] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:05.397398 11309 raft_consensus.cc:695] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 1 LEADER]: Becoming Leader. State: Replica: 8972204ef81e4f9686c39e34788d1cef, State: Running, Role: LEADER
I20250114 20:58:05.398317 11307 ts_tablet_manager.cc:1428] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250114 20:58:05.398026 11309 consensus_queue.cc:237] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.402258 11151 catalog_manager.cc:5526] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8972204ef81e4f9686c39e34788d1cef (127.6.177.65). New cstate: current_term: 1 leader_uuid: "8972204ef81e4f9686c39e34788d1cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:05.437518 11151 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42444:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
I20250114 20:58:05.453347 11262 tablet_service.cc:1467] Processing CreateTablet for tablet f1f15ab25f5348b28065243ed8c9c810 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dbd817290c424db8834a18ffbe73a7ad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20250114 20:58:05.454360 11262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f15ab25f5348b28065243ed8c9c810. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:05.464577 11307 tablet_bootstrap.cc:492] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: Bootstrap starting.
I20250114 20:58:05.468984 11307 tablet_bootstrap.cc:654] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:05.472584 11307 tablet_bootstrap.cc:492] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: No bootstrap required, opened a new log
I20250114 20:58:05.473032 11307 ts_tablet_manager.cc:1397] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20250114 20:58:05.474803 11307 raft_consensus.cc:357] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.475242 11307 raft_consensus.cc:383] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:05.475418 11307 raft_consensus.cc:738] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8972204ef81e4f9686c39e34788d1cef, State: Initialized, Role: FOLLOWER
I20250114 20:58:05.475812 11307 consensus_queue.cc:260] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.476204 11307 raft_consensus.cc:397] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:05.476363 11307 raft_consensus.cc:491] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:05.476534 11307 raft_consensus.cc:3054] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:05.480940 11307 raft_consensus.cc:513] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.481374 11307 leader_election.cc:304] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8972204ef81e4f9686c39e34788d1cef; no voters:
I20250114 20:58:05.481731 11307 leader_election.cc:290] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:05.481905 11309 raft_consensus.cc:2798] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:05.482390 11309 raft_consensus.cc:695] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 1 LEADER]: Becoming Leader. State: Replica: 8972204ef81e4f9686c39e34788d1cef, State: Running, Role: LEADER
I20250114 20:58:05.483064 11309 consensus_queue.cc:237] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } }
I20250114 20:58:05.483529 11307 ts_tablet_manager.cc:1428] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
I20250114 20:58:05.486208 11311 tablet_replica.cc:440] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8972204ef81e4f9686c39e34788d1cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } } }
I20250114 20:58:05.486389 11310 tablet_replica.cc:440] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: TxnStatusTablet state changed. Reason: New leader 8972204ef81e4f9686c39e34788d1cef. Latest consensus state: current_term: 1 leader_uuid: "8972204ef81e4f9686c39e34788d1cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } } }
I20250114 20:58:05.486685 11311 tablet_replica.cc:443] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: This TxnStatusTablet replica's current role is: LEADER
I20250114 20:58:05.486821 11310 tablet_replica.cc:443] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: This TxnStatusTablet replica's current role is: LEADER
I20250114 20:58:05.490268 11323 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20250114 20:58:05.490562 11323 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20250114 20:58:05.491348 11152 catalog_manager.cc:5526] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef reported cstate change: term changed from 0 to 1, leader changed from <none> to 8972204ef81e4f9686c39e34788d1cef (127.6.177.65). New cstate: current_term: 1 leader_uuid: "8972204ef81e4f9686c39e34788d1cef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8972204ef81e4f9686c39e34788d1cef" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 43109 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:05.552951 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:05.567580 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:05.568159 6853 tablet_replica.cc:331] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef: stopping tablet replica
I20250114 20:58:05.568599 6853 raft_consensus.cc:2238] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:05.568970 6853 raft_consensus.cc:2267] T f1f15ab25f5348b28065243ed8c9c810 P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:05.570921 6853 tablet_replica.cc:331] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef: stopping tablet replica
I20250114 20:58:05.571348 6853 raft_consensus.cc:2238] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:05.571656 6853 raft_consensus.cc:2267] T 04a8a99948e4459d9855e4cc95029cea P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:05.573422 6853 tablet_replica.cc:331] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef: stopping tablet replica
I20250114 20:58:05.573807 6853 raft_consensus.cc:2238] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:05.574117 6853 raft_consensus.cc:2267] T 399b08fa78034df98d7b2c899e82edc9 P 8972204ef81e4f9686c39e34788d1cef [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:05.594385 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:05.603844 6853 master.cc:537] Master@127.6.177.126:38669 shutting down...
I20250114 20:58:05.616674 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:05.617013 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:05.617321 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 9648c12004814b3aa10655fd50cf43a2: stopping tablet replica
I20250114 20:58:05.634893 6853 master.cc:559] Master@127.6.177.126:38669 shutdown complete.
[ OK ] ClientTest.AttemptToControlTxnByOtherUser (661 ms)
[----------] 21 tests from ClientTest (58058 ms total)
[----------] 1 test from ClientWithLocationTest
[ RUN ] ClientWithLocationTest.TestClientLocation
I20250114 20:58:05.655182 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:37763
I20250114 20:58:05.655992 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:05.660789 11331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:05.661518 11332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:05.662338 11334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:05.663226 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:05.663810 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:05.663949 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:05.664041 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888285664033 us; error 0 us; skew 500 ppm
I20250114 20:58:05.664392 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:05.666160 6853 webserver.cc:458] Webserver started at http://127.6.177.126:33649/ using document root <none> and password file <none>
I20250114 20:58:05.666538 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:05.666671 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:05.666862 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:05.667908 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "fef6c25289844f8fa4fa09d876d17a6e"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.671346 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:58:05.674042 11339 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.674628 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:58:05.674854 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "fef6c25289844f8fa4fa09d876d17a6e"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.675096 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:05.690301 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:05.691099 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:05.725693 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:37763
I20250114 20:58:05.725771 11400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:37763 every 8 connection(s)
I20250114 20:58:05.728798 11401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:05.737303 11401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e: Bootstrap starting.
I20250114 20:58:05.740770 11401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:05.743889 11401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e: No bootstrap required, opened a new log
I20250114 20:58:05.745361 11401 raft_consensus.cc:357] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef6c25289844f8fa4fa09d876d17a6e" member_type: VOTER }
I20250114 20:58:05.745656 11401 raft_consensus.cc:383] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:05.745849 11401 raft_consensus.cc:738] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef6c25289844f8fa4fa09d876d17a6e, State: Initialized, Role: FOLLOWER
I20250114 20:58:05.746323 11401 consensus_queue.cc:260] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef6c25289844f8fa4fa09d876d17a6e" member_type: VOTER }
I20250114 20:58:05.746757 11401 raft_consensus.cc:397] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:05.746948 11401 raft_consensus.cc:491] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:05.747186 11401 raft_consensus.cc:3054] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:05.750450 11401 raft_consensus.cc:513] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef6c25289844f8fa4fa09d876d17a6e" member_type: VOTER }
I20250114 20:58:05.750866 11401 leader_election.cc:304] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fef6c25289844f8fa4fa09d876d17a6e; no voters:
I20250114 20:58:05.751794 11401 leader_election.cc:290] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:05.752080 11404 raft_consensus.cc:2798] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:05.753335 11404 raft_consensus.cc:695] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 1 LEADER]: Becoming Leader. State: Replica: fef6c25289844f8fa4fa09d876d17a6e, State: Running, Role: LEADER
I20250114 20:58:05.753842 11404 consensus_queue.cc:237] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef6c25289844f8fa4fa09d876d17a6e" member_type: VOTER }
I20250114 20:58:05.754355 11401 sys_catalog.cc:564] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:05.756227 11405 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fef6c25289844f8fa4fa09d876d17a6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef6c25289844f8fa4fa09d876d17a6e" member_type: VOTER } }
I20250114 20:58:05.756264 11406 sys_catalog.cc:455] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fef6c25289844f8fa4fa09d876d17a6e. Latest consensus state: current_term: 1 leader_uuid: "fef6c25289844f8fa4fa09d876d17a6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fef6c25289844f8fa4fa09d876d17a6e" member_type: VOTER } }
I20250114 20:58:05.756974 11405 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:05.757334 11406 sys_catalog.cc:458] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:05.769058 11410 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:05.772787 11410 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:05.773698 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:05.779477 11410 catalog_manager.cc:1348] Generated new cluster ID: 79228fc7d5454d6ab9347333bf4171eb
I20250114 20:58:05.779711 11410 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:05.791865 11410 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:05.792919 11410 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:05.801672 11410 catalog_manager.cc:5899] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e: Generated new TSK 0
I20250114 20:58:05.802104 11410 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:05.807873 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:05.813843 11422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:05.814677 11423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:05.815816 11425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:05.816558 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:05.817198 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:05.817360 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:05.817473 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888285817463 us; error 0 us; skew 500 ppm
I20250114 20:58:05.817932 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:05.820001 6853 webserver.cc:458] Webserver started at http://127.6.177.65:40541/ using document root <none> and password file <none>
I20250114 20:58:05.820380 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:05.820520 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:05.820705 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:05.821596 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "74057c9daeb645e09ea62c6ef551d9bd"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.825356 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:58:05.827927 11430 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.828516 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:05.828706 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "74057c9daeb645e09ea62c6ef551d9bd"
format_stamp: "Formatted at 2025-01-14 20:58:05 on dist-test-slave-26qh"
I20250114 20:58:05.828917 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientWithLocationTest.TestClientLocation.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:05.836419 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:05.837153 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:05.838331 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:05.840251 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:05.840409 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.840550 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:05.840653 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:05.874476 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:45119
I20250114 20:58:05.874557 11492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:45119 every 8 connection(s)
I20250114 20:58:05.886634 11493 heartbeater.cc:346] Connected to a master server at 127.6.177.126:37763
I20250114 20:58:05.886905 11493 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:05.887461 11493 heartbeater.cc:510] Master 127.6.177.126:37763 requested a full tablet report, sending...
I20250114 20:58:05.936163 11356 ts_manager.cc:194] Registered new tserver with Master: 74057c9daeb645e09ea62c6ef551d9bd (127.6.177.65:45119)
I20250114 20:58:05.936508 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.059285103s
I20250114 20:58:05.938445 11356 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53632
I20250114 20:58:05.952098 11493 heartbeater.cc:502] Master 127.6.177.126:37763 was elected leader, sending a full tablet report...
I20250114 20:58:06.007306 11356 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53636:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:06.041853 11458 tablet_service.cc:1467] Processing CreateTablet for tablet cd58b2e93d5441469a738bdebb2964a3 (DEFAULT_TABLE table=client-testtb [id=ff3471becc354fe695fbe1ea0cfde3e7]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:58:06.042260 11457 tablet_service.cc:1467] Processing CreateTablet for tablet 6f2750283d964ea5859689826ef68e2a (DEFAULT_TABLE table=client-testtb [id=ff3471becc354fe695fbe1ea0cfde3e7]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:58:06.043272 11458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd58b2e93d5441469a738bdebb2964a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:06.043777 11457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2750283d964ea5859689826ef68e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:06.057138 11507 tablet_bootstrap.cc:492] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd: Bootstrap starting.
I20250114 20:58:06.062374 11507 tablet_bootstrap.cc:654] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:06.066568 11507 tablet_bootstrap.cc:492] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd: No bootstrap required, opened a new log
I20250114 20:58:06.066874 11507 ts_tablet_manager.cc:1397] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20250114 20:58:06.068869 11507 raft_consensus.cc:357] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.069283 11507 raft_consensus.cc:383] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:06.069484 11507 raft_consensus.cc:738] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74057c9daeb645e09ea62c6ef551d9bd, State: Initialized, Role: FOLLOWER
I20250114 20:58:06.070060 11507 consensus_queue.cc:260] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.070502 11507 raft_consensus.cc:397] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:06.070690 11507 raft_consensus.cc:491] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:06.070923 11507 raft_consensus.cc:3054] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:06.075986 11507 raft_consensus.cc:513] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.076462 11507 leader_election.cc:304] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74057c9daeb645e09ea62c6ef551d9bd; no voters:
I20250114 20:58:06.077533 11507 leader_election.cc:290] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:06.077895 11509 raft_consensus.cc:2798] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:06.079277 11509 raft_consensus.cc:695] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 1 LEADER]: Becoming Leader. State: Replica: 74057c9daeb645e09ea62c6ef551d9bd, State: Running, Role: LEADER
I20250114 20:58:06.080053 11507 ts_tablet_manager.cc:1428] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20250114 20:58:06.079934 11509 consensus_queue.cc:237] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.080690 11507 tablet_bootstrap.cc:492] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd: Bootstrap starting.
I20250114 20:58:06.086709 11507 tablet_bootstrap.cc:654] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:06.086359 11356 catalog_manager.cc:5526] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 74057c9daeb645e09ea62c6ef551d9bd (127.6.177.65). New cstate: current_term: 1 leader_uuid: "74057c9daeb645e09ea62c6ef551d9bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:06.090689 11507 tablet_bootstrap.cc:492] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd: No bootstrap required, opened a new log
I20250114 20:58:06.091130 11507 ts_tablet_manager.cc:1397] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20250114 20:58:06.093560 11507 raft_consensus.cc:357] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.094007 11507 raft_consensus.cc:383] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:06.094223 11507 raft_consensus.cc:738] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74057c9daeb645e09ea62c6ef551d9bd, State: Initialized, Role: FOLLOWER
I20250114 20:58:06.094687 11507 consensus_queue.cc:260] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.095151 11507 raft_consensus.cc:397] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:06.095402 11507 raft_consensus.cc:491] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:06.095678 11507 raft_consensus.cc:3054] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:06.100837 11507 raft_consensus.cc:513] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.101225 11507 leader_election.cc:304] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74057c9daeb645e09ea62c6ef551d9bd; no voters:
I20250114 20:58:06.101579 11507 leader_election.cc:290] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:06.101692 11509 raft_consensus.cc:2798] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:06.102321 11509 raft_consensus.cc:695] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 1 LEADER]: Becoming Leader. State: Replica: 74057c9daeb645e09ea62c6ef551d9bd, State: Running, Role: LEADER
I20250114 20:58:06.102886 11507 ts_tablet_manager.cc:1428] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20250114 20:58:06.102896 11509 consensus_queue.cc:237] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } }
I20250114 20:58:06.107267 11355 catalog_manager.cc:5526] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 74057c9daeb645e09ea62c6ef551d9bd (127.6.177.65). New cstate: current_term: 1 leader_uuid: "74057c9daeb645e09ea62c6ef551d9bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74057c9daeb645e09ea62c6ef551d9bd" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45119 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:06.121286 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:06.141021 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:06.141777 6853 tablet_replica.cc:331] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd: stopping tablet replica
I20250114 20:58:06.142288 6853 raft_consensus.cc:2238] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:06.142643 6853 raft_consensus.cc:2267] T cd58b2e93d5441469a738bdebb2964a3 P 74057c9daeb645e09ea62c6ef551d9bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:06.144709 6853 tablet_replica.cc:331] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd: stopping tablet replica
I20250114 20:58:06.145128 6853 raft_consensus.cc:2238] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:06.145438 6853 raft_consensus.cc:2267] T 6f2750283d964ea5859689826ef68e2a P 74057c9daeb645e09ea62c6ef551d9bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:06.164928 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:06.175905 6853 master.cc:537] Master@127.6.177.126:37763 shutting down...
I20250114 20:58:06.191851 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:06.192323 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:06.192796 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P fef6c25289844f8fa4fa09d876d17a6e: stopping tablet replica
I20250114 20:58:06.212646 6853 master.cc:559] Master@127.6.177.126:37763 shutdown complete.
[ OK ] ClientWithLocationTest.TestClientLocation (581 ms)
[----------] 1 test from ClientWithLocationTest (581 ms total)
[----------] 1 test from ReplicationFactorLimitsTest
[ RUN ] ReplicationFactorLimitsTest.MinReplicationFactor
I20250114 20:58:06.236845 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:45209
I20250114 20:58:06.237912 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:06.243803 11516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.244567 11517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.245354 11519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.246130 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:06.246996 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:06.247233 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:06.247393 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888286247369 us; error 0 us; skew 500 ppm
I20250114 20:58:06.248095 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:06.250362 6853 webserver.cc:458] Webserver started at http://127.6.177.126:38967/ using document root <none> and password file <none>
I20250114 20:58:06.250859 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:06.251044 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:06.251361 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:06.252485 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "07ca15b452f5437e9b676561317e354b"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.257262 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250114 20:58:06.260462 11524 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.261180 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:58:06.261399 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "07ca15b452f5437e9b676561317e354b"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.261632 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:06.273826 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:06.274827 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:06.309585 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:45209
I20250114 20:58:06.309657 11576 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:45209 every 8 connection(s)
I20250114 20:58:06.313253 11577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:06.322988 11577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: Bootstrap starting.
I20250114 20:58:06.326809 11577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:06.330317 11577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: No bootstrap required, opened a new log
I20250114 20:58:06.332091 11577 raft_consensus.cc:357] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:06.332437 11577 raft_consensus.cc:383] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:06.332644 11577 raft_consensus.cc:738] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07ca15b452f5437e9b676561317e354b, State: Initialized, Role: FOLLOWER
I20250114 20:58:06.333145 11577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:06.333571 11577 raft_consensus.cc:397] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:06.333757 11577 raft_consensus.cc:491] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:06.333988 11577 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:06.337620 11577 raft_consensus.cc:513] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:06.338083 11577 leader_election.cc:304] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07ca15b452f5437e9b676561317e354b; no voters:
I20250114 20:58:06.339100 11577 leader_election.cc:290] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:06.339414 11580 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:06.340703 11580 raft_consensus.cc:695] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 LEADER]: Becoming Leader. State: Replica: 07ca15b452f5437e9b676561317e354b, State: Running, Role: LEADER
I20250114 20:58:06.341257 11580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:06.341742 11577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:06.343849 11582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07ca15b452f5437e9b676561317e354b. Latest consensus state: current_term: 1 leader_uuid: "07ca15b452f5437e9b676561317e354b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER } }
I20250114 20:58:06.344360 11582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:06.346019 11581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07ca15b452f5437e9b676561317e354b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER } }
I20250114 20:58:06.346719 11581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:06.348032 11587 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:06.355108 11587 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:06.355933 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:06.362457 11587 catalog_manager.cc:1348] Generated new cluster ID: 67cb0702f3184836b01983df619b9d6d
I20250114 20:58:06.362668 11587 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:06.378903 11587 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:06.379920 11587 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:06.393967 11587 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: Generated new TSK 0
I20250114 20:58:06.394362 11587 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:06.421880 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:06.429831 11598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.430624 11599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.431715 6853 server_base.cc:1034] running on GCE node
W20250114 20:58:06.432446 11601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.433270 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:06.433460 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:06.433619 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888286433600 us; error 0 us; skew 500 ppm
I20250114 20:58:06.434149 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:06.436280 6853 webserver.cc:458] Webserver started at http://127.6.177.65:44573/ using document root <none> and password file <none>
I20250114 20:58:06.436750 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:06.436919 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:06.437153 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:06.438330 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "3992df6473c442dd81ab1eacb0649af0"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.442453 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20250114 20:58:06.445345 11606 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.445917 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:06.446152 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "3992df6473c442dd81ab1eacb0649af0"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.446410 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:06.462334 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:06.463372 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:06.464711 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:06.466750 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:06.466920 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.467142 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:06.467279 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.503445 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:45437
I20250114 20:58:06.503554 11668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:45437 every 8 connection(s)
I20250114 20:58:06.507547 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:06.515141 11673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.516135 11674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.518286 11676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.519217 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:06.519558 11669 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:06.519912 11669 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:06.520076 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:06.520269 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:06.520412 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888286520397 us; error 0 us; skew 500 ppm
I20250114 20:58:06.520562 11669 heartbeater.cc:510] Master 127.6.177.126:45209 requested a full tablet report, sending...
I20250114 20:58:06.520921 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:06.522439 11541 ts_manager.cc:194] Registered new tserver with Master: 3992df6473c442dd81ab1eacb0649af0 (127.6.177.65:45437)
I20250114 20:58:06.523607 6853 webserver.cc:458] Webserver started at http://127.6.177.66:46823/ using document root <none> and password file <none>
I20250114 20:58:06.524087 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:06.524260 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:06.524207 11541 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36454
I20250114 20:58:06.524608 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:06.525776 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-1-root/instance:
uuid: "205a5606475446d0a202483e4be6fd96"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.529460 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20250114 20:58:06.532371 11681 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.533059 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:58:06.533330 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-1-root
uuid: "205a5606475446d0a202483e4be6fd96"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.533558 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:06.536391 11669 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:06.553361 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:06.554322 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:06.555523 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:06.557438 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:06.557610 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.557834 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:06.557979 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.595697 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.66:39725
I20250114 20:58:06.595804 11743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.66:39725 every 8 connection(s)
I20250114 20:58:06.599910 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:06.607133 11747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.608780 11748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.610061 11750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.610996 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:06.611049 11744 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:06.611608 11744 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:06.612146 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:06.612428 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:06.612406 11744 heartbeater.cc:510] Master 127.6.177.126:45209 requested a full tablet report, sending...
I20250114 20:58:06.612792 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888286612771 us; error 0 us; skew 500 ppm
I20250114 20:58:06.613562 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:06.614513 11541 ts_manager.cc:194] Registered new tserver with Master: 205a5606475446d0a202483e4be6fd96 (127.6.177.66:39725)
I20250114 20:58:06.615938 6853 webserver.cc:458] Webserver started at http://127.6.177.67:46215/ using document root <none> and password file <none>
I20250114 20:58:06.615947 11541 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36456
I20250114 20:58:06.616427 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:06.616612 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:06.616827 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:06.618289 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-2-root/instance:
uuid: "520708c32200408aa03c62e6bda3a566"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.622087 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:58:06.625072 11755 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.625748 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:06.626041 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-2-root
uuid: "520708c32200408aa03c62e6bda3a566"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.626291 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:06.628302 11744 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:06.642443 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:06.643873 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:06.645020 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:06.646822 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:06.646967 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.647197 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:06.647315 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.690088 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.67:44013
I20250114 20:58:06.690174 11817 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.67:44013 every 8 connection(s)
I20250114 20:58:06.694531 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:06.701745 11821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.705014 6853 server_base.cc:1034] running on GCE node
W20250114 20:58:06.705767 11824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.706281 11822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.707059 11818 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:06.707468 11818 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:06.707659 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:06.707902 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:06.708096 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888286708074 us; error 0 us; skew 500 ppm
I20250114 20:58:06.708212 11818 heartbeater.cc:510] Master 127.6.177.126:45209 requested a full tablet report, sending...
I20250114 20:58:06.708739 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:06.710090 11541 ts_manager.cc:194] Registered new tserver with Master: 520708c32200408aa03c62e6bda3a566 (127.6.177.67:44013)
I20250114 20:58:06.711164 6853 webserver.cc:458] Webserver started at http://127.6.177.68:41171/ using document root <none> and password file <none>
I20250114 20:58:06.711443 11541 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36460
I20250114 20:58:06.711575 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:06.711815 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:06.712069 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:06.713518 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-3-root/instance:
uuid: "616f393f53ff449185f579e86574bf9e"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.717347 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20250114 20:58:06.720520 11829 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.721146 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:58:06.721390 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-3-root
uuid: "616f393f53ff449185f579e86574bf9e"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.721613 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:06.723862 11818 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:06.738590 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:06.740176 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:06.741401 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:06.743713 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:06.743858 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.744062 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:06.744179 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.793628 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.68:46671
I20250114 20:58:06.793699 11891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.68:46671 every 8 connection(s)
I20250114 20:58:06.799342 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:06.808077 11895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.809779 11896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.811599 11892 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:06.812078 11892 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:06.812899 11892 heartbeater.cc:510] Master 127.6.177.126:45209 requested a full tablet report, sending...
I20250114 20:58:06.813845 6853 server_base.cc:1034] running on GCE node
W20250114 20:58:06.814718 11898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.815750 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:06.815968 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:06.816190 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888286816171 us; error 0 us; skew 500 ppm
I20250114 20:58:06.814705 11540 ts_manager.cc:194] Registered new tserver with Master: 616f393f53ff449185f579e86574bf9e (127.6.177.68:46671)
I20250114 20:58:06.816749 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:06.818205 11540 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36468
I20250114 20:58:06.824616 6853 webserver.cc:458] Webserver started at http://127.6.177.69:36789/ using document root <none> and password file <none>
I20250114 20:58:06.824994 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:06.825132 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:06.825297 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:06.826160 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-4-root/instance:
uuid: "890bbe172afb461380670ff8145ebec5"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.830415 11892 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:06.831285 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20250114 20:58:06.834578 11903 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.835229 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20250114 20:58:06.835510 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-4-root
uuid: "890bbe172afb461380670ff8145ebec5"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.835736 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-4-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-4-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-4-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:06.854729 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:06.856074 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:06.857661 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:06.859781 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:06.859938 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.860147 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:06.860275 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.938287 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.69:43211
I20250114 20:58:06.938426 11965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.69:43211 every 8 connection(s)
I20250114 20:58:06.944051 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:06.952888 11969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:06.955240 11970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.959146 11966 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:06.959451 11966 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:06.959983 11966 heartbeater.cc:510] Master 127.6.177.126:45209 requested a full tablet report, sending...
I20250114 20:58:06.962116 11540 ts_manager.cc:194] Registered new tserver with Master: 890bbe172afb461380670ff8145ebec5 (127.6.177.69:43211)
W20250114 20:58:06.963688 11972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:06.963824 11540 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36484
I20250114 20:58:06.965011 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:06.965840 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:06.966015 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:06.966166 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888286966152 us; error 0 us; skew 500 ppm
I20250114 20:58:06.966576 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:06.968497 6853 webserver.cc:458] Webserver started at http://127.6.177.70:40827/ using document root <none> and password file <none>
I20250114 20:58:06.968866 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:06.969030 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:06.969228 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:06.970312 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-5-root/instance:
uuid: "c12bd16e4e8b4e57950d03d9bd426eb4"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.974238 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20250114 20:58:06.976011 11966 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:06.978921 11977 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:06.979547 6853 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250114 20:58:06.979758 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-5-root
uuid: "c12bd16e4e8b4e57950d03d9bd426eb4"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:06.979951 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-5-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-5-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-5-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:07.005577 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:07.006703 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:07.008481 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:07.011626 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:07.011778 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:07.011925 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:07.012058 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:07.093379 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.70:39801
I20250114 20:58:07.093508 12039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.70:39801 every 8 connection(s)
I20250114 20:58:07.103369 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:07.110723 12043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:07.115263 12040 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:07.115635 12040 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:07.116394 12040 heartbeater.cc:510] Master 127.6.177.126:45209 requested a full tablet report, sending...
W20250114 20:58:07.117519 12044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:07.118250 11539 ts_manager.cc:194] Registered new tserver with Master: c12bd16e4e8b4e57950d03d9bd426eb4 (127.6.177.70:39801)
I20250114 20:58:07.119360 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:07.119747 11539 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36490
W20250114 20:58:07.120883 12046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:07.121896 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:07.122272 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:07.122517 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888287122498 us; error 0 us; skew 500 ppm
I20250114 20:58:07.123257 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:07.125666 6853 webserver.cc:458] Webserver started at http://127.6.177.71:38889/ using document root <none> and password file <none>
I20250114 20:58:07.126068 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:07.126245 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:07.126521 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:07.127722 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-6-root/instance:
uuid: "98480fe86e2f4bcfbec175876517e487"
format_stamp: "Formatted at 2025-01-14 20:58:07 on dist-test-slave-26qh"
I20250114 20:58:07.131461 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20250114 20:58:07.132792 12040 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:07.135984 12051 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:07.136703 6853 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20250114 20:58:07.136950 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-6-root
uuid: "98480fe86e2f4bcfbec175876517e487"
format_stamp: "Formatted at 2025-01-14 20:58:07 on dist-test-slave-26qh"
I20250114 20:58:07.137298 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-6-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-6-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/ts-6-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:07.165565 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:07.166769 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:07.168363 6853 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250114 20:58:07.170785 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:07.171046 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:07.171883 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:07.172139 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:07.264062 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.71:35829
I20250114 20:58:07.264246 12113 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.71:35829 every 8 connection(s)
I20250114 20:58:07.278260 12114 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:07.278606 12114 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:07.279244 12114 heartbeater.cc:510] Master 127.6.177.126:45209 requested a full tablet report, sending...
I20250114 20:58:07.280666 11539 ts_manager.cc:194] Registered new tserver with Master: 98480fe86e2f4bcfbec175876517e487 (127.6.177.71:35829)
I20250114 20:58:07.281108 6853 internal_mini_cluster.cc:371] 7 TS(s) registered with all masters after 0.013344219s
I20250114 20:58:07.281821 11539 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36504
I20250114 20:58:07.294265 12114 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:07.309454 11539 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36506:
name: "replication_limits"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
W20250114 20:58:07.453246 11979 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.6.177.126:45209, user_credentials={real_user=slave}} blocked reactor thread for 56580.9us
I20250114 20:58:07.455799 11634 tablet_service.cc:1467] Processing CreateTablet for tablet f3084b6d69034faca9c40dd52b733f76 (DEFAULT_TABLE table=replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:07.458135 11634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3084b6d69034faca9c40dd52b733f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:07.465130 12079 tablet_service.cc:1467] Processing CreateTablet for tablet f3084b6d69034faca9c40dd52b733f76 (DEFAULT_TABLE table=replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:07.466583 12079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3084b6d69034faca9c40dd52b733f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:07.473078 11857 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1acb7dd4fa4bdfa7c645dea4bbc20d (DEFAULT_TABLE table=replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:07.473228 11931 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1acb7dd4fa4bdfa7c645dea4bbc20d (DEFAULT_TABLE table=replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:07.474032 11857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f1acb7dd4fa4bdfa7c645dea4bbc20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:07.474520 11931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f1acb7dd4fa4bdfa7c645dea4bbc20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:07.490386 12005 tablet_service.cc:1467] Processing CreateTablet for tablet 9f1acb7dd4fa4bdfa7c645dea4bbc20d (DEFAULT_TABLE table=replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:07.492558 12005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f1acb7dd4fa4bdfa7c645dea4bbc20d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:07.510950 11709 tablet_service.cc:1467] Processing CreateTablet for tablet f3084b6d69034faca9c40dd52b733f76 (DEFAULT_TABLE table=replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:07.512331 11709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3084b6d69034faca9c40dd52b733f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:07.538944 12140 tablet_bootstrap.cc:492] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0: Bootstrap starting.
I20250114 20:58:07.546859 12138 tablet_bootstrap.cc:492] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: Bootstrap starting.
I20250114 20:58:07.548668 12139 tablet_bootstrap.cc:492] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5: Bootstrap starting.
I20250114 20:58:07.558732 12138 tablet_bootstrap.cc:654] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:07.564536 12142 tablet_bootstrap.cc:492] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487: Bootstrap starting.
I20250114 20:58:07.565999 12141 tablet_bootstrap.cc:492] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4: Bootstrap starting.
I20250114 20:58:07.581319 12139 tablet_bootstrap.cc:654] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:07.588236 12140 tablet_bootstrap.cc:654] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:07.591024 12143 tablet_bootstrap.cc:492] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: Bootstrap starting.
I20250114 20:58:07.604718 12142 tablet_bootstrap.cc:654] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:07.606917 12138 tablet_bootstrap.cc:492] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: No bootstrap required, opened a new log
I20250114 20:58:07.607465 12138 ts_tablet_manager.cc:1397] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.012s
I20250114 20:58:07.614528 12138 raft_consensus.cc:357] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.615623 12138 raft_consensus.cc:383] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:07.615945 12138 raft_consensus.cc:738] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616f393f53ff449185f579e86574bf9e, State: Initialized, Role: FOLLOWER
I20250114 20:58:07.616375 12141 tablet_bootstrap.cc:654] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:07.616850 12138 consensus_queue.cc:260] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.628319 12143 tablet_bootstrap.cc:654] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:07.626446 12139 tablet_bootstrap.cc:492] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5: No bootstrap required, opened a new log
I20250114 20:58:07.631137 12139 ts_tablet_manager.cc:1397] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5: Time spent bootstrapping tablet: real 0.083s user 0.010s sys 0.017s
I20250114 20:58:07.638865 12142 tablet_bootstrap.cc:492] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487: No bootstrap required, opened a new log
I20250114 20:58:07.639472 12142 ts_tablet_manager.cc:1397] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487: Time spent bootstrapping tablet: real 0.086s user 0.016s sys 0.000s
I20250114 20:58:07.644701 12142 raft_consensus.cc:357] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.645387 12142 raft_consensus.cc:383] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:07.645721 12142 raft_consensus.cc:738] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98480fe86e2f4bcfbec175876517e487, State: Initialized, Role: FOLLOWER
I20250114 20:58:07.650014 12142 consensus_queue.cc:260] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.652117 12138 ts_tablet_manager.cc:1428] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: Time spent starting tablet: real 0.044s user 0.010s sys 0.005s
I20250114 20:58:07.653553 12141 tablet_bootstrap.cc:492] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4: No bootstrap required, opened a new log
I20250114 20:58:07.654670 12141 ts_tablet_manager.cc:1397] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4: Time spent bootstrapping tablet: real 0.091s user 0.007s sys 0.017s
I20250114 20:58:07.657097 12141 raft_consensus.cc:357] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.653805 12140 tablet_bootstrap.cc:492] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0: No bootstrap required, opened a new log
I20250114 20:58:07.658298 12140 ts_tablet_manager.cc:1397] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0: Time spent bootstrapping tablet: real 0.120s user 0.011s sys 0.011s
I20250114 20:58:07.662881 12140 raft_consensus.cc:357] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.666085 12140 raft_consensus.cc:383] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:07.666438 12140 raft_consensus.cc:738] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3992df6473c442dd81ab1eacb0649af0, State: Initialized, Role: FOLLOWER
I20250114 20:58:07.659866 12143 tablet_bootstrap.cc:492] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: No bootstrap required, opened a new log
I20250114 20:58:07.667120 12143 ts_tablet_manager.cc:1397] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.010s
I20250114 20:58:07.650457 12139 raft_consensus.cc:357] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.665766 12141 raft_consensus.cc:383] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:07.671169 12141 raft_consensus.cc:738] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12bd16e4e8b4e57950d03d9bd426eb4, State: Initialized, Role: FOLLOWER
I20250114 20:58:07.669454 12143 raft_consensus.cc:357] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.672250 12143 raft_consensus.cc:383] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:07.671908 12141 consensus_queue.cc:260] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.670312 12140 consensus_queue.cc:260] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.672757 12143 raft_consensus.cc:738] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 205a5606475446d0a202483e4be6fd96, State: Initialized, Role: FOLLOWER
I20250114 20:58:07.673727 12143 consensus_queue.cc:260] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.670010 12139 raft_consensus.cc:383] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:07.680362 12139 raft_consensus.cc:738] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890bbe172afb461380670ff8145ebec5, State: Initialized, Role: FOLLOWER
I20250114 20:58:07.681859 12139 consensus_queue.cc:260] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.698279 12142 ts_tablet_manager.cc:1428] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487: Time spent starting tablet: real 0.058s user 0.011s sys 0.036s
I20250114 20:58:07.702625 12140 ts_tablet_manager.cc:1428] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0: Time spent starting tablet: real 0.042s user 0.005s sys 0.009s
I20250114 20:58:07.705317 12143 ts_tablet_manager.cc:1428] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: Time spent starting tablet: real 0.038s user 0.012s sys 0.007s
I20250114 20:58:07.718230 12139 ts_tablet_manager.cc:1428] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5: Time spent starting tablet: real 0.083s user 0.003s sys 0.005s
I20250114 20:58:07.720321 12141 ts_tablet_manager.cc:1428] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4: Time spent starting tablet: real 0.065s user 0.009s sys 0.024s
I20250114 20:58:07.807264 12154 raft_consensus.cc:491] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250114 20:58:07.807808 12154 raft_consensus.cc:513] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.810911 12154 leader_election.cc:290] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3992df6473c442dd81ab1eacb0649af0 (127.6.177.65:45437), 98480fe86e2f4bcfbec175876517e487 (127.6.177.71:35829)
I20250114 20:58:07.819600 11644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3084b6d69034faca9c40dd52b733f76" candidate_uuid: "205a5606475446d0a202483e4be6fd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3992df6473c442dd81ab1eacb0649af0" is_pre_election: true
I20250114 20:58:07.820521 11644 raft_consensus.cc:2463] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 205a5606475446d0a202483e4be6fd96 in term 0.
I20250114 20:58:07.822199 12089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3084b6d69034faca9c40dd52b733f76" candidate_uuid: "205a5606475446d0a202483e4be6fd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98480fe86e2f4bcfbec175876517e487" is_pre_election: true
I20250114 20:58:07.822969 12089 raft_consensus.cc:2463] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 205a5606475446d0a202483e4be6fd96 in term 0.
I20250114 20:58:07.823287 11683 leader_election.cc:304] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 205a5606475446d0a202483e4be6fd96, 3992df6473c442dd81ab1eacb0649af0; no voters:
I20250114 20:58:07.824198 12154 raft_consensus.cc:2798] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250114 20:58:07.824522 12154 raft_consensus.cc:491] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250114 20:58:07.824796 12154 raft_consensus.cc:3054] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:07.829291 12154 raft_consensus.cc:513] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.830595 12154 leader_election.cc:290] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [CANDIDATE]: Term 1 election: Requested vote from peers 3992df6473c442dd81ab1eacb0649af0 (127.6.177.65:45437), 98480fe86e2f4bcfbec175876517e487 (127.6.177.71:35829)
I20250114 20:58:07.831171 11644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3084b6d69034faca9c40dd52b733f76" candidate_uuid: "205a5606475446d0a202483e4be6fd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3992df6473c442dd81ab1eacb0649af0"
I20250114 20:58:07.831738 11644 raft_consensus.cc:3054] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:07.831844 12089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3084b6d69034faca9c40dd52b733f76" candidate_uuid: "205a5606475446d0a202483e4be6fd96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98480fe86e2f4bcfbec175876517e487"
I20250114 20:58:07.832368 12089 raft_consensus.cc:3054] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:07.837046 11644 raft_consensus.cc:2463] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 205a5606475446d0a202483e4be6fd96 in term 1.
I20250114 20:58:07.837199 12089 raft_consensus.cc:2463] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 205a5606475446d0a202483e4be6fd96 in term 1.
I20250114 20:58:07.838078 11683 leader_election.cc:304] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 205a5606475446d0a202483e4be6fd96, 3992df6473c442dd81ab1eacb0649af0; no voters:
I20250114 20:58:07.839265 12154 raft_consensus.cc:2798] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:07.841779 12154 raft_consensus.cc:695] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 1 LEADER]: Becoming Leader. State: Replica: 205a5606475446d0a202483e4be6fd96, State: Running, Role: LEADER
I20250114 20:58:07.842614 12154 consensus_queue.cc:237] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } }
I20250114 20:58:07.848642 11541 catalog_manager.cc:5526] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 205a5606475446d0a202483e4be6fd96 (127.6.177.66). New cstate: current_term: 1 leader_uuid: "205a5606475446d0a202483e4be6fd96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98480fe86e2f4bcfbec175876517e487" member_type: VOTER last_known_addr { host: "127.6.177.71" port: 35829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "205a5606475446d0a202483e4be6fd96" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 39725 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:07.873575 12150 raft_consensus.cc:491] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250114 20:58:07.874011 12150 raft_consensus.cc:513] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.875963 12150 leader_election.cc:290] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 890bbe172afb461380670ff8145ebec5 (127.6.177.69:43211), c12bd16e4e8b4e57950d03d9bd426eb4 (127.6.177.70:39801)
I20250114 20:58:07.889528 12014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1acb7dd4fa4bdfa7c645dea4bbc20d" candidate_uuid: "616f393f53ff449185f579e86574bf9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" is_pre_election: true
I20250114 20:58:07.890234 12014 raft_consensus.cc:2463] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616f393f53ff449185f579e86574bf9e in term 0.
I20250114 20:58:07.891431 11941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1acb7dd4fa4bdfa7c645dea4bbc20d" candidate_uuid: "616f393f53ff449185f579e86574bf9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890bbe172afb461380670ff8145ebec5" is_pre_election: true
I20250114 20:58:07.891973 11941 raft_consensus.cc:2463] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616f393f53ff449185f579e86574bf9e in term 0.
I20250114 20:58:07.893378 11831 leader_election.cc:304] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 616f393f53ff449185f579e86574bf9e, c12bd16e4e8b4e57950d03d9bd426eb4; no voters:
I20250114 20:58:07.893980 12150 raft_consensus.cc:2798] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250114 20:58:07.894351 12150 raft_consensus.cc:491] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250114 20:58:07.894577 12150 raft_consensus.cc:3054] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:07.898625 12150 raft_consensus.cc:513] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.900331 12150 leader_election.cc:290] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [CANDIDATE]: Term 1 election: Requested vote from peers 890bbe172afb461380670ff8145ebec5 (127.6.177.69:43211), c12bd16e4e8b4e57950d03d9bd426eb4 (127.6.177.70:39801)
I20250114 20:58:07.903594 11941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1acb7dd4fa4bdfa7c645dea4bbc20d" candidate_uuid: "616f393f53ff449185f579e86574bf9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "890bbe172afb461380670ff8145ebec5"
I20250114 20:58:07.904114 11941 raft_consensus.cc:3054] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:07.904390 12014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f1acb7dd4fa4bdfa7c645dea4bbc20d" candidate_uuid: "616f393f53ff449185f579e86574bf9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4"
I20250114 20:58:07.904914 12014 raft_consensus.cc:3054] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:07.908660 11941 raft_consensus.cc:2463] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616f393f53ff449185f579e86574bf9e in term 1.
I20250114 20:58:07.909183 12014 raft_consensus.cc:2463] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616f393f53ff449185f579e86574bf9e in term 1.
I20250114 20:58:07.909479 11831 leader_election.cc:304] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 616f393f53ff449185f579e86574bf9e, 890bbe172afb461380670ff8145ebec5; no voters:
I20250114 20:58:07.910203 12150 raft_consensus.cc:2798] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:07.910938 12150 raft_consensus.cc:695] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 1 LEADER]: Becoming Leader. State: Replica: 616f393f53ff449185f579e86574bf9e, State: Running, Role: LEADER
I20250114 20:58:07.911561 12150 consensus_queue.cc:237] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } }
I20250114 20:58:07.921761 11539 catalog_manager.cc:5526] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 616f393f53ff449185f579e86574bf9e (127.6.177.68). New cstate: current_term: 1 leader_uuid: "616f393f53ff449185f579e86574bf9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "890bbe172afb461380670ff8145ebec5" member_type: VOTER last_known_addr { host: "127.6.177.69" port: 43211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c12bd16e4e8b4e57950d03d9bd426eb4" member_type: VOTER last_known_addr { host: "127.6.177.70" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616f393f53ff449185f579e86574bf9e" member_type: VOTER last_known_addr { host: "127.6.177.68" port: 46671 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:07.998970 11541 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36506:
name: "replication_limits"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: -1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
I20250114 20:58:08.003614 11541 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36506:
name: "replication_limits"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 0
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
I20250114 20:58:08.011662 11541 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36506:
name: "replication_limits"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
I20250114 20:58:08.016443 11541 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36506:
name: "replication_limits"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
I20250114 20:58:08.019173 6853 tablet_server.cc:178] TabletServer@127.6.177.66:0 shutting down...
I20250114 20:58:08.058619 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:08.061358 6853 tablet_replica.cc:331] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: stopping tablet replica
I20250114 20:58:08.062335 6853 raft_consensus.cc:2238] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:08.063946 6853 pending_rounds.cc:62] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: Trying to abort 1 pending ops.
I20250114 20:58:08.064352 6853 pending_rounds.cc:69] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114294427011592192 op_type: NO_OP noop_request { }
I20250114 20:58:08.065094 6853 raft_consensus.cc:2883] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250114 20:58:08.065544 6853 raft_consensus.cc:2267] T f3084b6d69034faca9c40dd52b733f76 P 205a5606475446d0a202483e4be6fd96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.093457 6853 tablet_server.cc:195] TabletServer@127.6.177.66:0 shutdown complete.
I20250114 20:58:08.109254 6853 tablet_server.cc:178] TabletServer@127.6.177.67:0 shutting down...
I20250114 20:58:08.141095 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:08.157617 6853 tablet_server.cc:195] TabletServer@127.6.177.67:0 shutdown complete.
I20250114 20:58:08.169706 6853 tablet_server.cc:178] TabletServer@127.6.177.68:0 shutting down...
I20250114 20:58:08.203598 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:08.204202 6853 tablet_replica.cc:331] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: stopping tablet replica
I20250114 20:58:08.204989 6853 raft_consensus.cc:2238] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:08.206079 6853 pending_rounds.cc:62] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: Trying to abort 1 pending ops.
I20250114 20:58:08.206346 6853 pending_rounds.cc:69] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114294427292524544 op_type: NO_OP noop_request { }
I20250114 20:58:08.207612 6853 raft_consensus.cc:2883] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250114 20:58:08.208060 6853 raft_consensus.cc:2267] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 616f393f53ff449185f579e86574bf9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.228070 6853 tablet_server.cc:195] TabletServer@127.6.177.68:0 shutdown complete.
I20250114 20:58:08.240340 6853 tablet_server.cc:178] TabletServer@127.6.177.69:0 shutting down...
I20250114 20:58:08.272737 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:08.273319 6853 tablet_replica.cc:331] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5: stopping tablet replica
I20250114 20:58:08.273747 6853 raft_consensus.cc:2238] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:08.274081 6853 raft_consensus.cc:2267] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P 890bbe172afb461380670ff8145ebec5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.282691 6853 tablet_server.cc:195] TabletServer@127.6.177.69:0 shutdown complete.
I20250114 20:58:08.291795 6853 tablet_server.cc:178] TabletServer@127.6.177.70:0 shutting down...
I20250114 20:58:08.316599 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:08.317145 6853 tablet_replica.cc:331] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4: stopping tablet replica
I20250114 20:58:08.317569 6853 raft_consensus.cc:2238] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:08.318003 6853 raft_consensus.cc:2267] T 9f1acb7dd4fa4bdfa7c645dea4bbc20d P c12bd16e4e8b4e57950d03d9bd426eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.335695 6853 tablet_server.cc:195] TabletServer@127.6.177.70:0 shutdown complete.
I20250114 20:58:08.345188 6853 tablet_server.cc:178] TabletServer@127.6.177.71:0 shutting down...
I20250114 20:58:08.364082 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:08.364598 6853 tablet_replica.cc:331] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487: stopping tablet replica
I20250114 20:58:08.365036 6853 raft_consensus.cc:2238] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:08.365470 6853 raft_consensus.cc:2267] T f3084b6d69034faca9c40dd52b733f76 P 98480fe86e2f4bcfbec175876517e487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.381978 6853 tablet_server.cc:195] TabletServer@127.6.177.71:0 shutdown complete.
I20250114 20:58:08.389727 6853 master.cc:537] Master@127.6.177.126:45209 shutting down...
I20250114 20:58:08.406270 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:08.406813 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.407137 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: stopping tablet replica
I20250114 20:58:08.426752 6853 master.cc:559] Master@127.6.177.126:45209 shutdown complete.
I20250114 20:58:08.444006 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:08.450388 12169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:08.451020 12170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:08.451891 12172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:08.452769 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:08.453574 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:08.453742 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:08.453862 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888288453854 us; error 0 us; skew 500 ppm
I20250114 20:58:08.454252 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:08.457173 6853 webserver.cc:458] Webserver started at http://127.6.177.126:38967/ using document root <none> and password file <none>
I20250114 20:58:08.457531 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:08.457700 6853 fs_manager.cc:365] Using existing metadata directory in first data directory
I20250114 20:58:08.460876 6853 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:58:08.463407 12177 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:08.464133 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:08.464391 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "07ca15b452f5437e9b676561317e354b"
format_stamp: "Formatted at 2025-01-14 20:58:06 on dist-test-slave-26qh"
I20250114 20:58:08.464700 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ReplicationFactorLimitsTest.MinReplicationFactor.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:08.495958 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:08.496904 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:08.532039 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:45209
I20250114 20:58:08.532131 12228 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:45209 every 8 connection(s)
I20250114 20:58:08.542660 12229 sys_catalog.cc:263] Verifying existing consensus state
I20250114 20:58:08.548259 12229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: Bootstrap starting.
I20250114 20:58:08.549191 11669 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45209
I20250114 20:58:08.577634 12229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=6 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250114 20:58:08.578383 12229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: Bootstrap complete.
I20250114 20:58:08.580706 12229 raft_consensus.cc:357] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:08.581182 12229 raft_consensus.cc:738] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07ca15b452f5437e9b676561317e354b, State: Initialized, Role: FOLLOWER
I20250114 20:58:08.581719 12229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:08.582172 12229 raft_consensus.cc:397] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:08.582412 12229 raft_consensus.cc:491] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:08.582708 12229 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 1 FOLLOWER]: Advancing to term 2
I20250114 20:58:08.587236 12229 raft_consensus.cc:513] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:08.587704 12229 leader_election.cc:304] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07ca15b452f5437e9b676561317e354b; no voters:
I20250114 20:58:08.588896 12229 leader_election.cc:290] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [CANDIDATE]: Term 2 election: Requested vote from peers
I20250114 20:58:08.589262 12233 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 2 FOLLOWER]: Leader election won for term 2
I20250114 20:58:08.591252 12233 raft_consensus.cc:695] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 2 LEADER]: Becoming Leader. State: Replica: 07ca15b452f5437e9b676561317e354b, State: Running, Role: LEADER
I20250114 20:58:08.591878 12229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:08.591922 12233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER }
I20250114 20:58:08.596912 12234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "07ca15b452f5437e9b676561317e354b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER } }
I20250114 20:58:08.597062 12235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07ca15b452f5437e9b676561317e354b. Latest consensus state: current_term: 2 leader_uuid: "07ca15b452f5437e9b676561317e354b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ca15b452f5437e9b676561317e354b" member_type: VOTER } }
I20250114 20:58:08.597515 12234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:08.597548 12235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:08.599720 12241 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:08.606227 12241 catalog_manager.cc:670] Loaded metadata for table replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58]
I20250114 20:58:08.610890 12241 tablet_loader.cc:96] loaded metadata for tablet 9f1acb7dd4fa4bdfa7c645dea4bbc20d (table replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58])
I20250114 20:58:08.611872 12241 tablet_loader.cc:96] loaded metadata for tablet f3084b6d69034faca9c40dd52b733f76 (table replication_limits [id=4cfb53bd1e274ad68b5fd4a63fc69a58])
I20250114 20:58:08.612802 12241 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:08.615548 12194 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "3992df6473c442dd81ab1eacb0649af0" instance_seqno: 1736888286494229) as {username='slave'} at 127.0.0.1:38538; Asking this server to re-register.
I20250114 20:58:08.616519 12241 catalog_manager.cc:1260] Loaded cluster ID: 67cb0702f3184836b01983df619b9d6d
I20250114 20:58:08.616577 11669 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:08.616873 12241 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:08.619019 12194 ts_manager.cc:194] Registered new tserver with Master: 3992df6473c442dd81ab1eacb0649af0 (127.6.177.65:45437)
I20250114 20:58:08.621572 12241 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:08.624428 12241 catalog_manager.cc:5910] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b: Loaded TSK: 0
I20250114 20:58:08.625213 12241 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:08.643368 11669 heartbeater.cc:502] Master 127.6.177.126:45209 was elected leader, sending a full tablet report...
I20250114 20:58:08.653815 12194 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38548:
name: "foobar"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:08.657477 12194 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38548:
name: "foobar"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:08.660830 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:08.684238 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:08.684724 6853 tablet_replica.cc:331] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0: stopping tablet replica
I20250114 20:58:08.685156 6853 raft_consensus.cc:2238] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:08.685463 6853 raft_consensus.cc:2267] T f3084b6d69034faca9c40dd52b733f76 P 3992df6473c442dd81ab1eacb0649af0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.702121 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:08.711650 6853 master.cc:537] Master@127.6.177.126:45209 shutting down...
I20250114 20:58:08.733244 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 2 LEADER]: Raft consensus shutting down.
I20250114 20:58:08.733686 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 07ca15b452f5437e9b676561317e354b [term 2 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:08.734035 6853 tablet_replica.cc:331] stopping tablet replica
I20250114 20:58:08.751454 6853 master.cc:559] Master@127.6.177.126:45209 shutdown complete.
[ OK ] ReplicationFactorLimitsTest.MinReplicationFactor (2540 ms)
[----------] 1 test from ReplicationFactorLimitsTest (2540 ms total)
[----------] 1 test from ClientTestMetacache
[ RUN ] ClientTestMetacache.TestClientMetacacheRecursion
I20250114 20:58:08.777271 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:33993
I20250114 20:58:08.778173 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:08.782313 12251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:08.783182 12252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:08.783936 12254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:08.784135 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:08.784704 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:08.784852 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:08.784948 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888288784940 us; error 0 us; skew 500 ppm
I20250114 20:58:08.785311 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:08.787282 6853 webserver.cc:458] Webserver started at http://127.6.177.126:45923/ using document root <none> and password file <none>
I20250114 20:58:08.787639 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:08.787770 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:08.787948 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:08.788791 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "61136c307f9b4856a1a5ad19e022197a"
format_stamp: "Formatted at 2025-01-14 20:58:08 on dist-test-slave-26qh"
I20250114 20:58:08.792327 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20250114 20:58:08.794934 12259 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:08.795616 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:58:08.795817 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "61136c307f9b4856a1a5ad19e022197a"
format_stamp: "Formatted at 2025-01-14 20:58:08 on dist-test-slave-26qh"
I20250114 20:58:08.796006 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:08.810786 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:08.811614 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:08.846958 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:33993
I20250114 20:58:08.847098 12320 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:33993 every 8 connection(s)
I20250114 20:58:08.850164 12321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:08.860042 12321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a: Bootstrap starting.
I20250114 20:58:08.864111 12321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:08.867630 12321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a: No bootstrap required, opened a new log
I20250114 20:58:08.869422 12321 raft_consensus.cc:357] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61136c307f9b4856a1a5ad19e022197a" member_type: VOTER }
I20250114 20:58:08.869760 12321 raft_consensus.cc:383] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:08.869975 12321 raft_consensus.cc:738] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61136c307f9b4856a1a5ad19e022197a, State: Initialized, Role: FOLLOWER
I20250114 20:58:08.870541 12321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61136c307f9b4856a1a5ad19e022197a" member_type: VOTER }
I20250114 20:58:08.871021 12321 raft_consensus.cc:397] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:08.871275 12321 raft_consensus.cc:491] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:08.871538 12321 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:08.875602 12321 raft_consensus.cc:513] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61136c307f9b4856a1a5ad19e022197a" member_type: VOTER }
I20250114 20:58:08.876055 12321 leader_election.cc:304] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61136c307f9b4856a1a5ad19e022197a; no voters:
I20250114 20:58:08.876984 12321 leader_election.cc:290] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:08.877220 12324 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:08.878494 12324 raft_consensus.cc:695] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 1 LEADER]: Becoming Leader. State: Replica: 61136c307f9b4856a1a5ad19e022197a, State: Running, Role: LEADER
I20250114 20:58:08.879150 12324 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61136c307f9b4856a1a5ad19e022197a" member_type: VOTER }
I20250114 20:58:08.879809 12321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:08.881721 12325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61136c307f9b4856a1a5ad19e022197a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61136c307f9b4856a1a5ad19e022197a" member_type: VOTER } }
I20250114 20:58:08.881776 12326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61136c307f9b4856a1a5ad19e022197a. Latest consensus state: current_term: 1 leader_uuid: "61136c307f9b4856a1a5ad19e022197a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61136c307f9b4856a1a5ad19e022197a" member_type: VOTER } }
I20250114 20:58:08.882632 12326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:08.882587 12325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:08.885202 12331 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:08.889480 12331 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:08.893857 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:08.898272 12331 catalog_manager.cc:1348] Generated new cluster ID: 6f859bcf81194805bf69e607e8dec04b
I20250114 20:58:08.898473 12331 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:08.915917 12331 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:08.916884 12331 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:08.929172 12331 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a: Generated new TSK 0
I20250114 20:58:08.929633 12331 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:08.959785 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:08.964486 12342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:08.965484 12343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:08.966635 12345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:08.967413 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:08.968061 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:08.968211 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:08.968317 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888288968305 us; error 0 us; skew 500 ppm
I20250114 20:58:08.968693 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:08.970551 6853 webserver.cc:458] Webserver started at http://127.6.177.65:36371/ using document root <none> and password file <none>
I20250114 20:58:08.970917 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:08.971057 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:08.971283 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:08.972164 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "1c7e412ed1cb4dafb49da4c11381b995"
format_stamp: "Formatted at 2025-01-14 20:58:08 on dist-test-slave-26qh"
I20250114 20:58:08.975955 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:58:08.978523 12350 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:08.979208 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:58:08.979427 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "1c7e412ed1cb4dafb49da4c11381b995"
format_stamp: "Formatted at 2025-01-14 20:58:08 on dist-test-slave-26qh"
I20250114 20:58:08.979641 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:09.004956 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:09.005893 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:09.011763 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:09.011979 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:09.012207 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:09.012372 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:09.056565 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:39571
I20250114 20:58:09.056648 12420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:39571 every 8 connection(s)
I20250114 20:58:09.060487 12421 heartbeater.cc:346] Connected to a master server at 127.6.177.126:33993
I20250114 20:58:09.060799 12421 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:09.061359 12421 heartbeater.cc:510] Master 127.6.177.126:33993 requested a full tablet report, sending...
I20250114 20:58:09.062907 12276 ts_manager.cc:194] Registered new tserver with Master: 1c7e412ed1cb4dafb49da4c11381b995 (127.6.177.65:39571)
I20250114 20:58:09.063045 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003682843s
I20250114 20:58:09.064795 12276 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48528
I20250114 20:58:09.076898 12421 heartbeater.cc:502] Master 127.6.177.126:33993 was elected leader, sending a full tablet report...
I20250114 20:58:09.083153 12275 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48550:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:09.111994 12386 tablet_service.cc:1467] Processing CreateTablet for tablet 6fec61754f6a456abd6fb24394286efc (DEFAULT_TABLE table=client-testtb [id=fd95e93c52ed4ea083528075503bdb4a]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:58:09.112082 12385 tablet_service.cc:1467] Processing CreateTablet for tablet 47727fc56c7f4064bdf21b8397ed9250 (DEFAULT_TABLE table=client-testtb [id=fd95e93c52ed4ea083528075503bdb4a]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:58:09.113250 12386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fec61754f6a456abd6fb24394286efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:09.113718 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47727fc56c7f4064bdf21b8397ed9250. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:09.125247 12431 tablet_bootstrap.cc:492] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995: Bootstrap starting.
I20250114 20:58:09.129259 12431 tablet_bootstrap.cc:654] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:09.133574 12431 tablet_bootstrap.cc:492] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995: No bootstrap required, opened a new log
I20250114 20:58:09.133895 12431 ts_tablet_manager.cc:1397] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20250114 20:58:09.135754 12431 raft_consensus.cc:357] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.136157 12431 raft_consensus.cc:383] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:09.136358 12431 raft_consensus.cc:738] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Initialized, Role: FOLLOWER
I20250114 20:58:09.136793 12431 consensus_queue.cc:260] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.137328 12431 raft_consensus.cc:397] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:09.137552 12431 raft_consensus.cc:491] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:09.137823 12431 raft_consensus.cc:3054] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:09.141791 12431 raft_consensus.cc:513] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.142258 12431 leader_election.cc:304] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c7e412ed1cb4dafb49da4c11381b995; no voters:
I20250114 20:58:09.143540 12431 leader_election.cc:290] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:09.143945 12433 raft_consensus.cc:2798] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:09.145431 12433 raft_consensus.cc:695] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Becoming Leader. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Running, Role: LEADER
I20250114 20:58:09.145867 12431 ts_tablet_manager.cc:1428] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20250114 20:58:09.146082 12433 consensus_queue.cc:237] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.146696 12431 tablet_bootstrap.cc:492] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995: Bootstrap starting.
I20250114 20:58:09.152601 12431 tablet_bootstrap.cc:654] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:09.153760 12275 catalog_manager.cc:5526] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7e412ed1cb4dafb49da4c11381b995 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "1c7e412ed1cb4dafb49da4c11381b995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:09.156567 12431 tablet_bootstrap.cc:492] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995: No bootstrap required, opened a new log
I20250114 20:58:09.156955 12431 ts_tablet_manager.cc:1397] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20250114 20:58:09.159277 12431 raft_consensus.cc:357] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.159857 12431 raft_consensus.cc:383] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:09.160115 12431 raft_consensus.cc:738] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Initialized, Role: FOLLOWER
I20250114 20:58:09.160599 12431 consensus_queue.cc:260] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.161085 12431 raft_consensus.cc:397] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:09.161280 12431 raft_consensus.cc:491] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:09.161495 12431 raft_consensus.cc:3054] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:09.165531 12431 raft_consensus.cc:513] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.166040 12431 leader_election.cc:304] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c7e412ed1cb4dafb49da4c11381b995; no voters:
I20250114 20:58:09.166514 12431 leader_election.cc:290] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:09.166644 12433 raft_consensus.cc:2798] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:09.167094 12433 raft_consensus.cc:695] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Becoming Leader. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Running, Role: LEADER
I20250114 20:58:09.167701 12433 consensus_queue.cc:237] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.168164 12431 ts_tablet_manager.cc:1428] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20250114 20:58:09.172650 12275 catalog_manager.cc:5526] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7e412ed1cb4dafb49da4c11381b995 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "1c7e412ed1cb4dafb49da4c11381b995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:09.194548 12275 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48550:
name: "TestClientMetacacheRecursion"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\000\000\000\000\000\007\001\000\001\000\000\000""\006\001\000\000\000\000\000\007\001\000\001\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:09.210188 12385 tablet_service.cc:1467] Processing CreateTablet for tablet 99795170f4ec45ec9ef40e4f99fc4031 (DEFAULT_TABLE table=TestClientMetacacheRecursion [id=8388da317c5748e8a82163a731ad2e45]), partition=RANGE (key) PARTITION 0 <= VALUES < 1
I20250114 20:58:09.211293 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99795170f4ec45ec9ef40e4f99fc4031. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:09.220937 12431 tablet_bootstrap.cc:492] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: Bootstrap starting.
I20250114 20:58:09.225281 12431 tablet_bootstrap.cc:654] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:09.228713 12431 tablet_bootstrap.cc:492] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: No bootstrap required, opened a new log
I20250114 20:58:09.229013 12431 ts_tablet_manager.cc:1397] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20250114 20:58:09.230618 12431 raft_consensus.cc:357] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.231009 12431 raft_consensus.cc:383] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:09.231251 12431 raft_consensus.cc:738] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Initialized, Role: FOLLOWER
I20250114 20:58:09.231688 12431 consensus_queue.cc:260] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.232100 12431 raft_consensus.cc:397] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:09.232333 12431 raft_consensus.cc:491] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:09.232565 12431 raft_consensus.cc:3054] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:09.236959 12431 raft_consensus.cc:513] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.237380 12431 leader_election.cc:304] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c7e412ed1cb4dafb49da4c11381b995; no voters:
I20250114 20:58:09.237818 12431 leader_election.cc:290] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:09.237968 12433 raft_consensus.cc:2798] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:09.238440 12433 raft_consensus.cc:695] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Becoming Leader. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Running, Role: LEADER
I20250114 20:58:09.239128 12433 consensus_queue.cc:237] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.239581 12431 ts_tablet_manager.cc:1428] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20250114 20:58:09.244580 12276 catalog_manager.cc:5526] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7e412ed1cb4dafb49da4c11381b995 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "1c7e412ed1cb4dafb49da4c11381b995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:09.291590 12275 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48550:
table { table_name: "TestClientMetacacheRecursion" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\000\000\000\000\000\007\001\000\001\000\000\000""\006\001\000\000\000\000\000\007\001\000\001\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "non_null_with_default" type: INT32 is_key: false is_nullable: false read_default_value: "90\000\000" encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20250114 20:58:09.301975 12275 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a: Sending DeleteTablet for 1 replicas of tablet 99795170f4ec45ec9ef40e4f99fc4031
I20250114 20:58:09.303722 12385 tablet_service.cc:1514] Processing DeleteTablet for tablet 99795170f4ec45ec9ef40e4f99fc4031 with delete_type TABLET_DATA_DELETED (Partition dropped at 2025-01-14 20:58:09 UTC) from {username='slave'} at 127.0.0.1:34892
I20250114 20:58:09.305225 12449 tablet_replica.cc:331] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: stopping tablet replica
I20250114 20:58:09.305970 12449 raft_consensus.cc:2238] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:09.306586 12449 raft_consensus.cc:2267] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:09.308216 12276 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48550:
table { table_name: "TestClientMetacacheRecursion" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\006\001\000\000\000\000\000\007\001\000\001\000\000\000""\006\001\000\000\000\000\000\007\001\000\001\000\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "non_null_with_default" type: INT32 is_key: false is_nullable: false read_default_value: "90\000\000" encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20250114 20:58:09.309480 12449 ts_tablet_manager.cc:1905] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250114 20:58:09.319082 12276 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e7c5e14824414436a64e5fc2bc61bcf6 has no consensus state
I20250114 20:58:09.321807 12449 ts_tablet_manager.cc:1918] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250114 20:58:09.322238 12449 log.cc:1198] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: Deleting WAL directory at /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.ClientTestMetacache.TestClientMetacacheRecursion.1736888227440588-6853-0/minicluster-data/ts-0-root/wals/99795170f4ec45ec9ef40e4f99fc4031
I20250114 20:58:09.323037 12449 ts_tablet_manager.cc:1939] T 99795170f4ec45ec9ef40e4f99fc4031 P 1c7e412ed1cb4dafb49da4c11381b995: Deleting consensus metadata
I20250114 20:58:09.325302 12263 catalog_manager.cc:4872] TS 1c7e412ed1cb4dafb49da4c11381b995 (127.6.177.65:39571): tablet 99795170f4ec45ec9ef40e4f99fc4031 (table TestClientMetacacheRecursion [id=8388da317c5748e8a82163a731ad2e45]) successfully deleted
I20250114 20:58:09.328023 12385 tablet_service.cc:1467] Processing CreateTablet for tablet e7c5e14824414436a64e5fc2bc61bcf6 (DEFAULT_TABLE table=TestClientMetacacheRecursion [id=8388da317c5748e8a82163a731ad2e45]), partition=RANGE (key) PARTITION 0 <= VALUES < 1
I20250114 20:58:09.328940 12385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c5e14824414436a64e5fc2bc61bcf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:09.338138 12431 tablet_bootstrap.cc:492] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995: Bootstrap starting.
I20250114 20:58:09.342120 12431 tablet_bootstrap.cc:654] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:09.345513 12431 tablet_bootstrap.cc:492] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995: No bootstrap required, opened a new log
I20250114 20:58:09.345845 12431 ts_tablet_manager.cc:1397] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20250114 20:58:09.347960 12431 raft_consensus.cc:357] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.348412 12431 raft_consensus.cc:383] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:09.348704 12431 raft_consensus.cc:738] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Initialized, Role: FOLLOWER
I20250114 20:58:09.349205 12431 consensus_queue.cc:260] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.349583 12431 raft_consensus.cc:397] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:09.349776 12431 raft_consensus.cc:491] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:09.349962 12431 raft_consensus.cc:3054] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:09.353483 12431 raft_consensus.cc:513] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.353922 12431 leader_election.cc:304] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c7e412ed1cb4dafb49da4c11381b995; no voters:
I20250114 20:58:09.354418 12431 leader_election.cc:290] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:09.354578 12433 raft_consensus.cc:2798] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:09.355024 12433 raft_consensus.cc:695] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Becoming Leader. State: Replica: 1c7e412ed1cb4dafb49da4c11381b995, State: Running, Role: LEADER
I20250114 20:58:09.355899 12431 ts_tablet_manager.cc:1428] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995: Time spent starting tablet: real 0.010s user 0.003s sys 0.008s
I20250114 20:58:09.355662 12433 consensus_queue.cc:237] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } }
I20250114 20:58:09.360728 12276 catalog_manager.cc:5526] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c7e412ed1cb4dafb49da4c11381b995 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "1c7e412ed1cb4dafb49da4c11381b995" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c7e412ed1cb4dafb49da4c11381b995" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 39571 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:09.371119 12276 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a: TestClientMetacacheRecursion [id=8388da317c5748e8a82163a731ad2e45] alter complete (version 0)
I20250114 20:58:13.725523 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:13.754348 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:13.754922 6853 tablet_replica.cc:331] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995: stopping tablet replica
I20250114 20:58:13.755642 6853 raft_consensus.cc:2238] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:13.756078 6853 raft_consensus.cc:2267] T e7c5e14824414436a64e5fc2bc61bcf6 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:13.758039 6853 tablet_replica.cc:331] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995: stopping tablet replica
I20250114 20:58:13.758566 6853 raft_consensus.cc:2238] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:13.759016 6853 raft_consensus.cc:2267] T 6fec61754f6a456abd6fb24394286efc P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:13.760848 6853 tablet_replica.cc:331] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995: stopping tablet replica
I20250114 20:58:13.761265 6853 raft_consensus.cc:2238] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:13.761641 6853 raft_consensus.cc:2267] T 47727fc56c7f4064bdf21b8397ed9250 P 1c7e412ed1cb4dafb49da4c11381b995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:13.781279 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:13.798039 6853 master.cc:537] Master@127.6.177.126:33993 shutting down...
I20250114 20:58:13.818228 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:13.818745 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:13.819036 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 61136c307f9b4856a1a5ad19e022197a: stopping tablet replica
I20250114 20:58:13.836369 6853 master.cc:559] Master@127.6.177.126:33993 shutdown complete.
[ OK ] ClientTestMetacache.TestClientMetacacheRecursion (5083 ms)
[----------] 1 test from ClientTestMetacache (5083 ms total)
[----------] 1 test from KeepAlivePeriodically/KeepAlivePeriodicallyTest
[ RUN ] KeepAlivePeriodically/KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate/1
I20250114 20:58:13.861773 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:36353
I20250114 20:58:13.862825 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:13.867863 12659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:13.868284 12660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:13.869627 12662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:13.870447 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:13.872150 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:13.872318 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:13.872418 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888293872410 us; error 0 us; skew 500 ppm
I20250114 20:58:13.872936 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:13.880026 6853 webserver.cc:458] Webserver started at http://127.6.177.126:45527/ using document root <none> and password file <none>
I20250114 20:58:13.880461 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:13.880601 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:13.880818 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:13.881865 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39"
format_stamp: "Formatted at 2025-01-14 20:58:13 on dist-test-slave-26qh"
I20250114 20:58:13.886381 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20250114 20:58:13.889515 12667 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:13.890199 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20250114 20:58:13.890471 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39"
format_stamp: "Formatted at 2025-01-14 20:58:13 on dist-test-slave-26qh"
I20250114 20:58:13.890736 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:13.903614 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:13.904618 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:13.945231 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:36353
I20250114 20:58:13.945310 12728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:36353 every 8 connection(s)
I20250114 20:58:13.948719 12729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:13.958540 12729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39: Bootstrap starting.
I20250114 20:58:13.962479 12729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:13.966055 12729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39: No bootstrap required, opened a new log
I20250114 20:58:13.967746 12729 raft_consensus.cc:357] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" member_type: VOTER }
I20250114 20:58:13.968093 12729 raft_consensus.cc:383] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:13.968271 12729 raft_consensus.cc:738] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8133bf1e3aa48c3bc5b4aacf54ecf39, State: Initialized, Role: FOLLOWER
I20250114 20:58:13.968776 12729 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" member_type: VOTER }
I20250114 20:58:13.969246 12729 raft_consensus.cc:397] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:13.969430 12729 raft_consensus.cc:491] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:13.969650 12729 raft_consensus.cc:3054] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:13.973474 12729 raft_consensus.cc:513] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" member_type: VOTER }
I20250114 20:58:13.973963 12729 leader_election.cc:304] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8133bf1e3aa48c3bc5b4aacf54ecf39; no voters:
I20250114 20:58:13.974874 12729 leader_election.cc:290] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:13.975216 12732 raft_consensus.cc:2798] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:13.976563 12732 raft_consensus.cc:695] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 1 LEADER]: Becoming Leader. State: Replica: d8133bf1e3aa48c3bc5b4aacf54ecf39, State: Running, Role: LEADER
I20250114 20:58:13.977200 12732 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" member_type: VOTER }
I20250114 20:58:13.977792 12729 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:13.980363 12734 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8133bf1e3aa48c3bc5b4aacf54ecf39. Latest consensus state: current_term: 1 leader_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" member_type: VOTER } }
I20250114 20:58:13.981184 12734 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:13.980316 12733 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8133bf1e3aa48c3bc5b4aacf54ecf39" member_type: VOTER } }
I20250114 20:58:13.982096 12733 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:13.983569 12738 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:13.988812 12738 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:13.991497 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:13.997110 12738 catalog_manager.cc:1348] Generated new cluster ID: a9b9a889c8564894b0079430650ffb6a
I20250114 20:58:13.997295 12738 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:14.023362 12738 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:14.024425 12738 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:14.033084 12738 catalog_manager.cc:5899] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39: Generated new TSK 0
I20250114 20:58:14.033536 12738 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:14.057811 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:14.063360 12750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.064611 12751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.065874 12753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:14.066954 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:14.067704 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:14.067881 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:14.067999 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888294067988 us; error 0 us; skew 500 ppm
I20250114 20:58:14.068434 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:14.070554 6853 webserver.cc:458] Webserver started at http://127.6.177.65:46493/ using document root <none> and password file <none>
I20250114 20:58:14.071033 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:14.071256 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:14.071481 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:14.072594 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "09186b2604914cb5928628bb13f50f5e"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.077494 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250114 20:58:14.080729 12758 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.081399 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250114 20:58:14.081641 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "09186b2604914cb5928628bb13f50f5e"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.081876 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:14.099596 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:14.100550 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:14.105156 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:14.105486 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20250114 20:58:14.105808 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:14.106050 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.153849 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:34233
I20250114 20:58:14.153936 12828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:34233 every 8 connection(s)
I20250114 20:58:14.158092 12829 heartbeater.cc:346] Connected to a master server at 127.6.177.126:36353
I20250114 20:58:14.158385 12829 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:14.159030 12829 heartbeater.cc:510] Master 127.6.177.126:36353 requested a full tablet report, sending...
I20250114 20:58:14.160539 12684 ts_manager.cc:194] Registered new tserver with Master: 09186b2604914cb5928628bb13f50f5e (127.6.177.65:34233)
I20250114 20:58:14.161391 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004732712s
I20250114 20:58:14.162030 12684 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55138
I20250114 20:58:14.174551 12829 heartbeater.cc:502] Master 127.6.177.126:36353 was elected leader, sending a full tablet report...
I20250114 20:58:14.180258 12683 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55146:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:14.209129 12794 tablet_service.cc:1467] Processing CreateTablet for tablet 56c44a96b29c4ae9b381f1e3781fdbe6 (DEFAULT_TABLE table=client-testtb [id=feb94ef602374845a13797d061d2078a]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:58:14.209417 12793 tablet_service.cc:1467] Processing CreateTablet for tablet dece7d1321644c56978f708095044a6c (DEFAULT_TABLE table=client-testtb [id=feb94ef602374845a13797d061d2078a]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:58:14.210338 12794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c44a96b29c4ae9b381f1e3781fdbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.210934 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dece7d1321644c56978f708095044a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.225587 12839 tablet_bootstrap.cc:492] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e: Bootstrap starting.
I20250114 20:58:14.229864 12839 tablet_bootstrap.cc:654] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:14.233078 12839 tablet_bootstrap.cc:492] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e: No bootstrap required, opened a new log
I20250114 20:58:14.233359 12839 ts_tablet_manager.cc:1397] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20250114 20:58:14.235419 12839 raft_consensus.cc:357] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.235801 12839 raft_consensus.cc:383] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:14.235953 12839 raft_consensus.cc:738] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09186b2604914cb5928628bb13f50f5e, State: Initialized, Role: FOLLOWER
I20250114 20:58:14.236308 12839 consensus_queue.cc:260] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.236670 12839 raft_consensus.cc:397] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:14.236831 12839 raft_consensus.cc:491] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:14.237013 12839 raft_consensus.cc:3054] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:14.241430 12839 raft_consensus.cc:513] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.241869 12839 leader_election.cc:304] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09186b2604914cb5928628bb13f50f5e; no voters:
I20250114 20:58:14.242807 12839 leader_election.cc:290] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:14.243216 12841 raft_consensus.cc:2798] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:14.244998 12839 ts_tablet_manager.cc:1428] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20250114 20:58:14.245514 12841 raft_consensus.cc:695] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 1 LEADER]: Becoming Leader. State: Replica: 09186b2604914cb5928628bb13f50f5e, State: Running, Role: LEADER
I20250114 20:58:14.245707 12839 tablet_bootstrap.cc:492] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e: Bootstrap starting.
I20250114 20:58:14.246088 12841 consensus_queue.cc:237] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.250686 12839 tablet_bootstrap.cc:654] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:14.251641 12683 catalog_manager.cc:5526] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 09186b2604914cb5928628bb13f50f5e (127.6.177.65). New cstate: current_term: 1 leader_uuid: "09186b2604914cb5928628bb13f50f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:14.254884 12839 tablet_bootstrap.cc:492] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e: No bootstrap required, opened a new log
I20250114 20:58:14.255326 12839 ts_tablet_manager.cc:1397] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20250114 20:58:14.257303 12839 raft_consensus.cc:357] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.257653 12839 raft_consensus.cc:383] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:14.257884 12839 raft_consensus.cc:738] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09186b2604914cb5928628bb13f50f5e, State: Initialized, Role: FOLLOWER
I20250114 20:58:14.258468 12839 consensus_queue.cc:260] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.259085 12839 raft_consensus.cc:397] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:14.259373 12839 raft_consensus.cc:491] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:14.259640 12839 raft_consensus.cc:3054] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:14.263680 12839 raft_consensus.cc:513] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.264163 12839 leader_election.cc:304] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09186b2604914cb5928628bb13f50f5e; no voters:
I20250114 20:58:14.264549 12839 leader_election.cc:290] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:14.264704 12841 raft_consensus.cc:2798] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:14.265142 12841 raft_consensus.cc:695] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 1 LEADER]: Becoming Leader. State: Replica: 09186b2604914cb5928628bb13f50f5e, State: Running, Role: LEADER
I20250114 20:58:14.265677 12841 consensus_queue.cc:237] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } }
I20250114 20:58:14.265962 12839 ts_tablet_manager.cc:1428] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e: Time spent starting tablet: real 0.010s user 0.006s sys 0.002s
I20250114 20:58:14.269981 12683 catalog_manager.cc:5526] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 09186b2604914cb5928628bb13f50f5e (127.6.177.65). New cstate: current_term: 1 leader_uuid: "09186b2604914cb5928628bb13f50f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09186b2604914cb5928628bb13f50f5e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 34233 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:14.289532 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:14.303517 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:14.304139 6853 tablet_replica.cc:331] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e: stopping tablet replica
I20250114 20:58:14.304589 6853 raft_consensus.cc:2238] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:14.304927 6853 raft_consensus.cc:2267] T dece7d1321644c56978f708095044a6c P 09186b2604914cb5928628bb13f50f5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:14.306739 6853 tablet_replica.cc:331] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e: stopping tablet replica
I20250114 20:58:14.307161 6853 raft_consensus.cc:2238] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:14.307471 6853 raft_consensus.cc:2267] T 56c44a96b29c4ae9b381f1e3781fdbe6 P 09186b2604914cb5928628bb13f50f5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:14.316991 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:14.327137 6853 master.cc:537] Master@127.6.177.126:36353 shutting down...
I20250114 20:58:14.342347 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:14.342788 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:14.343199 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P d8133bf1e3aa48c3bc5b4aacf54ecf39: stopping tablet replica
I20250114 20:58:14.361394 6853 master.cc:559] Master@127.6.177.126:36353 shutdown complete.
I20250114 20:58:14.374176 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:45955
I20250114 20:58:14.375166 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:14.379375 12848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.380087 12849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.380829 12851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:14.381575 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:14.382122 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:14.382278 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:14.382406 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888294382386 us; error 0 us; skew 500 ppm
I20250114 20:58:14.382875 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:14.384907 6853 webserver.cc:458] Webserver started at http://127.6.177.126:33419/ using document root <none> and password file <none>
I20250114 20:58:14.385284 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:14.385465 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:14.385679 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:14.386623 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "f50995f1f320429ba7a02d0f8fd8d665"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.390462 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:58:14.393224 12856 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.393880 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:14.394133 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "f50995f1f320429ba7a02d0f8fd8d665"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.394377 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:14.406775 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:14.407603 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:14.445922 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:45955
I20250114 20:58:14.446007 12917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:45955 every 8 connection(s)
I20250114 20:58:14.449580 12918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.458770 12918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665: Bootstrap starting.
I20250114 20:58:14.462436 12918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:14.465730 12918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665: No bootstrap required, opened a new log
I20250114 20:58:14.467406 12918 raft_consensus.cc:357] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50995f1f320429ba7a02d0f8fd8d665" member_type: VOTER }
I20250114 20:58:14.467741 12918 raft_consensus.cc:383] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:14.467942 12918 raft_consensus.cc:738] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f50995f1f320429ba7a02d0f8fd8d665, State: Initialized, Role: FOLLOWER
I20250114 20:58:14.468451 12918 consensus_queue.cc:260] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50995f1f320429ba7a02d0f8fd8d665" member_type: VOTER }
I20250114 20:58:14.468870 12918 raft_consensus.cc:397] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:14.469069 12918 raft_consensus.cc:491] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:14.469285 12918 raft_consensus.cc:3054] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:14.472837 12918 raft_consensus.cc:513] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50995f1f320429ba7a02d0f8fd8d665" member_type: VOTER }
I20250114 20:58:14.473286 12918 leader_election.cc:304] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f50995f1f320429ba7a02d0f8fd8d665; no voters:
I20250114 20:58:14.474256 12918 leader_election.cc:290] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:14.474515 12921 raft_consensus.cc:2798] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:14.475661 12921 raft_consensus.cc:695] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 1 LEADER]: Becoming Leader. State: Replica: f50995f1f320429ba7a02d0f8fd8d665, State: Running, Role: LEADER
I20250114 20:58:14.476189 12921 consensus_queue.cc:237] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50995f1f320429ba7a02d0f8fd8d665" member_type: VOTER }
I20250114 20:58:14.476680 12918 sys_catalog.cc:564] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:14.478931 12923 sys_catalog.cc:455] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f50995f1f320429ba7a02d0f8fd8d665. Latest consensus state: current_term: 1 leader_uuid: "f50995f1f320429ba7a02d0f8fd8d665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50995f1f320429ba7a02d0f8fd8d665" member_type: VOTER } }
I20250114 20:58:14.478958 12922 sys_catalog.cc:455] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f50995f1f320429ba7a02d0f8fd8d665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f50995f1f320429ba7a02d0f8fd8d665" member_type: VOTER } }
I20250114 20:58:14.479669 12923 sys_catalog.cc:458] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:14.480021 12922 sys_catalog.cc:458] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:14.482245 12927 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:14.489261 12927 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:14.490999 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:14.497018 12927 catalog_manager.cc:1348] Generated new cluster ID: 90834a1a681a46a7af9426e33702c984
I20250114 20:58:14.497251 12927 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:14.512882 12927 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:14.514065 12927 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:14.524587 12927 catalog_manager.cc:5899] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665: Generated new TSK 0
I20250114 20:58:14.525028 12927 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:14.557006 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:14.561904 12939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.562913 12940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.564373 12942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:14.564553 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:14.565285 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:14.565443 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:14.565578 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888294565563 us; error 0 us; skew 500 ppm
I20250114 20:58:14.565997 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:14.567931 6853 webserver.cc:458] Webserver started at http://127.6.177.65:39749/ using document root <none> and password file <none>
I20250114 20:58:14.568341 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:14.568495 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:14.568699 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:14.569598 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "6f59eed1a0094c6086054163991c0965"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.573256 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20250114 20:58:14.575918 12947 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.576505 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250114 20:58:14.576730 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "6f59eed1a0094c6086054163991c0965"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.576958 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:14.589772 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:14.590524 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:14.594883 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:14.595242 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20250114 20:58:14.595521 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:14.595749 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.641462 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:38493
I20250114 20:58:14.641557 13017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:38493 every 8 connection(s)
I20250114 20:58:14.645376 13018 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45955
I20250114 20:58:14.645610 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250114 20:58:14.645741 13018 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:14.646476 13018 heartbeater.cc:510] Master 127.6.177.126:45955 requested a full tablet report, sending...
I20250114 20:58:14.648228 12873 ts_manager.cc:194] Registered new tserver with Master: 6f59eed1a0094c6086054163991c0965 (127.6.177.65:38493)
I20250114 20:58:14.649981 12873 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55866
W20250114 20:58:14.651525 13020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.653051 13021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:14.654150 6853 server_base.cc:1034] running on GCE node
W20250114 20:58:14.655050 13023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:14.655812 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:14.655983 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:14.656128 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888294656112 us; error 0 us; skew 500 ppm
I20250114 20:58:14.656514 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:14.658414 6853 webserver.cc:458] Webserver started at http://127.6.177.66:36281/ using document root <none> and password file <none>
I20250114 20:58:14.658893 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:14.659044 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:14.659322 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:14.660280 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-1-root/instance:
uuid: "b89da850526b4796b8caf49d02bae623"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.663188 13018 heartbeater.cc:502] Master 127.6.177.126:45955 was elected leader, sending a full tablet report...
I20250114 20:58:14.664156 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250114 20:58:14.666986 13028 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.667726 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:14.667940 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-1-root
uuid: "b89da850526b4796b8caf49d02bae623"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.668145 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:14.684984 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:14.685765 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:14.690937 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:14.691211 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20250114 20:58:14.691411 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:14.691535 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.749641 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.66:43193
I20250114 20:58:14.749727 13097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.66:43193 every 8 connection(s)
I20250114 20:58:14.753487 13098 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45955
I20250114 20:58:14.753881 13098 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:14.753868 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250114 20:58:14.754858 13098 heartbeater.cc:510] Master 127.6.177.126:45955 requested a full tablet report, sending...
I20250114 20:58:14.756669 12872 ts_manager.cc:194] Registered new tserver with Master: b89da850526b4796b8caf49d02bae623 (127.6.177.66:43193)
I20250114 20:58:14.758320 12872 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55880
W20250114 20:58:14.760700 13100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.761961 13101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:14.763494 13103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:14.764626 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:14.765311 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:14.765488 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:14.765627 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888294765615 us; error 0 us; skew 500 ppm
I20250114 20:58:14.766068 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:14.768198 6853 webserver.cc:458] Webserver started at http://127.6.177.67:44695/ using document root <none> and password file <none>
I20250114 20:58:14.768702 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:14.768914 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:14.769239 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:14.770421 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-2-root/instance:
uuid: "f116a34afaa64d079d5100702d298d29"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.771097 13098 heartbeater.cc:502] Master 127.6.177.126:45955 was elected leader, sending a full tablet report...
I20250114 20:58:14.774991 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250114 20:58:14.777830 13108 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.778520 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:14.778807 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-2-root
uuid: "f116a34afaa64d079d5100702d298d29"
format_stamp: "Formatted at 2025-01-14 20:58:14 on dist-test-slave-26qh"
I20250114 20:58:14.779109 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate_1.1736888227440588-6853-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:14.793247 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:14.794449 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:14.800165 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:14.800439 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.800693 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:14.800881 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:14.854614 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.67:36651
I20250114 20:58:14.854707 13177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.67:36651 every 8 connection(s)
I20250114 20:58:14.858314 13178 heartbeater.cc:346] Connected to a master server at 127.6.177.126:45955
I20250114 20:58:14.858654 13178 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:14.859512 13178 heartbeater.cc:510] Master 127.6.177.126:45955 requested a full tablet report, sending...
I20250114 20:58:14.861020 12872 ts_manager.cc:194] Registered new tserver with Master: f116a34afaa64d079d5100702d298d29 (127.6.177.67:36651)
I20250114 20:58:14.861318 6853 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00392691s
I20250114 20:58:14.862174 12872 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55904
I20250114 20:58:14.874833 13178 heartbeater.cc:502] Master 127.6.177.126:45955 was elected leader, sending a full tablet report...
I20250114 20:58:14.881096 12872 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55922:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20250114 20:58:14.882664 12872 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table client-testtb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250114 20:58:14.934538 13143 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3b37965b954deca1a6f1c12a4322ae (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.936214 13143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3b37965b954deca1a6f1c12a4322ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.936635 13141 tablet_service.cc:1467] Processing CreateTablet for tablet 6d89b379d05948a9ab374e747e8d4448 (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.938177 13141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d89b379d05948a9ab374e747e8d4448. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.944409 13142 tablet_service.cc:1467] Processing CreateTablet for tablet 4252c2443d57444ab46edf979bbaebf0 (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.945873 13142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4252c2443d57444ab46edf979bbaebf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.976008 13192 tablet_bootstrap.cc:492] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29: Bootstrap starting.
I20250114 20:58:14.977375 13063 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3b37965b954deca1a6f1c12a4322ae (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.979871 13061 tablet_service.cc:1467] Processing CreateTablet for tablet 4252c2443d57444ab46edf979bbaebf0 (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.980260 13063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3b37965b954deca1a6f1c12a4322ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.981109 13061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4252c2443d57444ab46edf979bbaebf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.984241 12982 tablet_service.cc:1467] Processing CreateTablet for tablet 4252c2443d57444ab46edf979bbaebf0 (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.984421 13060 tablet_service.cc:1467] Processing CreateTablet for tablet 6d89b379d05948a9ab374e747e8d4448 (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.985074 12981 tablet_service.cc:1467] Processing CreateTablet for tablet 6d89b379d05948a9ab374e747e8d4448 (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.985416 13060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d89b379d05948a9ab374e747e8d4448. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.985353 12982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4252c2443d57444ab46edf979bbaebf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.986169 12983 tablet_service.cc:1467] Processing CreateTablet for tablet 7e3b37965b954deca1a6f1c12a4322ae (DEFAULT_TABLE table=client-testtb [id=110fc49a30ae43359aabf191e658e8cc]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:14.987326 12983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3b37965b954deca1a6f1c12a4322ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:14.994812 12981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d89b379d05948a9ab374e747e8d4448. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:15.006659 13194 tablet_bootstrap.cc:492] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965: Bootstrap starting.
I20250114 20:58:15.010426 13193 tablet_bootstrap.cc:492] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623: Bootstrap starting.
I20250114 20:58:15.013713 13194 tablet_bootstrap.cc:654] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.016638 13192 tablet_bootstrap.cc:654] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.019577 13193 tablet_bootstrap.cc:654] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.034092 13193 tablet_bootstrap.cc:492] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623: No bootstrap required, opened a new log
I20250114 20:58:15.034639 13193 ts_tablet_manager.cc:1397] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.004s
I20250114 20:58:15.034968 13194 tablet_bootstrap.cc:492] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965: No bootstrap required, opened a new log
I20250114 20:58:15.034106 13192 tablet_bootstrap.cc:492] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29: No bootstrap required, opened a new log
I20250114 20:58:15.035686 13192 ts_tablet_manager.cc:1397] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.008s
I20250114 20:58:15.035782 13194 ts_tablet_manager.cc:1397] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.004s
I20250114 20:58:15.037477 13193 raft_consensus.cc:357] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.038383 13193 raft_consensus.cc:383] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.038993 13193 raft_consensus.cc:738] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89da850526b4796b8caf49d02bae623, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.038410 13194 raft_consensus.cc:357] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.040225 13194 raft_consensus.cc:383] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.039839 13192 raft_consensus.cc:357] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.040462 13194 raft_consensus.cc:738] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f59eed1a0094c6086054163991c0965, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.040642 13192 raft_consensus.cc:383] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.041105 13192 raft_consensus.cc:738] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f116a34afaa64d079d5100702d298d29, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.041114 13194 consensus_queue.cc:260] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.041728 13192 consensus_queue.cc:260] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.039872 13193 consensus_queue.cc:260] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.044150 13194 ts_tablet_manager.cc:1428] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250114 20:58:15.044945 13194 tablet_bootstrap.cc:492] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965: Bootstrap starting.
I20250114 20:58:15.050488 13194 tablet_bootstrap.cc:654] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.052896 13192 ts_tablet_manager.cc:1428] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29: Time spent starting tablet: real 0.017s user 0.003s sys 0.003s
I20250114 20:58:15.053712 13192 tablet_bootstrap.cc:492] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29: Bootstrap starting.
I20250114 20:58:15.059144 13192 tablet_bootstrap.cc:654] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.062830 13193 ts_tablet_manager.cc:1428] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623: Time spent starting tablet: real 0.028s user 0.012s sys 0.010s
I20250114 20:58:15.064160 13193 tablet_bootstrap.cc:492] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623: Bootstrap starting.
I20250114 20:58:15.071461 13193 tablet_bootstrap.cc:654] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.097465 13192 tablet_bootstrap.cc:492] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29: No bootstrap required, opened a new log
I20250114 20:58:15.098619 13194 tablet_bootstrap.cc:492] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965: No bootstrap required, opened a new log
I20250114 20:58:15.098659 13192 ts_tablet_manager.cc:1397] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29: Time spent bootstrapping tablet: real 0.045s user 0.016s sys 0.020s
I20250114 20:58:15.099773 13193 tablet_bootstrap.cc:492] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623: No bootstrap required, opened a new log
I20250114 20:58:15.099879 13194 ts_tablet_manager.cc:1397] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965: Time spent bootstrapping tablet: real 0.055s user 0.010s sys 0.036s
I20250114 20:58:15.100519 13193 ts_tablet_manager.cc:1397] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623: Time spent bootstrapping tablet: real 0.037s user 0.020s sys 0.013s
I20250114 20:58:15.102046 13192 raft_consensus.cc:357] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.102686 13192 raft_consensus.cc:383] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.102989 13192 raft_consensus.cc:738] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f116a34afaa64d079d5100702d298d29, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.103273 13193 raft_consensus.cc:357] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.103451 13194 raft_consensus.cc:357] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.104130 13193 raft_consensus.cc:383] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.103811 13192 consensus_queue.cc:260] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.104219 13194 raft_consensus.cc:383] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.104610 13193 raft_consensus.cc:738] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89da850526b4796b8caf49d02bae623, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.104864 13194 raft_consensus.cc:738] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f59eed1a0094c6086054163991c0965, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.105445 13193 consensus_queue.cc:260] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.105664 13194 consensus_queue.cc:260] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.109328 13192 ts_tablet_manager.cc:1428] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29: Time spent starting tablet: real 0.010s user 0.002s sys 0.003s
I20250114 20:58:15.109663 13194 ts_tablet_manager.cc:1428] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20250114 20:58:15.109946 13193 ts_tablet_manager.cc:1428] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623: Time spent starting tablet: real 0.009s user 0.005s sys 0.002s
I20250114 20:58:15.110239 13192 tablet_bootstrap.cc:492] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29: Bootstrap starting.
I20250114 20:58:15.110816 13194 tablet_bootstrap.cc:492] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965: Bootstrap starting.
I20250114 20:58:15.110880 13193 tablet_bootstrap.cc:492] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623: Bootstrap starting.
I20250114 20:58:15.117041 13192 tablet_bootstrap.cc:654] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.118332 13194 tablet_bootstrap.cc:654] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.118335 13193 tablet_bootstrap.cc:654] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:15.128587 13192 tablet_bootstrap.cc:492] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29: No bootstrap required, opened a new log
I20250114 20:58:15.129033 13192 ts_tablet_manager.cc:1397] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.008s
I20250114 20:58:15.130573 13193 tablet_bootstrap.cc:492] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623: No bootstrap required, opened a new log
I20250114 20:58:15.131026 13193 ts_tablet_manager.cc:1397] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.013s
I20250114 20:58:15.131242 13192 raft_consensus.cc:357] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.131901 13192 raft_consensus.cc:383] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.132099 13192 raft_consensus.cc:738] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f116a34afaa64d079d5100702d298d29, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.132599 13192 consensus_queue.cc:260] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.133816 13193 raft_consensus.cc:357] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.134533 13192 ts_tablet_manager.cc:1428] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20250114 20:58:15.134558 13193 raft_consensus.cc:383] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.135147 13193 raft_consensus.cc:738] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89da850526b4796b8caf49d02bae623, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.135504 13194 tablet_bootstrap.cc:492] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965: No bootstrap required, opened a new log
I20250114 20:58:15.135932 13194 ts_tablet_manager.cc:1397] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.007s
I20250114 20:58:15.135861 13193 consensus_queue.cc:260] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.138679 13193 ts_tablet_manager.cc:1428] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250114 20:58:15.139056 13194 raft_consensus.cc:357] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.139683 13194 raft_consensus.cc:383] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:15.139914 13194 raft_consensus.cc:738] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f59eed1a0094c6086054163991c0965, State: Initialized, Role: FOLLOWER
I20250114 20:58:15.140412 13194 consensus_queue.cc:260] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.142324 13194 ts_tablet_manager.cc:1428] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20250114 20:58:15.146262 13199 raft_consensus.cc:491] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250114 20:58:15.146723 13199 raft_consensus.cc:513] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.148952 13199 leader_election.cc:290] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b89da850526b4796b8caf49d02bae623 (127.6.177.66:43193), 6f59eed1a0094c6086054163991c0965 (127.6.177.65:38493)
I20250114 20:58:15.158485 13073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3b37965b954deca1a6f1c12a4322ae" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89da850526b4796b8caf49d02bae623" is_pre_election: true
I20250114 20:58:15.158620 12993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3b37965b954deca1a6f1c12a4322ae" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f59eed1a0094c6086054163991c0965" is_pre_election: true
I20250114 20:58:15.159212 13073 raft_consensus.cc:2463] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 0.
I20250114 20:58:15.159402 12993 raft_consensus.cc:2463] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 0.
I20250114 20:58:15.160245 13109 leader_election.cc:304] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89da850526b4796b8caf49d02bae623, f116a34afaa64d079d5100702d298d29; no voters:
I20250114 20:58:15.161054 13199 raft_consensus.cc:2798] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250114 20:58:15.161412 13199 raft_consensus.cc:491] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250114 20:58:15.161773 13199 raft_consensus.cc:3054] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.166985 13199 raft_consensus.cc:513] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.168432 13199 leader_election.cc:290] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 election: Requested vote from peers b89da850526b4796b8caf49d02bae623 (127.6.177.66:43193), 6f59eed1a0094c6086054163991c0965 (127.6.177.65:38493)
I20250114 20:58:15.169107 13073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3b37965b954deca1a6f1c12a4322ae" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89da850526b4796b8caf49d02bae623"
I20250114 20:58:15.169248 12993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e3b37965b954deca1a6f1c12a4322ae" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f59eed1a0094c6086054163991c0965"
I20250114 20:58:15.169508 13073 raft_consensus.cc:3054] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.169740 12993 raft_consensus.cc:3054] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.173673 13073 raft_consensus.cc:2463] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 1.
I20250114 20:58:15.174662 13109 leader_election.cc:304] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89da850526b4796b8caf49d02bae623, f116a34afaa64d079d5100702d298d29; no voters:
I20250114 20:58:15.174747 12993 raft_consensus.cc:2463] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 1.
I20250114 20:58:15.175581 13199 raft_consensus.cc:2798] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:15.176551 13199 raft_consensus.cc:695] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 1 LEADER]: Becoming Leader. State: Replica: f116a34afaa64d079d5100702d298d29, State: Running, Role: LEADER
I20250114 20:58:15.177320 13199 consensus_queue.cc:237] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } }
I20250114 20:58:15.183820 12873 catalog_manager.cc:5526] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 reported cstate change: term changed from 0 to 1, leader changed from <none> to f116a34afaa64d079d5100702d298d29 (127.6.177.67). New cstate: current_term: 1 leader_uuid: "f116a34afaa64d079d5100702d298d29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } health_report { overall_health: UNKNOWN } } }
I20250114 20:58:15.188509 13199 raft_consensus.cc:491] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250114 20:58:15.188969 13199 raft_consensus.cc:513] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.190892 13199 leader_election.cc:290] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f59eed1a0094c6086054163991c0965 (127.6.177.65:38493), b89da850526b4796b8caf49d02bae623 (127.6.177.66:43193)
I20250114 20:58:15.191865 13073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d89b379d05948a9ab374e747e8d4448" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89da850526b4796b8caf49d02bae623" is_pre_election: true
I20250114 20:58:15.191999 12993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d89b379d05948a9ab374e747e8d4448" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f59eed1a0094c6086054163991c0965" is_pre_election: true
I20250114 20:58:15.192484 13073 raft_consensus.cc:2463] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 0.
I20250114 20:58:15.192634 12993 raft_consensus.cc:2463] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 0.
I20250114 20:58:15.193750 13109 leader_election.cc:304] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b89da850526b4796b8caf49d02bae623, f116a34afaa64d079d5100702d298d29; no voters:
I20250114 20:58:15.194495 13199 raft_consensus.cc:2798] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250114 20:58:15.194756 13199 raft_consensus.cc:491] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250114 20:58:15.194981 13199 raft_consensus.cc:3054] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.200016 13199 raft_consensus.cc:513] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.201901 12993 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d89b379d05948a9ab374e747e8d4448" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f59eed1a0094c6086054163991c0965"
I20250114 20:58:15.202452 12993 raft_consensus.cc:3054] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.202176 13073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d89b379d05948a9ab374e747e8d4448" candidate_uuid: "f116a34afaa64d079d5100702d298d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89da850526b4796b8caf49d02bae623"
I20250114 20:58:15.203171 13073 raft_consensus.cc:3054] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.202147 13199 leader_election.cc:290] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 election: Requested vote from peers 6f59eed1a0094c6086054163991c0965 (127.6.177.65:38493), b89da850526b4796b8caf49d02bae623 (127.6.177.66:43193)
I20250114 20:58:15.208923 12993 raft_consensus.cc:2463] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 1.
I20250114 20:58:15.210068 13112 leader_election.cc:304] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f59eed1a0094c6086054163991c0965, f116a34afaa64d079d5100702d298d29; no voters:
I20250114 20:58:15.210800 13199 raft_consensus.cc:2798] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:15.211185 13199 raft_consensus.cc:695] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 1 LEADER]: Becoming Leader. State: Replica: f116a34afaa64d079d5100702d298d29, State: Running, Role: LEADER
I20250114 20:58:15.211833 13199 consensus_queue.cc:237] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.212407 13073 raft_consensus.cc:2463] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f116a34afaa64d079d5100702d298d29 in term 1.
I20250114 20:58:15.217876 12871 catalog_manager.cc:5526] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 reported cstate change: term changed from 0 to 1, leader changed from <none> to f116a34afaa64d079d5100702d298d29 (127.6.177.67). New cstate: current_term: 1 leader_uuid: "f116a34afaa64d079d5100702d298d29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:15.240166 13198 raft_consensus.cc:491] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250114 20:58:15.240561 13198 raft_consensus.cc:513] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.242771 13198 leader_election.cc:290] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b89da850526b4796b8caf49d02bae623 (127.6.177.66:43193), f116a34afaa64d079d5100702d298d29 (127.6.177.67:36651)
I20250114 20:58:15.253434 13153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4252c2443d57444ab46edf979bbaebf0" candidate_uuid: "6f59eed1a0094c6086054163991c0965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f116a34afaa64d079d5100702d298d29" is_pre_election: true
I20250114 20:58:15.254123 13153 raft_consensus.cc:2463] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f59eed1a0094c6086054163991c0965 in term 0.
I20250114 20:58:15.254176 13073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4252c2443d57444ab46edf979bbaebf0" candidate_uuid: "6f59eed1a0094c6086054163991c0965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89da850526b4796b8caf49d02bae623" is_pre_election: true
I20250114 20:58:15.254882 13073 raft_consensus.cc:2463] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f59eed1a0094c6086054163991c0965 in term 0.
I20250114 20:58:15.255481 12950 leader_election.cc:304] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f59eed1a0094c6086054163991c0965, f116a34afaa64d079d5100702d298d29; no voters:
I20250114 20:58:15.256337 13198 raft_consensus.cc:2798] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250114 20:58:15.256635 13198 raft_consensus.cc:491] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250114 20:58:15.256958 13198 raft_consensus.cc:3054] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.262244 13198 raft_consensus.cc:513] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.263753 13198 leader_election.cc:290] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [CANDIDATE]: Term 1 election: Requested vote from peers b89da850526b4796b8caf49d02bae623 (127.6.177.66:43193), f116a34afaa64d079d5100702d298d29 (127.6.177.67:36651)
I20250114 20:58:15.264591 13073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4252c2443d57444ab46edf979bbaebf0" candidate_uuid: "6f59eed1a0094c6086054163991c0965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89da850526b4796b8caf49d02bae623"
I20250114 20:58:15.264863 13153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4252c2443d57444ab46edf979bbaebf0" candidate_uuid: "6f59eed1a0094c6086054163991c0965" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f116a34afaa64d079d5100702d298d29"
I20250114 20:58:15.265213 13073 raft_consensus.cc:3054] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.265411 13153 raft_consensus.cc:3054] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:15.271399 13073 raft_consensus.cc:2463] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f59eed1a0094c6086054163991c0965 in term 1.
I20250114 20:58:15.271764 13153 raft_consensus.cc:2463] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f59eed1a0094c6086054163991c0965 in term 1.
I20250114 20:58:15.272598 12948 leader_election.cc:304] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f59eed1a0094c6086054163991c0965, b89da850526b4796b8caf49d02bae623; no voters:
I20250114 20:58:15.274859 13198 raft_consensus.cc:2798] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:15.276193 13198 raft_consensus.cc:695] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 1 LEADER]: Becoming Leader. State: Replica: 6f59eed1a0094c6086054163991c0965, State: Running, Role: LEADER
I20250114 20:58:15.276953 13198 consensus_queue.cc:237] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } }
I20250114 20:58:15.283277 12873 catalog_manager.cc:5526] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f59eed1a0094c6086054163991c0965 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "6f59eed1a0094c6086054163991c0965" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 } health_report { overall_health: UNKNOWN } } }
I20250114 20:58:15.603947 13199 consensus_queue.cc:1035] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250114 20:58:15.635973 13218 consensus_queue.cc:1035] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250114 20:58:15.708721 13218 consensus_queue.cc:1035] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f59eed1a0094c6086054163991c0965" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 38493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250114 20:58:15.718346 13219 consensus_queue.cc:1035] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250114 20:58:15.866969 13198 consensus_queue.cc:1035] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f116a34afaa64d079d5100702d298d29" member_type: VOTER last_known_addr { host: "127.6.177.67" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250114 20:58:15.879858 13225 consensus_queue.cc:1035] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89da850526b4796b8caf49d02bae623" member_type: VOTER last_known_addr { host: "127.6.177.66" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250114 20:58:16.483970 13184 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.177.65:38493, user_credentials={real_user=slave}} blocked reactor thread for 51448.5us
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/client-test.cc:3099: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20250114 20:58:16.816874 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
W20250114 20:58:16.843534 13112 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20250114 20:58:16.854524 13112 consensus_peers.cc:487] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 -> Peer 6f59eed1a0094c6086054163991c0965 (127.6.177.65:38493): Couldn't send request to peer 6f59eed1a0094c6086054163991c0965. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250114 20:58:16.864683 13183 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.177.67:36651, user_credentials={real_user=slave}} blocked reactor thread for 64909.8us
W20250114 20:58:16.877951 13112 consensus_peers.cc:487] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 -> Peer 6f59eed1a0094c6086054163991c0965 (127.6.177.65:38493): Couldn't send request to peer 6f59eed1a0094c6086054163991c0965. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250114 20:58:16.892606 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:16.893319 6853 tablet_replica.cc:331] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965: stopping tablet replica
I20250114 20:58:16.894099 6853 raft_consensus.cc:2238] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:16.894662 6853 raft_consensus.cc:2267] T 6d89b379d05948a9ab374e747e8d4448 P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:16.897617 6853 tablet_replica.cc:331] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965: stopping tablet replica
I20250114 20:58:16.898133 6853 raft_consensus.cc:2238] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:16.898555 6853 raft_consensus.cc:2267] T 7e3b37965b954deca1a6f1c12a4322ae P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:16.901199 6853 tablet_replica.cc:331] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965: stopping tablet replica
I20250114 20:58:16.901747 6853 raft_consensus.cc:2238] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:16.902572 6853 raft_consensus.cc:2267] T 4252c2443d57444ab46edf979bbaebf0 P 6f59eed1a0094c6086054163991c0965 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:16.924322 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:16.936594 6853 tablet_server.cc:178] TabletServer@127.6.177.66:0 shutting down...
I20250114 20:58:16.955778 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:16.956290 6853 tablet_replica.cc:331] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623: stopping tablet replica
I20250114 20:58:16.956923 6853 raft_consensus.cc:2238] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:16.957348 6853 raft_consensus.cc:2267] T 6d89b379d05948a9ab374e747e8d4448 P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:16.960178 6853 tablet_replica.cc:331] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623: stopping tablet replica
I20250114 20:58:16.960608 6853 raft_consensus.cc:2238] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:16.960983 6853 raft_consensus.cc:2267] T 7e3b37965b954deca1a6f1c12a4322ae P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:16.963732 6853 tablet_replica.cc:331] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623: stopping tablet replica
I20250114 20:58:16.964223 6853 raft_consensus.cc:2238] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:16.964592 6853 raft_consensus.cc:2267] T 4252c2443d57444ab46edf979bbaebf0 P b89da850526b4796b8caf49d02bae623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:16.986232 6853 tablet_server.cc:195] TabletServer@127.6.177.66:0 shutdown complete.
I20250114 20:58:16.997215 6853 tablet_server.cc:178] TabletServer@127.6.177.67:0 shutting down...
I20250114 20:58:17.015749 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:17.016172 6853 tablet_replica.cc:331] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29: stopping tablet replica
I20250114 20:58:17.016579 6853 raft_consensus.cc:2238] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:17.017239 6853 raft_consensus.cc:2267] T 6d89b379d05948a9ab374e747e8d4448 P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:17.019768 6853 tablet_replica.cc:331] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29: stopping tablet replica
I20250114 20:58:17.020179 6853 raft_consensus.cc:2238] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250114 20:58:17.020534 6853 raft_consensus.cc:2267] T 4252c2443d57444ab46edf979bbaebf0 P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:17.022871 6853 tablet_replica.cc:331] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29: stopping tablet replica
I20250114 20:58:17.023326 6853 raft_consensus.cc:2238] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:17.023962 6853 raft_consensus.cc:2267] T 7e3b37965b954deca1a6f1c12a4322ae P f116a34afaa64d079d5100702d298d29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:17.044507 6853 tablet_server.cc:195] TabletServer@127.6.177.67:0 shutdown complete.
I20250114 20:58:17.055543 6853 master.cc:537] Master@127.6.177.126:45955 shutting down...
I20250114 20:58:17.072150 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:17.072535 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:17.072796 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P f50995f1f320429ba7a02d0f8fd8d665: stopping tablet replica
I20250114 20:58:17.089553 6853 master.cc:559] Master@127.6.177.126:45955 shutdown complete.
[ SKIPPED ] KeepAlivePeriodically/KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate/1 (3250 ms)
[----------] 1 test from KeepAlivePeriodically/KeepAlivePeriodicallyTest (3251 ms total)
[----------] 1 test from IntColEncodings/IntEncodingNullPredicatesTest
[ RUN ] IntColEncodings/IntEncodingNullPredicatesTest.TestIntEncodings/0
I20250114 20:58:17.112437 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:36551
I20250114 20:58:17.113278 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:17.117431 13247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:17.118077 13248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:17.118649 13250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:17.119256 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:17.120921 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:17.121091 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:17.121208 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888297121198 us; error 0 us; skew 500 ppm
I20250114 20:58:17.121570 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:17.123466 6853 webserver.cc:458] Webserver started at http://127.6.177.126:40587/ using document root <none> and password file <none>
I20250114 20:58:17.123831 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:17.123967 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:17.124174 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:17.124977 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "66e2f020a21549a39e9ff279caadef47"
format_stamp: "Formatted at 2025-01-14 20:58:17 on dist-test-slave-26qh"
I20250114 20:58:17.128373 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:58:17.130885 13255 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:17.131471 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:17.131686 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "66e2f020a21549a39e9ff279caadef47"
format_stamp: "Formatted at 2025-01-14 20:58:17 on dist-test-slave-26qh"
I20250114 20:58:17.131906 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:17.154292 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:17.155119 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:17.190292 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:36551
I20250114 20:58:17.190372 13316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:36551 every 8 connection(s)
I20250114 20:58:17.193686 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:17.202749 13317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47: Bootstrap starting.
I20250114 20:58:17.207511 13317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:17.210819 13317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47: No bootstrap required, opened a new log
I20250114 20:58:17.212527 13317 raft_consensus.cc:357] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e2f020a21549a39e9ff279caadef47" member_type: VOTER }
I20250114 20:58:17.212888 13317 raft_consensus.cc:383] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:17.213136 13317 raft_consensus.cc:738] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e2f020a21549a39e9ff279caadef47, State: Initialized, Role: FOLLOWER
I20250114 20:58:17.213682 13317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e2f020a21549a39e9ff279caadef47" member_type: VOTER }
I20250114 20:58:17.214144 13317 raft_consensus.cc:397] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:17.214345 13317 raft_consensus.cc:491] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:17.214566 13317 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:17.218058 13317 raft_consensus.cc:513] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e2f020a21549a39e9ff279caadef47" member_type: VOTER }
I20250114 20:58:17.218497 13317 leader_election.cc:304] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66e2f020a21549a39e9ff279caadef47; no voters:
I20250114 20:58:17.219489 13317 leader_election.cc:290] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:17.219730 13320 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:17.220908 13320 raft_consensus.cc:695] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 1 LEADER]: Becoming Leader. State: Replica: 66e2f020a21549a39e9ff279caadef47, State: Running, Role: LEADER
I20250114 20:58:17.221508 13320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e2f020a21549a39e9ff279caadef47" member_type: VOTER }
I20250114 20:58:17.221944 13317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:17.225368 13322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66e2f020a21549a39e9ff279caadef47. Latest consensus state: current_term: 1 leader_uuid: "66e2f020a21549a39e9ff279caadef47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e2f020a21549a39e9ff279caadef47" member_type: VOTER } }
I20250114 20:58:17.225932 13322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:17.229894 13321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66e2f020a21549a39e9ff279caadef47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66e2f020a21549a39e9ff279caadef47" member_type: VOTER } }
I20250114 20:58:17.230365 13321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:17.232231 13329 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:17.236418 13329 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:17.237269 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:17.243597 13329 catalog_manager.cc:1348] Generated new cluster ID: 830cfd73f8294562b1a430671efaa61c
I20250114 20:58:17.243808 13329 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:17.259181 13329 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:17.260169 13329 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:17.272125 13329 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47: Generated new TSK 0
I20250114 20:58:17.272539 13329 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:17.303061 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:17.308137 13338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:17.309007 13339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:17.310559 6853 server_base.cc:1034] running on GCE node
W20250114 20:58:17.311036 13341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:17.311837 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:17.312036 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:17.312189 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888297312171 us; error 0 us; skew 500 ppm
I20250114 20:58:17.312637 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:17.314749 6853 webserver.cc:458] Webserver started at http://127.6.177.65:40263/ using document root <none> and password file <none>
I20250114 20:58:17.315214 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:17.315392 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:17.315625 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:17.316538 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "fb37cb1ebeb24056b6f75bc887a6669e"
format_stamp: "Formatted at 2025-01-14 20:58:17 on dist-test-slave-26qh"
I20250114 20:58:17.320417 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:58:17.323352 13346 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:17.323998 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:58:17.324285 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "fb37cb1ebeb24056b6f75bc887a6669e"
format_stamp: "Formatted at 2025-01-14 20:58:17 on dist-test-slave-26qh"
I20250114 20:58:17.324523 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.IntColEncodings_IntEncodingNullPredicatesTest.TestIntEncodings_0.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:17.346745 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:17.347690 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:17.351787 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:17.352142 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:17.352437 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:17.352710 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:17.395776 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:44051
I20250114 20:58:17.395869 13416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:44051 every 8 connection(s)
I20250114 20:58:17.399586 13417 heartbeater.cc:346] Connected to a master server at 127.6.177.126:36551
I20250114 20:58:17.399917 13417 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:17.400506 13417 heartbeater.cc:510] Master 127.6.177.126:36551 requested a full tablet report, sending...
I20250114 20:58:17.402063 13272 ts_manager.cc:194] Registered new tserver with Master: fb37cb1ebeb24056b6f75bc887a6669e (127.6.177.65:44051)
I20250114 20:58:17.402233 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003742132s
I20250114 20:58:17.404361 13272 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40148
I20250114 20:58:17.416954 13417 heartbeater.cc:502] Master 127.6.177.126:36551 was elected leader, sending a full tablet report...
I20250114 20:58:17.422047 13271 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40158:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:17.449617 13382 tablet_service.cc:1467] Processing CreateTablet for tablet 944a82207be64cf9b9525bede7ad6fff (DEFAULT_TABLE table=client-testtb [id=ae0da946d9bb4bef9452f849cd939edf]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:58:17.450021 13381 tablet_service.cc:1467] Processing CreateTablet for tablet 8ffd9da7abbc4b09a8ba06e4b51c69a7 (DEFAULT_TABLE table=client-testtb [id=ae0da946d9bb4bef9452f849cd939edf]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:58:17.450628 13382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944a82207be64cf9b9525bede7ad6fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:17.451054 13381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffd9da7abbc4b09a8ba06e4b51c69a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:17.461892 13427 tablet_bootstrap.cc:492] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e: Bootstrap starting.
I20250114 20:58:17.465606 13427 tablet_bootstrap.cc:654] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:17.468793 13427 tablet_bootstrap.cc:492] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e: No bootstrap required, opened a new log
I20250114 20:58:17.469089 13427 ts_tablet_manager.cc:1397] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20250114 20:58:17.471146 13427 raft_consensus.cc:357] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.471505 13427 raft_consensus.cc:383] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:17.471654 13427 raft_consensus.cc:738] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb37cb1ebeb24056b6f75bc887a6669e, State: Initialized, Role: FOLLOWER
I20250114 20:58:17.471997 13427 consensus_queue.cc:260] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.472352 13427 raft_consensus.cc:397] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:17.472505 13427 raft_consensus.cc:491] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:17.472676 13427 raft_consensus.cc:3054] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:17.476716 13427 raft_consensus.cc:513] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.477133 13427 leader_election.cc:304] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb37cb1ebeb24056b6f75bc887a6669e; no voters:
I20250114 20:58:17.478072 13427 leader_election.cc:290] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:17.478359 13429 raft_consensus.cc:2798] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:17.479637 13429 raft_consensus.cc:695] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 1 LEADER]: Becoming Leader. State: Replica: fb37cb1ebeb24056b6f75bc887a6669e, State: Running, Role: LEADER
I20250114 20:58:17.480360 13427 ts_tablet_manager.cc:1428] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20250114 20:58:17.480263 13429 consensus_queue.cc:237] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.480953 13427 tablet_bootstrap.cc:492] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e: Bootstrap starting.
I20250114 20:58:17.485992 13427 tablet_bootstrap.cc:654] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:17.487485 13271 catalog_manager.cc:5526] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e reported cstate change: term changed from 0 to 1, leader changed from <none> to fb37cb1ebeb24056b6f75bc887a6669e (127.6.177.65). New cstate: current_term: 1 leader_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:17.489533 13427 tablet_bootstrap.cc:492] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e: No bootstrap required, opened a new log
I20250114 20:58:17.489920 13427 ts_tablet_manager.cc:1397] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20250114 20:58:17.491771 13427 raft_consensus.cc:357] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.492132 13427 raft_consensus.cc:383] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:17.492367 13427 raft_consensus.cc:738] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb37cb1ebeb24056b6f75bc887a6669e, State: Initialized, Role: FOLLOWER
I20250114 20:58:17.492861 13427 consensus_queue.cc:260] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.493470 13427 raft_consensus.cc:397] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:17.493729 13427 raft_consensus.cc:491] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:17.493981 13427 raft_consensus.cc:3054] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:17.498448 13427 raft_consensus.cc:513] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.498939 13427 leader_election.cc:304] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb37cb1ebeb24056b6f75bc887a6669e; no voters:
I20250114 20:58:17.499456 13427 leader_election.cc:290] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:17.499586 13429 raft_consensus.cc:2798] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:17.499987 13429 raft_consensus.cc:695] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 LEADER]: Becoming Leader. State: Replica: fb37cb1ebeb24056b6f75bc887a6669e, State: Running, Role: LEADER
I20250114 20:58:17.500509 13429 consensus_queue.cc:237] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.500720 13427 ts_tablet_manager.cc:1428] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20250114 20:58:17.504637 13271 catalog_manager.cc:5526] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e reported cstate change: term changed from 0 to 1, leader changed from <none> to fb37cb1ebeb24056b6f75bc887a6669e (127.6.177.65). New cstate: current_term: 1 leader_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:17.516264 13271 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40158:
name: "IntEncodingNullPredicatesTestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: true
encoding: PLAIN_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:17.532249 13382 tablet_service.cc:1467] Processing CreateTablet for tablet 8af18ea805f644d6b186ff9b052c3117 (DEFAULT_TABLE table=IntEncodingNullPredicatesTestTable [id=c4220afdbdd0419da5a370c19006d7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250114 20:58:17.533108 13382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af18ea805f644d6b186ff9b052c3117. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:17.543074 13427 tablet_bootstrap.cc:492] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e: Bootstrap starting.
I20250114 20:58:17.546975 13427 tablet_bootstrap.cc:654] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:17.550093 13427 tablet_bootstrap.cc:492] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e: No bootstrap required, opened a new log
I20250114 20:58:17.550460 13427 ts_tablet_manager.cc:1397] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20250114 20:58:17.552507 13427 raft_consensus.cc:357] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.552850 13427 raft_consensus.cc:383] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:17.553083 13427 raft_consensus.cc:738] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb37cb1ebeb24056b6f75bc887a6669e, State: Initialized, Role: FOLLOWER
I20250114 20:58:17.553552 13427 consensus_queue.cc:260] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.554023 13427 raft_consensus.cc:397] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:17.554258 13427 raft_consensus.cc:491] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:17.554555 13427 raft_consensus.cc:3054] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:17.558457 13427 raft_consensus.cc:513] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.558950 13427 leader_election.cc:304] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb37cb1ebeb24056b6f75bc887a6669e; no voters:
I20250114 20:58:17.559427 13427 leader_election.cc:290] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:17.559556 13429 raft_consensus.cc:2798] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:17.559985 13429 raft_consensus.cc:695] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 LEADER]: Becoming Leader. State: Replica: fb37cb1ebeb24056b6f75bc887a6669e, State: Running, Role: LEADER
I20250114 20:58:17.560519 13429 consensus_queue.cc:237] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } }
I20250114 20:58:17.560758 13427 ts_tablet_manager.cc:1428] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20250114 20:58:17.565974 13271 catalog_manager.cc:5526] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e reported cstate change: term changed from 0 to 1, leader changed from <none> to fb37cb1ebeb24056b6f75bc887a6669e (127.6.177.65). New cstate: current_term: 1 leader_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb37cb1ebeb24056b6f75bc887a6669e" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 44051 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:17.969859 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:17.997180 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:17.997953 6853 tablet_replica.cc:331] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e: stopping tablet replica
I20250114 20:58:17.998683 6853 raft_consensus.cc:2238] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:17.999292 6853 raft_consensus.cc:2267] T 8af18ea805f644d6b186ff9b052c3117 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:18.003849 6853 tablet_replica.cc:331] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e: stopping tablet replica
I20250114 20:58:18.004528 6853 raft_consensus.cc:2238] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:18.004985 6853 raft_consensus.cc:2267] T 8ffd9da7abbc4b09a8ba06e4b51c69a7 P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:18.029595 6853 tablet_replica.cc:331] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e: stopping tablet replica
I20250114 20:58:18.030486 6853 raft_consensus.cc:2238] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:18.031299 6853 raft_consensus.cc:2267] T 944a82207be64cf9b9525bede7ad6fff P fb37cb1ebeb24056b6f75bc887a6669e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:18.057694 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:18.079423 6853 master.cc:537] Master@127.6.177.126:36551 shutting down...
I20250114 20:58:18.113641 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:18.114526 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:18.114854 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 66e2f020a21549a39e9ff279caadef47: stopping tablet replica
I20250114 20:58:18.134488 6853 master.cc:559] Master@127.6.177.126:36551 shutdown complete.
[ OK ] IntColEncodings/IntEncodingNullPredicatesTest.TestIntEncodings/0 (1061 ms)
[----------] 1 test from IntColEncodings/IntEncodingNullPredicatesTest (1062 ms total)
[----------] 2 tests from Params/ClientTestImmutableColumn
[ RUN ] Params/ClientTestImmutableColumn.TestUpdate/0
I20250114 20:58:18.175700 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:36929
I20250114 20:58:18.176764 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:18.182299 13442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:18.183413 13443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:18.184983 13445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:18.186223 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:18.187053 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:18.187323 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:18.187486 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888298187472 us; error 0 us; skew 500 ppm
I20250114 20:58:18.188078 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:18.190629 6853 webserver.cc:458] Webserver started at http://127.6.177.126:43183/ using document root <none> and password file <none>
I20250114 20:58:18.191222 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:18.191426 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:18.191713 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:18.193285 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "65fc30caa9a04cb3a894fc3768548489"
format_stamp: "Formatted at 2025-01-14 20:58:18 on dist-test-slave-26qh"
I20250114 20:58:18.198881 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20250114 20:58:18.202997 13450 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:18.203867 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20250114 20:58:18.204185 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "65fc30caa9a04cb3a894fc3768548489"
format_stamp: "Formatted at 2025-01-14 20:58:18 on dist-test-slave-26qh"
I20250114 20:58:18.204519 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:18.216517 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:18.217905 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:18.270051 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:36929
I20250114 20:58:18.270124 13511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:36929 every 8 connection(s)
I20250114 20:58:18.274896 13512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:18.286149 13512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489: Bootstrap starting.
I20250114 20:58:18.290328 13512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:18.294370 13512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489: No bootstrap required, opened a new log
I20250114 20:58:18.296437 13512 raft_consensus.cc:357] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65fc30caa9a04cb3a894fc3768548489" member_type: VOTER }
I20250114 20:58:18.296937 13512 raft_consensus.cc:383] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:18.297175 13512 raft_consensus.cc:738] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65fc30caa9a04cb3a894fc3768548489, State: Initialized, Role: FOLLOWER
I20250114 20:58:18.297735 13512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65fc30caa9a04cb3a894fc3768548489" member_type: VOTER }
I20250114 20:58:18.298213 13512 raft_consensus.cc:397] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:18.298417 13512 raft_consensus.cc:491] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:18.298681 13512 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:18.302690 13512 raft_consensus.cc:513] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65fc30caa9a04cb3a894fc3768548489" member_type: VOTER }
I20250114 20:58:18.303185 13512 leader_election.cc:304] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65fc30caa9a04cb3a894fc3768548489; no voters:
I20250114 20:58:18.304456 13512 leader_election.cc:290] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:18.304847 13515 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:18.306360 13515 raft_consensus.cc:695] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 1 LEADER]: Becoming Leader. State: Replica: 65fc30caa9a04cb3a894fc3768548489, State: Running, Role: LEADER
I20250114 20:58:18.307228 13515 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65fc30caa9a04cb3a894fc3768548489" member_type: VOTER }
I20250114 20:58:18.307988 13512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:18.310217 13516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65fc30caa9a04cb3a894fc3768548489" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65fc30caa9a04cb3a894fc3768548489" member_type: VOTER } }
I20250114 20:58:18.310753 13516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:18.319599 13517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65fc30caa9a04cb3a894fc3768548489. Latest consensus state: current_term: 1 leader_uuid: "65fc30caa9a04cb3a894fc3768548489" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65fc30caa9a04cb3a894fc3768548489" member_type: VOTER } }
I20250114 20:58:18.320230 13521 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:18.320510 13517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:18.328641 13521 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:18.337622 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:18.338586 13521 catalog_manager.cc:1348] Generated new cluster ID: 4043978f30a248c4a6bf7e4860b43293
I20250114 20:58:18.338855 13521 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:18.360616 13521 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:18.361693 13521 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:18.373571 13521 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489: Generated new TSK 0
I20250114 20:58:18.374110 13521 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:18.403719 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:18.409579 13534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:18.411846 13535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:18.413667 13537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:18.414402 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:18.415198 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:18.415364 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:18.415495 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888298415479 us; error 0 us; skew 500 ppm
I20250114 20:58:18.415902 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:18.418399 6853 webserver.cc:458] Webserver started at http://127.6.177.65:45859/ using document root <none> and password file <none>
I20250114 20:58:18.418846 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:18.419039 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:18.419332 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:18.420702 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "231fca5d05874b70b146b2b177742902"
format_stamp: "Formatted at 2025-01-14 20:58:18 on dist-test-slave-26qh"
I20250114 20:58:18.426095 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20250114 20:58:18.428994 13542 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:18.429718 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250114 20:58:18.429951 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "231fca5d05874b70b146b2b177742902"
format_stamp: "Formatted at 2025-01-14 20:58:18 on dist-test-slave-26qh"
I20250114 20:58:18.430173 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpdate_0.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:18.441766 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:18.442683 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:18.454521 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:18.454895 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20250114 20:58:18.455262 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:18.455547 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:18.524672 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:45893
I20250114 20:58:18.524879 13612 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:45893 every 8 connection(s)
I20250114 20:58:18.529067 13613 heartbeater.cc:346] Connected to a master server at 127.6.177.126:36929
I20250114 20:58:18.529392 13613 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:18.530012 13613 heartbeater.cc:510] Master 127.6.177.126:36929 requested a full tablet report, sending...
I20250114 20:58:18.531911 13467 ts_manager.cc:194] Registered new tserver with Master: 231fca5d05874b70b146b2b177742902 (127.6.177.65:45893)
I20250114 20:58:18.532557 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004773156s
I20250114 20:58:18.534168 13467 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45450
I20250114 20:58:18.546995 13613 heartbeater.cc:502] Master 127.6.177.126:36929 was elected leader, sending a full tablet report...
I20250114 20:58:18.553745 13466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45474:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "imm_val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: true
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:18.589254 13578 tablet_service.cc:1467] Processing CreateTablet for tablet 88732aa2cee94f90944b858ce48d0e00 (DEFAULT_TABLE table=client-testtb [id=3321b4fd309a4e809d29553b5e1becc7]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:58:18.589623 13577 tablet_service.cc:1467] Processing CreateTablet for tablet d5537edd49e848c396b6c629795a2343 (DEFAULT_TABLE table=client-testtb [id=3321b4fd309a4e809d29553b5e1becc7]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:58:18.590509 13578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88732aa2cee94f90944b858ce48d0e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:18.591152 13577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5537edd49e848c396b6c629795a2343. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:18.606174 13623 tablet_bootstrap.cc:492] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902: Bootstrap starting.
I20250114 20:58:18.612188 13623 tablet_bootstrap.cc:654] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:18.617049 13623 tablet_bootstrap.cc:492] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902: No bootstrap required, opened a new log
I20250114 20:58:18.617412 13623 ts_tablet_manager.cc:1397] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20250114 20:58:18.619917 13623 raft_consensus.cc:357] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.620374 13623 raft_consensus.cc:383] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:18.620609 13623 raft_consensus.cc:738] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 231fca5d05874b70b146b2b177742902, State: Initialized, Role: FOLLOWER
I20250114 20:58:18.621117 13623 consensus_queue.cc:260] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.621644 13623 raft_consensus.cc:397] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:18.621901 13623 raft_consensus.cc:491] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:18.622179 13623 raft_consensus.cc:3054] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:18.628098 13623 raft_consensus.cc:513] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.628636 13623 leader_election.cc:304] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 231fca5d05874b70b146b2b177742902; no voters:
I20250114 20:58:18.629917 13623 leader_election.cc:290] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:18.630244 13625 raft_consensus.cc:2798] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:18.631712 13625 raft_consensus.cc:695] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 1 LEADER]: Becoming Leader. State: Replica: 231fca5d05874b70b146b2b177742902, State: Running, Role: LEADER
I20250114 20:58:18.632313 13625 consensus_queue.cc:237] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.638012 13623 ts_tablet_manager.cc:1428] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902: Time spent starting tablet: real 0.020s user 0.014s sys 0.007s
I20250114 20:58:18.638881 13623 tablet_bootstrap.cc:492] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902: Bootstrap starting.
I20250114 20:58:18.638638 13466 catalog_manager.cc:5526] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 231fca5d05874b70b146b2b177742902 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "231fca5d05874b70b146b2b177742902" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:18.644887 13623 tablet_bootstrap.cc:654] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:18.649986 13623 tablet_bootstrap.cc:492] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902: No bootstrap required, opened a new log
I20250114 20:58:18.650290 13623 ts_tablet_manager.cc:1397] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20250114 20:58:18.652405 13623 raft_consensus.cc:357] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.652882 13623 raft_consensus.cc:383] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:18.653136 13623 raft_consensus.cc:738] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 231fca5d05874b70b146b2b177742902, State: Initialized, Role: FOLLOWER
I20250114 20:58:18.654134 13623 consensus_queue.cc:260] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.654744 13623 raft_consensus.cc:397] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:18.655022 13623 raft_consensus.cc:491] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:18.655316 13623 raft_consensus.cc:3054] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:18.660290 13623 raft_consensus.cc:513] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.660763 13623 leader_election.cc:304] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 231fca5d05874b70b146b2b177742902; no voters:
I20250114 20:58:18.661145 13623 leader_election.cc:290] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:18.661372 13627 raft_consensus.cc:2798] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:18.661777 13627 raft_consensus.cc:695] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 1 LEADER]: Becoming Leader. State: Replica: 231fca5d05874b70b146b2b177742902, State: Running, Role: LEADER
I20250114 20:58:18.662364 13627 consensus_queue.cc:237] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } }
I20250114 20:58:18.662861 13623 ts_tablet_manager.cc:1428] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902: Time spent starting tablet: real 0.012s user 0.003s sys 0.007s
I20250114 20:58:18.667706 13466 catalog_manager.cc:5526] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 reported cstate change: term changed from 0 to 1, leader changed from <none> to 231fca5d05874b70b146b2b177742902 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "231fca5d05874b70b146b2b177742902" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "231fca5d05874b70b146b2b177742902" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 45893 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:18.777366 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:18.803753 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:18.806355 6853 tablet_replica.cc:331] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902: stopping tablet replica
I20250114 20:58:18.806903 6853 raft_consensus.cc:2238] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:18.807379 6853 raft_consensus.cc:2267] T 88732aa2cee94f90944b858ce48d0e00 P 231fca5d05874b70b146b2b177742902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:18.809567 6853 tablet_replica.cc:331] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902: stopping tablet replica
I20250114 20:58:18.809979 6853 raft_consensus.cc:2238] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:18.810393 6853 raft_consensus.cc:2267] T d5537edd49e848c396b6c629795a2343 P 231fca5d05874b70b146b2b177742902 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:18.832588 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:18.846905 6853 master.cc:537] Master@127.6.177.126:36929 shutting down...
I20250114 20:58:18.865844 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:18.866354 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:18.866837 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 65fc30caa9a04cb3a894fc3768548489: stopping tablet replica
I20250114 20:58:18.886641 6853 master.cc:559] Master@127.6.177.126:36929 shutdown complete.
[ OK ] Params/ClientTestImmutableColumn.TestUpdate/0 (736 ms)
[ RUN ] Params/ClientTestImmutableColumn.TestUpsertIgnore/0
I20250114 20:58:18.912798 6853 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.177.126:36343
I20250114 20:58:18.913980 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:18.919061 13634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:18.919255 13635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:18.922855 6853 server_base.cc:1034] running on GCE node
W20250114 20:58:18.923496 13637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:18.924351 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:18.924579 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:18.924728 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888298924717 us; error 0 us; skew 500 ppm
I20250114 20:58:18.925271 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:18.932907 6853 webserver.cc:458] Webserver started at http://127.6.177.126:39439/ using document root <none> and password file <none>
I20250114 20:58:18.933450 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:18.933656 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:18.933952 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:18.935237 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/master-0-root/instance:
uuid: "559a52561ee446f792746d8eeebc72cd"
format_stamp: "Formatted at 2025-01-14 20:58:18 on dist-test-slave-26qh"
I20250114 20:58:18.940181 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250114 20:58:18.943636 13642 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:18.944406 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20250114 20:58:18.944671 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/master-0-root
uuid: "559a52561ee446f792746d8eeebc72cd"
format_stamp: "Formatted at 2025-01-14 20:58:18 on dist-test-slave-26qh"
I20250114 20:58:18.944952 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:18.956377 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:18.957345 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:19.002290 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.126:36343
I20250114 20:58:19.002384 13703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.126:36343 every 8 connection(s)
I20250114 20:58:19.006381 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:19.016072 13704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd: Bootstrap starting.
I20250114 20:58:19.020076 13704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:19.023844 13704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd: No bootstrap required, opened a new log
I20250114 20:58:19.025516 13704 raft_consensus.cc:357] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559a52561ee446f792746d8eeebc72cd" member_type: VOTER }
I20250114 20:58:19.025856 13704 raft_consensus.cc:383] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:19.026029 13704 raft_consensus.cc:738] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 559a52561ee446f792746d8eeebc72cd, State: Initialized, Role: FOLLOWER
I20250114 20:58:19.026480 13704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559a52561ee446f792746d8eeebc72cd" member_type: VOTER }
I20250114 20:58:19.026876 13704 raft_consensus.cc:397] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:19.027057 13704 raft_consensus.cc:491] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:19.027303 13704 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:19.030678 13704 raft_consensus.cc:513] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559a52561ee446f792746d8eeebc72cd" member_type: VOTER }
I20250114 20:58:19.031102 13704 leader_election.cc:304] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 559a52561ee446f792746d8eeebc72cd; no voters:
I20250114 20:58:19.032166 13704 leader_election.cc:290] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:19.032439 13707 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:19.035529 13707 raft_consensus.cc:695] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 1 LEADER]: Becoming Leader. State: Replica: 559a52561ee446f792746d8eeebc72cd, State: Running, Role: LEADER
I20250114 20:58:19.035804 13704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [sys.catalog]: configured and running, proceeding with master startup.
I20250114 20:58:19.036134 13707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559a52561ee446f792746d8eeebc72cd" member_type: VOTER }
I20250114 20:58:19.038667 13708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "559a52561ee446f792746d8eeebc72cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559a52561ee446f792746d8eeebc72cd" member_type: VOTER } }
I20250114 20:58:19.039202 13708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:19.039798 13709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 559a52561ee446f792746d8eeebc72cd. Latest consensus state: current_term: 1 leader_uuid: "559a52561ee446f792746d8eeebc72cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "559a52561ee446f792746d8eeebc72cd" member_type: VOTER } }
I20250114 20:58:19.040431 13709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [sys.catalog]: This master's current role is: LEADER
I20250114 20:58:19.050396 13713 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250114 20:58:19.058813 13713 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250114 20:58:19.060094 6853 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250114 20:58:19.068032 13713 catalog_manager.cc:1348] Generated new cluster ID: c598839fc3124e7387e308a917f1b002
I20250114 20:58:19.068442 13713 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250114 20:58:19.089174 13713 catalog_manager.cc:1371] Generated new certificate authority record
I20250114 20:58:19.090171 13713 catalog_manager.cc:1505] Loading token signing keys...
I20250114 20:58:19.110504 13713 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd: Generated new TSK 0
I20250114 20:58:19.110976 13713 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250114 20:58:19.126477 6853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250114 20:58:19.132401 13725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:19.133875 13726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250114 20:58:19.134909 13728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250114 20:58:19.135265 6853 server_base.cc:1034] running on GCE node
I20250114 20:58:19.135988 6853 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250114 20:58:19.136168 6853 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250114 20:58:19.136296 6853 hybrid_clock.cc:648] HybridClock initialized: now 1736888299136279 us; error 0 us; skew 500 ppm
I20250114 20:58:19.136690 6853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250114 20:58:19.139317 6853 webserver.cc:458] Webserver started at http://127.6.177.65:37115/ using document root <none> and password file <none>
I20250114 20:58:19.139737 6853 fs_manager.cc:362] Metadata directory not provided
I20250114 20:58:19.139904 6853 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250114 20:58:19.140125 6853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250114 20:58:19.141081 6853 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/ts-0-root/instance:
uuid: "733e0a76ea454d849ceb4d1c610b7140"
format_stamp: "Formatted at 2025-01-14 20:58:19 on dist-test-slave-26qh"
I20250114 20:58:19.144949 6853 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250114 20:58:19.147840 13733 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:19.148566 6853 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250114 20:58:19.148862 6853 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/ts-0-root
uuid: "733e0a76ea454d849ceb4d1c610b7140"
format_stamp: "Formatted at 2025-01-14 20:58:19 on dist-test-slave-26qh"
I20250114 20:58:19.149200 6853 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDtcdH4/test-tmp/client-test.0.Params_ClientTestImmutableColumn.TestUpsertIgnore_0.1736888227440588-6853-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250114 20:58:19.159849 6853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250114 20:58:19.160971 6853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250114 20:58:19.180644 6853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250114 20:58:19.180902 6853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:19.181180 6853 ts_tablet_manager.cc:610] Registered 0 tablets
I20250114 20:58:19.181361 6853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250114 20:58:19.237428 6853 rpc_server.cc:307] RPC server started. Bound to: 127.6.177.65:35749
I20250114 20:58:19.237501 13803 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.177.65:35749 every 8 connection(s)
I20250114 20:58:19.242853 13804 heartbeater.cc:346] Connected to a master server at 127.6.177.126:36343
I20250114 20:58:19.243201 13804 heartbeater.cc:463] Registering TS with master...
I20250114 20:58:19.243861 13804 heartbeater.cc:510] Master 127.6.177.126:36343 requested a full tablet report, sending...
I20250114 20:58:19.245963 13659 ts_manager.cc:194] Registered new tserver with Master: 733e0a76ea454d849ceb4d1c610b7140 (127.6.177.65:35749)
I20250114 20:58:19.246426 6853 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004972984s
I20250114 20:58:19.247795 13659 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54166
I20250114 20:58:19.260396 13804 heartbeater.cc:502] Master 127.6.177.126:36343 was elected leader, sending a full tablet report...
I20250114 20:58:19.270419 13659 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54194:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "imm_val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: true
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250114 20:58:19.301584 13769 tablet_service.cc:1467] Processing CreateTablet for tablet 9dcf5b62973f41879460c678a8ba54ed (DEFAULT_TABLE table=client-testtb [id=c5ba38f86a2642deb2bd08d3473a3fa9]), partition=RANGE (key) PARTITION VALUES < 9
I20250114 20:58:19.301855 13768 tablet_service.cc:1467] Processing CreateTablet for tablet 8e6b3518d0ba45928b2a1079e6453f73 (DEFAULT_TABLE table=client-testtb [id=c5ba38f86a2642deb2bd08d3473a3fa9]), partition=RANGE (key) PARTITION 9 <= VALUES
I20250114 20:58:19.302739 13769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dcf5b62973f41879460c678a8ba54ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:19.303614 13768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6b3518d0ba45928b2a1079e6453f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250114 20:58:19.320495 13814 tablet_bootstrap.cc:492] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140: Bootstrap starting.
I20250114 20:58:19.324956 13814 tablet_bootstrap.cc:654] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:19.330598 13814 tablet_bootstrap.cc:492] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140: No bootstrap required, opened a new log
I20250114 20:58:19.330955 13814 ts_tablet_manager.cc:1397] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20250114 20:58:19.332753 13814 raft_consensus.cc:357] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.333141 13814 raft_consensus.cc:383] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:19.333389 13814 raft_consensus.cc:738] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733e0a76ea454d849ceb4d1c610b7140, State: Initialized, Role: FOLLOWER
I20250114 20:58:19.333885 13814 consensus_queue.cc:260] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.334352 13814 raft_consensus.cc:397] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:19.334569 13814 raft_consensus.cc:491] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:19.334832 13814 raft_consensus.cc:3054] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:19.339660 13814 raft_consensus.cc:513] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.340086 13814 leader_election.cc:304] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 733e0a76ea454d849ceb4d1c610b7140; no voters:
I20250114 20:58:19.341181 13814 leader_election.cc:290] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:19.341516 13816 raft_consensus.cc:2798] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:19.344756 13816 raft_consensus.cc:695] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 1 LEADER]: Becoming Leader. State: Replica: 733e0a76ea454d849ceb4d1c610b7140, State: Running, Role: LEADER
I20250114 20:58:19.345413 13814 ts_tablet_manager.cc:1428] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140: Time spent starting tablet: real 0.014s user 0.012s sys 0.001s
I20250114 20:58:19.345417 13816 consensus_queue.cc:237] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.346450 13814 tablet_bootstrap.cc:492] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140: Bootstrap starting.
I20250114 20:58:19.352759 13814 tablet_bootstrap.cc:654] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140: Neither blocks nor log segments found. Creating new log.
I20250114 20:58:19.355655 13659 catalog_manager.cc:5526] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 reported cstate change: term changed from 0 to 1, leader changed from <none> to 733e0a76ea454d849ceb4d1c610b7140 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "733e0a76ea454d849ceb4d1c610b7140" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:19.357684 13814 tablet_bootstrap.cc:492] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140: No bootstrap required, opened a new log
I20250114 20:58:19.358072 13814 ts_tablet_manager.cc:1397] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20250114 20:58:19.360033 13814 raft_consensus.cc:357] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.360496 13814 raft_consensus.cc:383] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250114 20:58:19.360754 13814 raft_consensus.cc:738] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 733e0a76ea454d849ceb4d1c610b7140, State: Initialized, Role: FOLLOWER
I20250114 20:58:19.361223 13814 consensus_queue.cc:260] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.361728 13814 raft_consensus.cc:397] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250114 20:58:19.361980 13814 raft_consensus.cc:491] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250114 20:58:19.362246 13814 raft_consensus.cc:3054] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 0 FOLLOWER]: Advancing to term 1
I20250114 20:58:19.367370 13814 raft_consensus.cc:513] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.367961 13814 leader_election.cc:304] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 733e0a76ea454d849ceb4d1c610b7140; no voters:
I20250114 20:58:19.368489 13814 leader_election.cc:290] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250114 20:58:19.368635 13817 raft_consensus.cc:2798] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 1 FOLLOWER]: Leader election won for term 1
I20250114 20:58:19.369140 13817 raft_consensus.cc:695] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 1 LEADER]: Becoming Leader. State: Replica: 733e0a76ea454d849ceb4d1c610b7140, State: Running, Role: LEADER
I20250114 20:58:19.369699 13817 consensus_queue.cc:237] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } }
I20250114 20:58:19.370363 13814 ts_tablet_manager.cc:1428] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20250114 20:58:19.374696 13659 catalog_manager.cc:5526] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 reported cstate change: term changed from 0 to 1, leader changed from <none> to 733e0a76ea454d849ceb4d1c610b7140 (127.6.177.65). New cstate: current_term: 1 leader_uuid: "733e0a76ea454d849ceb4d1c610b7140" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "733e0a76ea454d849ceb4d1c610b7140" member_type: VOTER last_known_addr { host: "127.6.177.65" port: 35749 } health_report { overall_health: HEALTHY } } }
I20250114 20:58:19.467242 6853 tablet_server.cc:178] TabletServer@127.6.177.65:0 shutting down...
I20250114 20:58:19.486760 6853 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250114 20:58:19.487542 6853 tablet_replica.cc:331] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140: stopping tablet replica
I20250114 20:58:19.488188 6853 raft_consensus.cc:2238] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:19.488670 6853 raft_consensus.cc:2267] T 8e6b3518d0ba45928b2a1079e6453f73 P 733e0a76ea454d849ceb4d1c610b7140 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:19.491420 6853 tablet_replica.cc:331] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140: stopping tablet replica
I20250114 20:58:19.491958 6853 raft_consensus.cc:2238] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:19.492429 6853 raft_consensus.cc:2267] T 9dcf5b62973f41879460c678a8ba54ed P 733e0a76ea454d849ceb4d1c610b7140 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:19.505033 6853 tablet_server.cc:195] TabletServer@127.6.177.65:0 shutdown complete.
I20250114 20:58:19.515887 6853 master.cc:537] Master@127.6.177.126:36343 shutting down...
I20250114 20:58:19.537757 6853 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 1 LEADER]: Raft consensus shutting down.
I20250114 20:58:19.538231 6853 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20250114 20:58:19.538686 6853 tablet_replica.cc:331] T 00000000000000000000000000000000 P 559a52561ee446f792746d8eeebc72cd: stopping tablet replica
I20250114 20:58:19.548171 6853 master.cc:559] Master@127.6.177.126:36343 shutdown complete.
[ OK ] Params/ClientTestImmutableColumn.TestUpsertIgnore/0 (655 ms)
[----------] 2 tests from Params/ClientTestImmutableColumn (1392 ms total)
[----------] Global test environment tear-down
[==========] 28 tests from 7 test suites ran. (71971 ms total)
[ PASSED ] 25 tests.
[ SKIPPED ] 2 tests, listed below:
[ SKIPPED ] ClientTest.TestDefaultRPCTimeoutSessionTimeoutDifferent
[ SKIPPED ] KeepAlivePeriodically/KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyScannerTolerate/1
[ FAILED ] 1 test, listed below:
[ FAILED ] ClientTest.TestScanTimeout
1 FAILED TEST
I20250114 20:58:19.605247 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 1 messages since previous log ~2 seconds ago
I20250114 20:58:19.605497 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2367: suppressed but not reported on 20 messages since previous log ~31 seconds ago
I20250114 20:58:19.605675 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 1 messages since previous log ~26 seconds ago
I20250114 20:58:19.605861 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 1 messages since previous log ~26 seconds ago
I20250114 20:58:19.606020 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/meta_cache.cc:302: suppressed but not reported on 3 messages since previous log ~29 seconds ago
I20250114 20:58:19.606199 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/master_proxy_rpc.cc:203: suppressed but not reported on 4 messages since previous log ~42 seconds ago
I20250114 20:58:19.606438 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/master_proxy_rpc.cc:203: suppressed but not reported on 6 messages since previous log ~69 seconds ago
I20250114 20:58:19.606595 6853 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:643: suppressed but not reported on 158 messages since previous log ~69 seconds ago